Nov 08 16:46:35 user nova-compute[74669]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74669) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 16:46:35 user nova-compute[74669]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74669) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 16:46:35 user nova-compute[74669]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74669) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 16:46:35 user nova-compute[74669]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 08 16:46:35 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:46:35 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:46:35 user nova-compute[74669]: INFO nova.virt.driver [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 08 16:46:35 user nova-compute[74669]: INFO nova.compute.provider_config [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] Acquiring lock "singleton_lock" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] Acquired lock "singleton_lock" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] Releasing lock "singleton_lock" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] Full set of CONF: {{(pid=74669) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ******************************************************************************** {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] Configuration options gathered from: {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ================================================================================ {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] allow_resize_to_same_host      = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] arq_binding_timeout            = 300 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] backdoor_port                  = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] backdoor_socket                = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] block_device_allocate_retries  = 300 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] block_device_allocate_retries_interval = 5 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cert                           = self.pem {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] compute_monitors               = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] config_dir                     = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] config_drive_format            = iso9660 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] config_source                  = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] console_host                   = user {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] control_exchange               = nova {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cpu_allocation_ratio           = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] daemon                         = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] debug                          = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] default_access_ip_network_name = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] default_availability_zone      = nova {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] default_ephemeral_format       = ext4 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] default_green_pool_size        = 1000 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] default_schedule_zone          = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] disk_allocation_ratio          = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] enable_new_services            = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] enabled_ssl_apis               = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] flat_injected                  = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] force_config_drive             = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] force_raw_images               = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] graceful_shutdown_timeout      = 5 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] heal_instance_info_cache_interval = 60 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] host                           = user {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] instance_build_timeout         = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] instance_delete_interval       = 300 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] instance_name_template         = instance-%08x {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] instance_usage_audit           = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] instance_usage_audit_period    = month {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] internal_service_availability_zone = internal {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] key                            = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] live_migration_retry_count     = 30 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] log_config_append              = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] log_dir                        = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] log_file                       = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] log_options                    = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] log_rotate_interval            = 1 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] log_rotate_interval_type       = days {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] log_rotation_type              = none {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] long_rpc_timeout               = 1800 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] max_concurrent_builds          = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] max_concurrent_live_migrations = 1 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] max_concurrent_snapshots       = 5 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] max_local_block_devices        = 3 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] max_logfile_count              = 30 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] max_logfile_size_mb            = 200 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] maximum_instance_delete_attempts = 5 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] metadata_listen                = 0.0.0.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] metadata_listen_port           = 8775 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] metadata_workers               = 3 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] migrate_max_retries            = -1 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] mkisofs_cmd                    = genisoimage {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] my_ip                          = 10.0.0.210 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] network_allocate_retries       = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] osapi_compute_listen_port      = 8774 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] osapi_compute_unique_server_name_scope =  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] osapi_compute_workers          = 3 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] password_length                = 12 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] periodic_enable                = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] periodic_fuzzy_delay           = 60 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] pointer_model                  = ps2mouse {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] preallocate_images             = none {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] publish_errors                 = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] pybasedir                      = /opt/stack/nova {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ram_allocation_ratio           = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] rate_limit_burst               = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] rate_limit_except_level        = CRITICAL {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] rate_limit_interval            = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] reboot_timeout                 = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] reclaim_instance_interval      = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] record                         = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] reimage_timeout_per_gb         = 60 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] report_interval                = 120 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] rescue_timeout                 = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] reserved_host_cpus             = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] reserved_host_disk_mb          = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] reserved_host_memory_mb        = 512 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] reserved_huge_pages            = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] resize_confirm_window          = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] resize_fs_using_block_device   = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] resume_guests_state_on_host_boot = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] rpc_response_timeout           = 60 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] run_external_periodic_tasks    = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] running_deleted_instance_action = reap {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] running_deleted_instance_timeout = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] scheduler_instance_sync_interval = 120 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] service_down_time              = 720 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] servicegroup_driver            = db {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] shelved_offload_time           = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] shelved_poll_interval          = 3600 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] shutdown_timeout               = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] source_is_ipv6                 = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ssl_only                       = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] state_path                     = /opt/stack/data/nova {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] sync_power_state_interval      = 600 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] sync_power_state_pool_size     = 1000 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] syslog_log_facility            = LOG_USER {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] tempdir                        = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] timeout_nbd                    = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] transport_url                  = **** {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] update_resources_interval      = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] use_cow_images                 = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] use_eventlog                   = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] use_journal                    = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] use_json                       = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] use_rootwrap_daemon            = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] use_stderr                     = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] use_syslog                     = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vcpu_pin_set                   = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vif_plugging_is_fatal          = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vif_plugging_timeout           = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] virt_mkfs                      = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] volume_usage_poll_interval     = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] watch_log_file                 = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] web                            = /usr/share/spice-html5 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_concurrency.disable_process_locking = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.auth_strategy              = keystone {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.compute_link_prefix        = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.dhcp_domain                = novalocal {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.enable_instance_password   = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.glance_link_prefix         = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.instance_list_per_project_cells = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.list_records_by_skipping_down_cells = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.local_metadata_per_cell    = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.max_limit                  = 1000 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.metadata_cache_expiration  = 15 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.neutron_default_tenant_id  = default {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.use_forwarded_for          = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.use_neutron_default_nets   = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.vendordata_dynamic_targets = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.vendordata_jsonfile_path   = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.backend_argument         = **** {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.config_prefix            = cache.oslo {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.dead_timeout             = 60.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.debug_cache_backend      = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.enable_retry_client      = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.enable_socket_keepalive  = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.enabled                  = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.expiration_time          = 600 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.hashclient_retry_attempts = 2 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.memcache_dead_retry      = 300 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.memcache_password        =  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.memcache_sasl_enabled    = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.memcache_username        =  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.proxies                  = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.retry_attempts           = 2 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.retry_delay              = 0.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.socket_keepalive_count   = 1 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.socket_keepalive_idle    = 1 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.socket_keepalive_interval = 1 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.tls_allowed_ciphers      = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.tls_cafile               = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.tls_certfile             = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.tls_enabled              = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cache.tls_keyfile              = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cinder.auth_section            = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cinder.auth_type               = password {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cinder.cafile                  = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cinder.certfile                = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cinder.collect_timing          = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cinder.cross_az_attach         = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cinder.debug                   = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cinder.endpoint_template       = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cinder.http_retries            = 3 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cinder.insecure                = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cinder.keyfile                 = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cinder.os_region_name          = RegionOne {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cinder.split_loggers           = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cinder.timeout                 = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] compute.cpu_dedicated_set      = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] compute.cpu_shared_set         = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] compute.image_type_exclude_list = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] compute.resource_provider_association_refresh = 300 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] compute.shutdown_retry_interval = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] conductor.workers              = 3 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] console.allowed_origins        = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] console.ssl_ciphers            = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] console.ssl_minimum_version    = default {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] consoleauth.token_ttl          = 600 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cyborg.cafile                  = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cyborg.certfile                = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cyborg.collect_timing          = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cyborg.connect_retries         = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cyborg.connect_retry_delay     = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cyborg.endpoint_override       = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cyborg.insecure                = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cyborg.keyfile                 = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cyborg.max_version             = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cyborg.min_version             = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cyborg.region_name             = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cyborg.service_name            = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cyborg.service_type            = accelerator {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cyborg.split_loggers           = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cyborg.status_code_retries     = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cyborg.status_code_retry_delay = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cyborg.timeout                 = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] cyborg.version                 = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] database.backend               = sqlalchemy {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] database.connection            = **** {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] database.connection_debug      = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] database.connection_parameters =  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] database.connection_recycle_time = 3600 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] database.connection_trace      = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] database.db_inc_retry_interval = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] database.db_max_retries        = 20 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] database.db_max_retry_interval = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] database.db_retry_interval     = 1 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] database.max_overflow          = 50 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] database.max_pool_size         = 5 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] database.max_retries           = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] database.mysql_wsrep_sync_wait = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] database.pool_timeout          = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] database.retry_interval        = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] database.slave_connection      = **** {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] database.sqlite_synchronous    = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api_database.backend           = sqlalchemy {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api_database.connection        = **** {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api_database.connection_debug  = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api_database.connection_parameters =  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api_database.connection_recycle_time = 3600 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api_database.connection_trace  = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api_database.db_inc_retry_interval = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api_database.db_max_retries    = 20 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api_database.db_max_retry_interval = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api_database.db_retry_interval = 1 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api_database.max_overflow      = 50 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api_database.max_pool_size     = 5 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api_database.max_retries       = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api_database.pool_timeout      = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api_database.retry_interval    = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api_database.slave_connection  = **** {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] api_database.sqlite_synchronous = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] devices.enabled_mdev_types     = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ephemeral_storage_encryption.enabled = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.api_servers             = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.cafile                  = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.certfile                = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.collect_timing          = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.connect_retries         = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.connect_retry_delay     = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.debug                   = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.default_trusted_certificate_ids = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.enable_certificate_validation = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.enable_rbd_download     = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.endpoint_override       = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.insecure                = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.keyfile                 = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.max_version             = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.min_version             = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.num_retries             = 3 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.rbd_ceph_conf           =  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.rbd_connect_timeout     = 5 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.rbd_pool                =  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.rbd_user                =  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.region_name             = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.service_name            = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.service_type            = image {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.split_loggers           = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.status_code_retries     = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.status_code_retry_delay = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.timeout                 = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.verify_glance_signatures = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] glance.version                 = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] guestfs.debug                  = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] hyperv.config_drive_cdrom      = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] hyperv.config_drive_inject_password = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] hyperv.enable_remotefx         = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] hyperv.instances_path_share    =  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] hyperv.limit_cpu_features      = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] hyperv.use_multipath_io        = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] hyperv.vswitch_name            = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] mks.enabled                    = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] image_cache.manager_interval   = 2400 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] image_cache.precache_concurrency = 1 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] image_cache.remove_unused_base_images = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] image_cache.subdirectory_name  = _base {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.api_max_retries         = 60 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.api_retry_interval      = 2 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.auth_section            = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.auth_type               = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.cafile                  = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.certfile                = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.collect_timing          = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.conductor_group         = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.connect_retries         = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.connect_retry_delay     = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.endpoint_override       = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.insecure                = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.keyfile                 = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.max_version             = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.min_version             = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.peer_list               = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.region_name             = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.serial_console_state_timeout = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.service_name            = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.service_type            = baremetal {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.split_loggers           = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.status_code_retries     = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.status_code_retry_delay = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.timeout                 = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ironic.version                 = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] key_manager.fixed_key          = **** {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican.barbican_api_version  = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican.barbican_endpoint     = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican.barbican_endpoint_type = public {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican.barbican_region_name  = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican.cafile                = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican.certfile              = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican.collect_timing        = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican.insecure              = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican.keyfile               = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican.number_of_retries     = 60 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican.retry_delay           = 1 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican.send_service_user_token = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican.split_loggers         = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican.timeout               = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican.verify_ssl            = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican.verify_ssl_path       = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican_service_user.auth_section = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican_service_user.auth_type = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican_service_user.cafile   = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican_service_user.certfile = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican_service_user.collect_timing = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican_service_user.insecure = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican_service_user.keyfile  = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican_service_user.split_loggers = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] barbican_service_user.timeout  = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vault.approle_role_id          = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vault.approle_secret_id        = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vault.cafile                   = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vault.certfile                 = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vault.collect_timing           = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vault.insecure                 = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vault.keyfile                  = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vault.kv_mountpoint            = secret {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vault.kv_path                  = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vault.kv_version               = 2 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vault.namespace                = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vault.root_token_id            = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vault.split_loggers            = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vault.ssl_ca_crt_file          = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vault.timeout                  = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vault.use_ssl                  = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] keystone.auth_section          = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] keystone.auth_type             = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] keystone.cafile                = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] keystone.certfile              = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] keystone.collect_timing        = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] keystone.connect_retries       = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] keystone.connect_retry_delay   = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] keystone.endpoint_override     = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] keystone.insecure              = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] keystone.keyfile               = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] keystone.max_version           = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] keystone.min_version           = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] keystone.region_name           = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] keystone.service_name          = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] keystone.service_type          = identity {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] keystone.split_loggers         = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] keystone.status_code_retries   = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] keystone.status_code_retry_delay = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] keystone.timeout               = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] keystone.version               = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.connection_uri         =  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.cpu_mode               = custom {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: WARNING oslo_config.cfg [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.cpu_power_governor_high = performance {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.cpu_power_management   = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.device_detach_attempts = 8 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.device_detach_timeout  = 20 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.disk_cachemodes        = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.disk_prefix            = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.enabled_perf_events    = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.file_backed_memory     = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.gid_maps               = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.hw_disk_discard        = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.hw_machine_type        = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.images_rbd_pool        = rbd {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.images_type            = default {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.images_volume_group    = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.inject_key             = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.inject_partition       = -2 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.inject_password        = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.iscsi_iface            = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.iser_use_multipath     = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.live_migration_downtime = 500 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.live_migration_inbound_addr = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.live_migration_scheme  = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.live_migration_timeout_action = abort {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.live_migration_tunnelled = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: WARNING oslo_config.cfg [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 08 16:46:36 user nova-compute[74669]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 08 16:46:36 user nova-compute[74669]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 08 16:46:36 user nova-compute[74669]: and ``live_migration_inbound_addr`` respectively.
Nov 08 16:46:36 user nova-compute[74669]: ).  Its value may be silently ignored in the future.
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.live_migration_with_native_tls = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.max_queues             = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.nfs_mount_options      = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.num_pcie_ports         = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.pmem_namespaces        = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.quobyte_client_cfg     = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.rbd_secret_uuid        = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.rbd_user               = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.rescue_image_id        = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.rescue_kernel_id       = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.rx_queue_size          = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.smbfs_mount_options    =  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.snapshot_compression   = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.snapshot_image_format  = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.sparse_logical_volumes = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.swtpm_enabled          = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.swtpm_group            = tss {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.swtpm_user             = tss {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.sysinfo_serial         = unique {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.tb_cache_size          = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.tx_queue_size          = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.uid_maps               = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.use_virtio_for_bridges = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.virt_type              = kvm {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.volume_clear           = zero {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.volume_clear_size      = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.volume_use_multipath   = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.vzstorage_cache_path   = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.auth_section           = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.auth_type              = password {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.cafile                 = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.certfile               = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.collect_timing         = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.connect_retries        = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.connect_retry_delay    = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.default_floating_pool  = public {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.endpoint_override      = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.extension_sync_interval = 600 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.http_retries           = 3 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.insecure               = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.keyfile                = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.max_version            = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.min_version            = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.ovs_bridge             = br-int {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.physnets               = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.region_name            = RegionOne {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.service_metadata_proxy = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.service_name           = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.service_type           = network {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.split_loggers          = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.status_code_retries    = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.status_code_retry_delay = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.timeout                = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] neutron.version                = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] notifications.bdms_in_notifications = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] notifications.default_level    = INFO {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] notifications.notification_format = unversioned {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] notifications.notify_on_state_change = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] pci.alias                      = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] pci.device_spec                = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] pci.report_in_placement        = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.auth_section         = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.auth_type            = password {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.cafile               = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.certfile             = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.collect_timing       = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.connect_retries      = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.connect_retry_delay  = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.default_domain_id    = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.default_domain_name  = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.domain_id            = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.domain_name          = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.endpoint_override    = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.insecure             = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.keyfile              = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.max_version          = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.min_version          = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.password             = **** {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.project_domain_id    = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.project_domain_name  = Default {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.project_id           = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.project_name         = service {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.region_name          = RegionOne {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.service_name         = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.service_type         = placement {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.split_loggers        = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.status_code_retries  = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.status_code_retry_delay = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.system_scope         = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.timeout              = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.trust_id             = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.user_domain_id       = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.user_domain_name     = Default {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.user_id              = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.username             = placement {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] placement.version              = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] quota.cores                    = 20 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] quota.count_usage_from_placement = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] quota.injected_file_content_bytes = 10240 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] quota.injected_file_path_length = 255 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] quota.injected_files           = 5 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] quota.instances                = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] quota.key_pairs                = 100 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] quota.metadata_items           = 128 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] quota.ram                      = 51200 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] quota.recheck_quota            = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] quota.server_group_members     = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] quota.server_groups            = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] rdp.enabled                    = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] scheduler.image_metadata_prefilter = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] scheduler.max_attempts         = 3 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] scheduler.max_placement_results = 1000 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] scheduler.workers              = 3 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.host_subset_size = 1 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.isolated_hosts = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.isolated_images = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.pci_in_placement = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.track_instance_changes = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] metrics.required               = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] metrics.weight_multiplier      = 1.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] metrics.weight_setting         = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] serial_console.enabled         = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] serial_console.port_range      = 10000:20000 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] serial_console.serialproxy_port = 6083 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] service_user.auth_section      = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] service_user.auth_type         = password {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] service_user.cafile            = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] service_user.certfile          = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] service_user.collect_timing    = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] service_user.insecure          = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] service_user.keyfile           = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] service_user.send_service_user_token = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] service_user.split_loggers     = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] service_user.timeout           = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] spice.agent_enabled            = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] spice.enabled                  = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] spice.html5proxy_port          = 6082 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] spice.image_compression        = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] spice.jpeg_compression         = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] spice.playback_compression     = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] spice.server_listen            = 127.0.0.1 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] spice.streaming_mode           = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] spice.zlib_compression         = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] upgrade_levels.baseapi         = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] upgrade_levels.cert            = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] upgrade_levels.compute         = auto {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] upgrade_levels.conductor       = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] upgrade_levels.scheduler       = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vendordata_dynamic_auth.cafile = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vendordata_dynamic_auth.certfile = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vendordata_dynamic_auth.insecure = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vendordata_dynamic_auth.timeout = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.api_retry_count         = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.ca_file                 = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.cache_prefix            = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.cluster_name            = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.connection_pool_size    = 10 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.console_delay_seconds   = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.datastore_regex         = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.host_ip                 = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.host_password           = **** {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.host_port               = 443 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.host_username           = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.insecure                = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.integration_bridge      = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.maximum_objects         = 100 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.pbm_default_policy      = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.pbm_enabled             = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.pbm_wsdl_location       = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.serial_port_proxy_uri   = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.serial_port_service_uri = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.task_poll_interval      = 0.5 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.use_linked_clone        = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.vnc_keymap              = en-us {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.vnc_port                = 5900 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vmware.vnc_port_total          = 10000 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vnc.auth_schemes               = ['none'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vnc.enabled                    = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vnc.novncproxy_port            = 6080 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vnc.vencrypt_ca_certs          = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vnc.vencrypt_client_cert       = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vnc.vencrypt_client_key        = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] workarounds.disable_rootwrap   = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] workarounds.enable_numa_live_migration = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] workarounds.libvirt_disable_apic = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] wsgi.client_socket_timeout     = 900 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] wsgi.default_pool_size         = 1000 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] wsgi.keep_alive                = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] wsgi.max_header_line           = 16384 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] wsgi.ssl_ca_file               = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] wsgi.ssl_cert_file             = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] wsgi.ssl_key_file              = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] wsgi.tcp_keepidle              = 600 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] zvm.ca_file                    = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] zvm.cloud_connector_url        = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] zvm.reachable_timeout          = 300 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_policy.enforce_new_defaults = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_policy.enforce_scope      = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_policy.policy_default_rule = default {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] profiler.connection_string     = messaging:// {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] profiler.enabled               = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] profiler.es_doc_type           = notification {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] profiler.es_scroll_size        = 10000 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] profiler.es_scroll_time        = 2m {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] profiler.filter_error_trace    = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] profiler.hmac_keys             = **** {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] profiler.sentinel_service_name = mymaster {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] profiler.socket_timeout        = 0.1 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] profiler.trace_requests        = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] profiler.trace_sqlalchemy      = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] profiler_jaeger.process_tags   = {} {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] profiler_jaeger.service_name_prefix = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] profiler_otlp.service_name_prefix = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] remote_debug.host              = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] remote_debug.port              = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_notifications.retry = -1 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_limit.auth_section        = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_limit.auth_type           = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_limit.cafile              = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_limit.certfile            = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_limit.collect_timing      = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_limit.connect_retries     = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_limit.connect_retry_delay = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_limit.endpoint_id         = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_limit.endpoint_override   = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_limit.insecure            = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_limit.keyfile             = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_limit.max_version         = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_limit.min_version         = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_limit.region_name         = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_limit.service_name        = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_limit.service_type        = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_limit.split_loggers       = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_limit.status_code_retries = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_limit.status_code_retry_delay = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_limit.timeout             = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_limit.valid_interfaces    = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_limit.version             = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_reports.file_event_handler = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] oslo_reports.log_dir           = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vif_plug_ovs_privileged.group  = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] vif_plug_ovs_privileged.user   = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] os_vif_ovs.isolate_vif         = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] os_brick.lock_path             = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] privsep_osbrick.capabilities   = [21] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] privsep_osbrick.group          = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] privsep_osbrick.helper_command = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] privsep_osbrick.user           = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] nova_sys_admin.group           = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] nova_sys_admin.helper_command  = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] nova_sys_admin.user            = None {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG oslo_service.service [None req-bebb78d1-62a8-489f-9410-361855d8e566 None None] ******************************************************************************** {{(pid=74669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 08 16:46:36 user nova-compute[74669]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 08 16:46:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Connecting to libvirt: qemu:///system {{(pid=74669) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fd9b142f010> {{(pid=74669) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 08 16:46:36 user nova-compute[74669]: libvirt:  error : internal error: could not initialize domain event timer
Nov 08 16:46:36 user nova-compute[74669]: WARNING nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 08 16:46:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fd9b142f010> {{(pid=74669) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Starting native event thread {{(pid=74669) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Starting green dispatch thread {{(pid=74669) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 08 16:46:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Starting connection event dispatch thread {{(pid=74669) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 08 16:46:36 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Connection event '1' reason 'None'
Nov 08 16:46:36 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 08 16:46:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.mount [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Initialising _HostMountState generation 0 {{(pid=74669) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 08 16:46:43 user nova-compute[74669]: INFO nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Libvirt host capabilities <capabilities>
Nov 08 16:46:43 user nova-compute[74669]:   <host>
Nov 08 16:46:43 user nova-compute[74669]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 08 16:46:43 user nova-compute[74669]:     <cpu>
Nov 08 16:46:43 user nova-compute[74669]:       <arch>x86_64</arch>
Nov 08 16:46:43 user nova-compute[74669]:       <model>IvyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <vendor>Intel</vendor>
Nov 08 16:46:43 user nova-compute[74669]:       <microcode version='1070'/>
Nov 08 16:46:43 user nova-compute[74669]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 08 16:46:43 user nova-compute[74669]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature name='ss'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature name='vmx'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature name='pcid'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature name='osxsave'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature name='hypervisor'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature name='arat'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature name='tsc_adjust'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature name='md-clear'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature name='stibp'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature name='arch-capabilities'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature name='ssbd'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature name='invtsc'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature name='rsba'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature name='skip-l1dfl-vmentry'/>
Nov 08 16:46:43 user nova-compute[74669]:       <pages unit='KiB' size='4'/>
Nov 08 16:46:43 user nova-compute[74669]:       <pages unit='KiB' size='2048'/>
Nov 08 16:46:43 user nova-compute[74669]:     </cpu>
Nov 08 16:46:43 user nova-compute[74669]:     <power_management>
Nov 08 16:46:43 user nova-compute[74669]:       <suspend_mem/>
Nov 08 16:46:43 user nova-compute[74669]:       <suspend_disk/>
Nov 08 16:46:43 user nova-compute[74669]:       <suspend_hybrid/>
Nov 08 16:46:43 user nova-compute[74669]:     </power_management>
Nov 08 16:46:43 user nova-compute[74669]:     <iommu support='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     <migration_features>
Nov 08 16:46:43 user nova-compute[74669]:       <live/>
Nov 08 16:46:43 user nova-compute[74669]:       <uri_transports>
Nov 08 16:46:43 user nova-compute[74669]:         <uri_transport>tcp</uri_transport>
Nov 08 16:46:43 user nova-compute[74669]:         <uri_transport>rdma</uri_transport>
Nov 08 16:46:43 user nova-compute[74669]:       </uri_transports>
Nov 08 16:46:43 user nova-compute[74669]:     </migration_features>
Nov 08 16:46:43 user nova-compute[74669]:     <topology>
Nov 08 16:46:43 user nova-compute[74669]:       <cells num='2'>
Nov 08 16:46:43 user nova-compute[74669]:         <cell id='0'>
Nov 08 16:46:43 user nova-compute[74669]:           <memory unit='KiB'>8140616</memory>
Nov 08 16:46:43 user nova-compute[74669]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 08 16:46:43 user nova-compute[74669]:           <pages unit='KiB' size='2048'>0</pages>
Nov 08 16:46:43 user nova-compute[74669]:           <distances>
Nov 08 16:46:43 user nova-compute[74669]:             <sibling id='0' value='10'/>
Nov 08 16:46:43 user nova-compute[74669]:             <sibling id='1' value='20'/>
Nov 08 16:46:43 user nova-compute[74669]:           </distances>
Nov 08 16:46:43 user nova-compute[74669]:           <cpus num='6'>
Nov 08 16:46:43 user nova-compute[74669]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 08 16:46:43 user nova-compute[74669]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 08 16:46:43 user nova-compute[74669]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 08 16:46:43 user nova-compute[74669]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 08 16:46:43 user nova-compute[74669]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 08 16:46:43 user nova-compute[74669]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 08 16:46:43 user nova-compute[74669]:           </cpus>
Nov 08 16:46:43 user nova-compute[74669]:         </cell>
Nov 08 16:46:43 user nova-compute[74669]:         <cell id='1'>
Nov 08 16:46:43 user nova-compute[74669]:           <memory unit='KiB'>8255068</memory>
Nov 08 16:46:43 user nova-compute[74669]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 08 16:46:43 user nova-compute[74669]:           <pages unit='KiB' size='2048'>0</pages>
Nov 08 16:46:43 user nova-compute[74669]:           <distances>
Nov 08 16:46:43 user nova-compute[74669]:             <sibling id='0' value='20'/>
Nov 08 16:46:43 user nova-compute[74669]:             <sibling id='1' value='10'/>
Nov 08 16:46:43 user nova-compute[74669]:           </distances>
Nov 08 16:46:43 user nova-compute[74669]:           <cpus num='6'>
Nov 08 16:46:43 user nova-compute[74669]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 08 16:46:43 user nova-compute[74669]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 08 16:46:43 user nova-compute[74669]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 08 16:46:43 user nova-compute[74669]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 08 16:46:43 user nova-compute[74669]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 08 16:46:43 user nova-compute[74669]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 08 16:46:43 user nova-compute[74669]:           </cpus>
Nov 08 16:46:43 user nova-compute[74669]:         </cell>
Nov 08 16:46:43 user nova-compute[74669]:       </cells>
Nov 08 16:46:43 user nova-compute[74669]:     </topology>
Nov 08 16:46:43 user nova-compute[74669]:     <cache>
Nov 08 16:46:43 user nova-compute[74669]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 08 16:46:43 user nova-compute[74669]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 08 16:46:43 user nova-compute[74669]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 08 16:46:43 user nova-compute[74669]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 08 16:46:43 user nova-compute[74669]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 08 16:46:43 user nova-compute[74669]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 08 16:46:43 user nova-compute[74669]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 08 16:46:43 user nova-compute[74669]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 08 16:46:43 user nova-compute[74669]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 08 16:46:43 user nova-compute[74669]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 08 16:46:43 user nova-compute[74669]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 08 16:46:43 user nova-compute[74669]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 08 16:46:43 user nova-compute[74669]:     </cache>
Nov 08 16:46:43 user nova-compute[74669]:     <secmodel>
Nov 08 16:46:43 user nova-compute[74669]:       <model>apparmor</model>
Nov 08 16:46:43 user nova-compute[74669]:       <doi>0</doi>
Nov 08 16:46:43 user nova-compute[74669]:     </secmodel>
Nov 08 16:46:43 user nova-compute[74669]:     <secmodel>
Nov 08 16:46:43 user nova-compute[74669]:       <model>dac</model>
Nov 08 16:46:43 user nova-compute[74669]:       <doi>0</doi>
Nov 08 16:46:43 user nova-compute[74669]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 08 16:46:43 user nova-compute[74669]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 08 16:46:43 user nova-compute[74669]:     </secmodel>
Nov 08 16:46:43 user nova-compute[74669]:   </host>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='alpha'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>64</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>clipper</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='armv6l'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>32</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>spitz</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>nuri</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>kzm</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>sx1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>z2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>tosa</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>n810</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>n800</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>terrier</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>midway</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>microbit</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>verdex</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>highbank</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>akita</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>connex</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>collie</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='armv7l'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>32</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>spitz</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>nuri</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>kzm</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>sx1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>z2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>tosa</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>n810</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>n800</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>terrier</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>midway</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>microbit</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>verdex</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>highbank</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>akita</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>connex</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>collie</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='aarch64'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>64</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>spitz</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>nuri</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>kzm</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>sx1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>z2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>tosa</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>n810</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>n800</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>terrier</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>midway</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>microbit</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>verdex</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>raspi3b</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>highbank</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>akita</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>connex</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>collie</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <acpi default='on' toggle='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='cris'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>32</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='i686'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>32</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>x-remote</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>isapc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>microvm</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='kvm'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <pae/>
Nov 08 16:46:43 user nova-compute[74669]:       <nonpae/>
Nov 08 16:46:43 user nova-compute[74669]:       <acpi default='on' toggle='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:       <apic default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='m68k'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>32</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>an5206</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>q800</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>next-cube</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='microblaze'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>32</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='microblazeel'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>32</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='mips'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>32</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='16'>malta</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='mipsel'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>32</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='16'>malta</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='mips64'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>64</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='16'>malta</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>pica61</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>magnum</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='mips64el'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>64</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='16'>malta</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>pica61</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>magnum</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='16'>boston</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='ppc'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>32</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mac99</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>40p</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>taihu</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='ppc64'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>64</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2048'>powernv9</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>taihu</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2048'>powernv10</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>40p</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mac99</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2048'>powernv8</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='ppc64le'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>64</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2048'>powernv9</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>taihu</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2048'>powernv10</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>40p</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>mac99</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2048'>powernv8</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='riscv32'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>32</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='8'>spike</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>opentitan</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='5'>sifive_u</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>sifive_e</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='8'>virt</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='riscv64'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>64</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='8'>spike</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='5'>sifive_u</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>shakti_c</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>sifive_e</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='8'>virt</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='s390x'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>64</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='sh4'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>32</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>shix</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>r2d</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='sh4eb'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>64</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>shix</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>r2d</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='sparc'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>32</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>SS-5</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>SS-20</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>LX</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>SS-4</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>SS-10</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>Voyager</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='sparc64'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>64</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>sun4u</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>niagara</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>sun4v</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='x86_64'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>64</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>x-remote</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='1'>isapc</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>microvm</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='kvm'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <acpi default='on' toggle='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:       <apic default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='xtensa'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>32</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>sim</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='32'>kc705</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='32'>ml605</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='32'>virt</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='32'>lx200</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='32'>lx60</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]:   <guest>
Nov 08 16:46:43 user nova-compute[74669]:     <os_type>hvm</os_type>
Nov 08 16:46:43 user nova-compute[74669]:     <arch name='xtensaeb'>
Nov 08 16:46:43 user nova-compute[74669]:       <wordsize>32</wordsize>
Nov 08 16:46:43 user nova-compute[74669]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='4'>sim</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='32'>kc705</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='32'>ml605</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='32'>virt</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='32'>lx200</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='32'>lx60</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 08 16:46:43 user nova-compute[74669]:       <domain type='qemu'/>
Nov 08 16:46:43 user nova-compute[74669]:     </arch>
Nov 08 16:46:43 user nova-compute[74669]:     <features>
Nov 08 16:46:43 user nova-compute[74669]:       <cpuselection/>
Nov 08 16:46:43 user nova-compute[74669]:       <deviceboot/>
Nov 08 16:46:43 user nova-compute[74669]:       <disksnapshot default='on' toggle='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     </features>
Nov 08 16:46:43 user nova-compute[74669]:   </guest>
Nov 08 16:46:43 user nova-compute[74669]: </capabilities>
Nov 08 16:46:43 user nova-compute[74669]: 
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 08 16:46:43 user nova-compute[74669]: <domainCapabilities>
Nov 08 16:46:43 user nova-compute[74669]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 16:46:43 user nova-compute[74669]:   <domain>kvm</domain>
Nov 08 16:46:43 user nova-compute[74669]:   <machine>pc-i440fx-6.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:   <arch>i686</arch>
Nov 08 16:46:43 user nova-compute[74669]:   <vcpu max='255'/>
Nov 08 16:46:43 user nova-compute[74669]:   <iothreads supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:   <os supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:     <enum name='firmware'/>
Nov 08 16:46:43 user nova-compute[74669]:     <loader supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='type'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>rom</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>pflash</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='readonly'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>yes</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>no</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='secure'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>no</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </loader>
Nov 08 16:46:43 user nova-compute[74669]:   </os>
Nov 08 16:46:43 user nova-compute[74669]:   <cpu>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='host-passthrough' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='hostPassthroughMigratable'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>off</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='maximum' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='maximumMigratable'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>on</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>off</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='host-model' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <vendor>Intel</vendor>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ss'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='vmx'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='pcid'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='hypervisor'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='arat'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='umip'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='md-clear'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='stibp'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ssbd'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ibpb'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ibrs'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='amd-stibp'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='disable' name='erms'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='disable' name='lm'/>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='custom' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>qemu64</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>qemu32</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>phenom</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium3</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium2</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>n270</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>kvm64</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>kvm32</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>coreduo</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>core2duo</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>athlon</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Westmere</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Snowridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>SandyBridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Penryn</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G5</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G4</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G3</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G2</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G1</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Nehalem</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>IvyBridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Icelake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-Rome</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-Milan</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Dhyana</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cooperlake</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Conroe</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>486</model>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:   </cpu>
Nov 08 16:46:43 user nova-compute[74669]:   <memoryBacking supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:     <enum name='sourceType'>
Nov 08 16:46:43 user nova-compute[74669]:       <value>file</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>anonymous</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>memfd</value>
Nov 08 16:46:43 user nova-compute[74669]:     </enum>
Nov 08 16:46:43 user nova-compute[74669]:   </memoryBacking>
Nov 08 16:46:43 user nova-compute[74669]:   <devices>
Nov 08 16:46:43 user nova-compute[74669]:     <disk supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='diskDevice'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>disk</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>cdrom</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>floppy</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>lun</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='bus'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>ide</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>fdc</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>scsi</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>usb</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>sata</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-non-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </disk>
Nov 08 16:46:43 user nova-compute[74669]:     <graphics supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='type'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>sdl</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vnc</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>spice</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>egl-headless</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </graphics>
Nov 08 16:46:43 user nova-compute[74669]:     <video supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='modelType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vga</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>cirrus</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vmvga</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>qxl</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>none</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>bochs</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>ramfb</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </video>
Nov 08 16:46:43 user nova-compute[74669]:     <hostdev supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='mode'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>subsystem</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='startupPolicy'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>default</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>mandatory</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>requisite</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>optional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='subsysType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>usb</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>pci</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>scsi</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='capsType'/>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='pciBackend'/>
Nov 08 16:46:43 user nova-compute[74669]:     </hostdev>
Nov 08 16:46:43 user nova-compute[74669]:     <rng supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-non-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='backendModel'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>random</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>egd</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>builtin</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </rng>
Nov 08 16:46:43 user nova-compute[74669]:     <filesystem supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='driverType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>path</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>handle</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtiofs</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </filesystem>
Nov 08 16:46:43 user nova-compute[74669]:     <tpm supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>tpm-tis</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>tpm-crb</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='backendModel'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>passthrough</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>emulator</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </tpm>
Nov 08 16:46:43 user nova-compute[74669]:   </devices>
Nov 08 16:46:43 user nova-compute[74669]:   <features>
Nov 08 16:46:43 user nova-compute[74669]:     <gic supported='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     <vmcoreinfo supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <genid supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <backingStoreInput supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <backup supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <sev supported='no'/>
Nov 08 16:46:43 user nova-compute[74669]:   </features>
Nov 08 16:46:43 user nova-compute[74669]: </domainCapabilities>
Nov 08 16:46:43 user nova-compute[74669]:  {{(pid=74669) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 08 16:46:43 user nova-compute[74669]: <domainCapabilities>
Nov 08 16:46:43 user nova-compute[74669]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 16:46:43 user nova-compute[74669]:   <domain>kvm</domain>
Nov 08 16:46:43 user nova-compute[74669]:   <machine>pc-q35-jammy</machine>
Nov 08 16:46:43 user nova-compute[74669]:   <arch>i686</arch>
Nov 08 16:46:43 user nova-compute[74669]:   <vcpu max='288'/>
Nov 08 16:46:43 user nova-compute[74669]:   <iothreads supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:   <os supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:     <enum name='firmware'/>
Nov 08 16:46:43 user nova-compute[74669]:     <loader supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='type'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>rom</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>pflash</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='readonly'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>yes</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>no</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='secure'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>no</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </loader>
Nov 08 16:46:43 user nova-compute[74669]:   </os>
Nov 08 16:46:43 user nova-compute[74669]:   <cpu>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='host-passthrough' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='hostPassthroughMigratable'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>off</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='maximum' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='maximumMigratable'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>on</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>off</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='host-model' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <vendor>Intel</vendor>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ss'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='vmx'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='pcid'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='hypervisor'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='arat'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='umip'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='md-clear'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='stibp'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ssbd'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ibpb'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ibrs'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='amd-stibp'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='disable' name='erms'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='disable' name='lm'/>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='custom' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>qemu64</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>qemu32</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>phenom</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium3</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium2</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>n270</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>kvm64</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>kvm32</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>coreduo</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>core2duo</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>athlon</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Westmere</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Snowridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>SandyBridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Penryn</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G5</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G4</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G3</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G2</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G1</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Nehalem</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>IvyBridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Icelake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-Rome</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-Milan</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Dhyana</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cooperlake</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Conroe</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>486</model>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:   </cpu>
Nov 08 16:46:43 user nova-compute[74669]:   <memoryBacking supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:     <enum name='sourceType'>
Nov 08 16:46:43 user nova-compute[74669]:       <value>file</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>anonymous</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>memfd</value>
Nov 08 16:46:43 user nova-compute[74669]:     </enum>
Nov 08 16:46:43 user nova-compute[74669]:   </memoryBacking>
Nov 08 16:46:43 user nova-compute[74669]:   <devices>
Nov 08 16:46:43 user nova-compute[74669]:     <disk supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='diskDevice'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>disk</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>cdrom</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>floppy</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>lun</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='bus'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>fdc</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>scsi</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>usb</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>sata</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-non-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </disk>
Nov 08 16:46:43 user nova-compute[74669]:     <graphics supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='type'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>sdl</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vnc</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>spice</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>egl-headless</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </graphics>
Nov 08 16:46:43 user nova-compute[74669]:     <video supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='modelType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vga</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>cirrus</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vmvga</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>qxl</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>none</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>bochs</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>ramfb</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </video>
Nov 08 16:46:43 user nova-compute[74669]:     <hostdev supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='mode'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>subsystem</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='startupPolicy'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>default</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>mandatory</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>requisite</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>optional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='subsysType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>usb</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>pci</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>scsi</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='capsType'/>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='pciBackend'/>
Nov 08 16:46:43 user nova-compute[74669]:     </hostdev>
Nov 08 16:46:43 user nova-compute[74669]:     <rng supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-non-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='backendModel'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>random</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>egd</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>builtin</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </rng>
Nov 08 16:46:43 user nova-compute[74669]:     <filesystem supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='driverType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>path</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>handle</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtiofs</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </filesystem>
Nov 08 16:46:43 user nova-compute[74669]:     <tpm supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>tpm-tis</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>tpm-crb</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='backendModel'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>passthrough</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>emulator</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </tpm>
Nov 08 16:46:43 user nova-compute[74669]:   </devices>
Nov 08 16:46:43 user nova-compute[74669]:   <features>
Nov 08 16:46:43 user nova-compute[74669]:     <gic supported='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     <vmcoreinfo supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <genid supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <backingStoreInput supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <backup supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <sev supported='no'/>
Nov 08 16:46:43 user nova-compute[74669]:   </features>
Nov 08 16:46:43 user nova-compute[74669]: </domainCapabilities>
Nov 08 16:46:43 user nova-compute[74669]:  {{(pid=74669) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 08 16:46:43 user nova-compute[74669]: <domainCapabilities>
Nov 08 16:46:43 user nova-compute[74669]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 16:46:43 user nova-compute[74669]:   <domain>kvm</domain>
Nov 08 16:46:43 user nova-compute[74669]:   <machine>pc-q35-6.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:   <arch>i686</arch>
Nov 08 16:46:43 user nova-compute[74669]:   <vcpu max='288'/>
Nov 08 16:46:43 user nova-compute[74669]:   <iothreads supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:   <os supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:     <enum name='firmware'/>
Nov 08 16:46:43 user nova-compute[74669]:     <loader supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='type'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>rom</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>pflash</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='readonly'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>yes</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>no</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='secure'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>no</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </loader>
Nov 08 16:46:43 user nova-compute[74669]:   </os>
Nov 08 16:46:43 user nova-compute[74669]:   <cpu>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='host-passthrough' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='hostPassthroughMigratable'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>off</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='maximum' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='maximumMigratable'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>on</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>off</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='host-model' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <vendor>Intel</vendor>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ss'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='vmx'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='pcid'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='hypervisor'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='arat'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='umip'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='md-clear'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='stibp'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ssbd'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ibpb'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ibrs'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='amd-stibp'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='disable' name='erms'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='disable' name='lm'/>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='custom' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>qemu64</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>qemu32</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>phenom</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium3</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium2</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>n270</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>kvm64</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>kvm32</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>coreduo</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>core2duo</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>athlon</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Westmere</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Snowridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>SandyBridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Penryn</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G5</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G4</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G3</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G2</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G1</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Nehalem</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>IvyBridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Icelake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-Rome</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-Milan</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Dhyana</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cooperlake</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Conroe</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>486</model>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:   </cpu>
Nov 08 16:46:43 user nova-compute[74669]:   <memoryBacking supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:     <enum name='sourceType'>
Nov 08 16:46:43 user nova-compute[74669]:       <value>file</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>anonymous</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>memfd</value>
Nov 08 16:46:43 user nova-compute[74669]:     </enum>
Nov 08 16:46:43 user nova-compute[74669]:   </memoryBacking>
Nov 08 16:46:43 user nova-compute[74669]:   <devices>
Nov 08 16:46:43 user nova-compute[74669]:     <disk supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='diskDevice'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>disk</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>cdrom</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>floppy</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>lun</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='bus'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>fdc</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>scsi</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>usb</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>sata</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-non-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </disk>
Nov 08 16:46:43 user nova-compute[74669]:     <graphics supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='type'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>sdl</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vnc</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>spice</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>egl-headless</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </graphics>
Nov 08 16:46:43 user nova-compute[74669]:     <video supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='modelType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vga</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>cirrus</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vmvga</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>qxl</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>none</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>bochs</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>ramfb</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </video>
Nov 08 16:46:43 user nova-compute[74669]:     <hostdev supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='mode'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>subsystem</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='startupPolicy'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>default</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>mandatory</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>requisite</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>optional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='subsysType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>usb</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>pci</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>scsi</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='capsType'/>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='pciBackend'/>
Nov 08 16:46:43 user nova-compute[74669]:     </hostdev>
Nov 08 16:46:43 user nova-compute[74669]:     <rng supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-non-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='backendModel'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>random</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>egd</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>builtin</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </rng>
Nov 08 16:46:43 user nova-compute[74669]:     <filesystem supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='driverType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>path</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>handle</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtiofs</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </filesystem>
Nov 08 16:46:43 user nova-compute[74669]:     <tpm supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>tpm-tis</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>tpm-crb</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='backendModel'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>passthrough</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>emulator</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </tpm>
Nov 08 16:46:43 user nova-compute[74669]:   </devices>
Nov 08 16:46:43 user nova-compute[74669]:   <features>
Nov 08 16:46:43 user nova-compute[74669]:     <gic supported='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     <vmcoreinfo supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <genid supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <backingStoreInput supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <backup supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <sev supported='no'/>
Nov 08 16:46:43 user nova-compute[74669]:   </features>
Nov 08 16:46:43 user nova-compute[74669]: </domainCapabilities>
Nov 08 16:46:43 user nova-compute[74669]:  {{(pid=74669) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 08 16:46:43 user nova-compute[74669]: <domainCapabilities>
Nov 08 16:46:43 user nova-compute[74669]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 16:46:43 user nova-compute[74669]:   <domain>kvm</domain>
Nov 08 16:46:43 user nova-compute[74669]:   <machine>pc-i440fx-jammy</machine>
Nov 08 16:46:43 user nova-compute[74669]:   <arch>i686</arch>
Nov 08 16:46:43 user nova-compute[74669]:   <vcpu max='255'/>
Nov 08 16:46:43 user nova-compute[74669]:   <iothreads supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:   <os supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:     <enum name='firmware'/>
Nov 08 16:46:43 user nova-compute[74669]:     <loader supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='type'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>rom</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>pflash</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='readonly'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>yes</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>no</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='secure'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>no</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </loader>
Nov 08 16:46:43 user nova-compute[74669]:   </os>
Nov 08 16:46:43 user nova-compute[74669]:   <cpu>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='host-passthrough' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='hostPassthroughMigratable'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>off</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='maximum' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='maximumMigratable'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>on</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>off</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='host-model' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <vendor>Intel</vendor>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ss'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='vmx'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='pcid'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='hypervisor'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='arat'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='umip'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='md-clear'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='stibp'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ssbd'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ibpb'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ibrs'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='amd-stibp'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='disable' name='erms'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='disable' name='lm'/>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='custom' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>qemu64</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>qemu32</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>phenom</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium3</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium2</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>n270</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>kvm64</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>kvm32</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>coreduo</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>core2duo</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>athlon</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Westmere</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Snowridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>SandyBridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Penryn</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G5</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G4</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G3</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G2</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G1</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Nehalem</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>IvyBridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Icelake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-Rome</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-Milan</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Dhyana</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cooperlake</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Conroe</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>486</model>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:   </cpu>
Nov 08 16:46:43 user nova-compute[74669]:   <memoryBacking supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:     <enum name='sourceType'>
Nov 08 16:46:43 user nova-compute[74669]:       <value>file</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>anonymous</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>memfd</value>
Nov 08 16:46:43 user nova-compute[74669]:     </enum>
Nov 08 16:46:43 user nova-compute[74669]:   </memoryBacking>
Nov 08 16:46:43 user nova-compute[74669]:   <devices>
Nov 08 16:46:43 user nova-compute[74669]:     <disk supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='diskDevice'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>disk</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>cdrom</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>floppy</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>lun</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='bus'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>ide</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>fdc</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>scsi</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>usb</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>sata</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-non-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </disk>
Nov 08 16:46:43 user nova-compute[74669]:     <graphics supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='type'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>sdl</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vnc</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>spice</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>egl-headless</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </graphics>
Nov 08 16:46:43 user nova-compute[74669]:     <video supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='modelType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vga</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>cirrus</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vmvga</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>qxl</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>none</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>bochs</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>ramfb</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </video>
Nov 08 16:46:43 user nova-compute[74669]:     <hostdev supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='mode'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>subsystem</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='startupPolicy'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>default</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>mandatory</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>requisite</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>optional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='subsysType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>usb</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>pci</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>scsi</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='capsType'/>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='pciBackend'/>
Nov 08 16:46:43 user nova-compute[74669]:     </hostdev>
Nov 08 16:46:43 user nova-compute[74669]:     <rng supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-non-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='backendModel'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>random</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>egd</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>builtin</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </rng>
Nov 08 16:46:43 user nova-compute[74669]:     <filesystem supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='driverType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>path</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>handle</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtiofs</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </filesystem>
Nov 08 16:46:43 user nova-compute[74669]:     <tpm supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>tpm-tis</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>tpm-crb</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='backendModel'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>passthrough</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>emulator</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </tpm>
Nov 08 16:46:43 user nova-compute[74669]:   </devices>
Nov 08 16:46:43 user nova-compute[74669]:   <features>
Nov 08 16:46:43 user nova-compute[74669]:     <gic supported='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     <vmcoreinfo supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <genid supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <backingStoreInput supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <backup supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <sev supported='no'/>
Nov 08 16:46:43 user nova-compute[74669]:   </features>
Nov 08 16:46:43 user nova-compute[74669]: </domainCapabilities>
Nov 08 16:46:43 user nova-compute[74669]:  {{(pid=74669) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 08 16:46:43 user nova-compute[74669]: <domainCapabilities>
Nov 08 16:46:43 user nova-compute[74669]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 16:46:43 user nova-compute[74669]:   <domain>kvm</domain>
Nov 08 16:46:43 user nova-compute[74669]:   <machine>pc-i440fx-6.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:   <arch>x86_64</arch>
Nov 08 16:46:43 user nova-compute[74669]:   <vcpu max='255'/>
Nov 08 16:46:43 user nova-compute[74669]:   <iothreads supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:   <os supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:     <enum name='firmware'>
Nov 08 16:46:43 user nova-compute[74669]:       <value>efi</value>
Nov 08 16:46:43 user nova-compute[74669]:     </enum>
Nov 08 16:46:43 user nova-compute[74669]:     <loader supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='type'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>rom</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>pflash</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='readonly'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>yes</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>no</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='secure'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>no</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </loader>
Nov 08 16:46:43 user nova-compute[74669]:   </os>
Nov 08 16:46:43 user nova-compute[74669]:   <cpu>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='host-passthrough' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='hostPassthroughMigratable'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>on</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>off</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='maximum' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='maximumMigratable'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>on</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>off</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='host-model' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <vendor>Intel</vendor>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ss'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='vmx'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='pcid'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='hypervisor'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='arat'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='umip'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='md-clear'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='stibp'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ssbd'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='invtsc'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ibpb'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ibrs'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='amd-stibp'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='rsba'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='disable' name='erms'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='custom' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>qemu64</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>qemu32</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>phenom</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium3</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium2</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>n270</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>kvm64</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>kvm32</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>coreduo</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>core2duo</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>athlon</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Westmere</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Snowridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>SandyBridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Penryn</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G5</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G4</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G3</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G2</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Opteron_G1</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Nehalem</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>IvyBridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Icelake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-Rome</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-Milan</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Dhyana</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cooperlake</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Conroe</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>486</model>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:   </cpu>
Nov 08 16:46:43 user nova-compute[74669]:   <memoryBacking supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:     <enum name='sourceType'>
Nov 08 16:46:43 user nova-compute[74669]:       <value>file</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>anonymous</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>memfd</value>
Nov 08 16:46:43 user nova-compute[74669]:     </enum>
Nov 08 16:46:43 user nova-compute[74669]:   </memoryBacking>
Nov 08 16:46:43 user nova-compute[74669]:   <devices>
Nov 08 16:46:43 user nova-compute[74669]:     <disk supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='diskDevice'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>disk</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>cdrom</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>floppy</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>lun</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='bus'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>ide</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>fdc</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>scsi</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>usb</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>sata</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-non-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </disk>
Nov 08 16:46:43 user nova-compute[74669]:     <graphics supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='type'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>sdl</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vnc</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>spice</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>egl-headless</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </graphics>
Nov 08 16:46:43 user nova-compute[74669]:     <video supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='modelType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vga</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>cirrus</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vmvga</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>qxl</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>none</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>bochs</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>ramfb</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </video>
Nov 08 16:46:43 user nova-compute[74669]:     <hostdev supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='mode'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>subsystem</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='startupPolicy'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>default</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>mandatory</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>requisite</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>optional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='subsysType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>usb</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>pci</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>scsi</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='capsType'/>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='pciBackend'/>
Nov 08 16:46:43 user nova-compute[74669]:     </hostdev>
Nov 08 16:46:43 user nova-compute[74669]:     <rng supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-non-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='backendModel'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>random</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>egd</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>builtin</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </rng>
Nov 08 16:46:43 user nova-compute[74669]:     <filesystem supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='driverType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>path</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>handle</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtiofs</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </filesystem>
Nov 08 16:46:43 user nova-compute[74669]:     <tpm supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>tpm-tis</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>tpm-crb</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='backendModel'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>passthrough</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>emulator</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </tpm>
Nov 08 16:46:43 user nova-compute[74669]:   </devices>
Nov 08 16:46:43 user nova-compute[74669]:   <features>
Nov 08 16:46:43 user nova-compute[74669]:     <gic supported='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     <vmcoreinfo supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <genid supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <backingStoreInput supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <backup supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <sev supported='no'/>
Nov 08 16:46:43 user nova-compute[74669]:   </features>
Nov 08 16:46:43 user nova-compute[74669]: </domainCapabilities>
Nov 08 16:46:43 user nova-compute[74669]:  {{(pid=74669) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 08 16:46:43 user nova-compute[74669]: <domainCapabilities>
Nov 08 16:46:43 user nova-compute[74669]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 16:46:43 user nova-compute[74669]:   <domain>kvm</domain>
Nov 08 16:46:43 user nova-compute[74669]:   <machine>pc-q35-jammy</machine>
Nov 08 16:46:43 user nova-compute[74669]:   <arch>x86_64</arch>
Nov 08 16:46:43 user nova-compute[74669]:   <vcpu max='288'/>
Nov 08 16:46:43 user nova-compute[74669]:   <iothreads supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:   <os supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:     <enum name='firmware'>
Nov 08 16:46:43 user nova-compute[74669]:       <value>efi</value>
Nov 08 16:46:43 user nova-compute[74669]:     </enum>
Nov 08 16:46:43 user nova-compute[74669]:     <loader supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='type'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>rom</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>pflash</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='readonly'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>yes</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>no</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='secure'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>yes</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>no</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </loader>
Nov 08 16:46:43 user nova-compute[74669]:   </os>
Nov 08 16:46:43 user nova-compute[74669]:   <cpu>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='host-passthrough' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='hostPassthroughMigratable'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>on</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>off</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='maximum' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='maximumMigratable'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>on</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>off</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='host-model' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <vendor>Intel</vendor>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ss'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='vmx'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='pcid'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='hypervisor'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='arat'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='umip'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='md-clear'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='stibp'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ssbd'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='invtsc'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ibpb'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ibrs'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='amd-stibp'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='rsba'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='disable' name='erms'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='custom' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>qemu64</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>qemu32</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>phenom</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium3</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium2</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>n270</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>kvm64</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>kvm32</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>coreduo</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>core2duo</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>athlon</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Westmere</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Snowridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>SandyBridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Penryn</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G5</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G4</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G3</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G2</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Opteron_G1</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Nehalem</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>IvyBridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Icelake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-Rome</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-Milan</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Dhyana</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cooperlake</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Conroe</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>486</model>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:   </cpu>
Nov 08 16:46:43 user nova-compute[74669]:   <memoryBacking supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:     <enum name='sourceType'>
Nov 08 16:46:43 user nova-compute[74669]:       <value>file</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>anonymous</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>memfd</value>
Nov 08 16:46:43 user nova-compute[74669]:     </enum>
Nov 08 16:46:43 user nova-compute[74669]:   </memoryBacking>
Nov 08 16:46:43 user nova-compute[74669]:   <devices>
Nov 08 16:46:43 user nova-compute[74669]:     <disk supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='diskDevice'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>disk</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>cdrom</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>floppy</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>lun</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='bus'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>fdc</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>scsi</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>usb</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>sata</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-non-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </disk>
Nov 08 16:46:43 user nova-compute[74669]:     <graphics supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='type'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>sdl</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vnc</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>spice</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>egl-headless</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </graphics>
Nov 08 16:46:43 user nova-compute[74669]:     <video supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='modelType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vga</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>cirrus</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vmvga</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>qxl</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>none</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>bochs</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>ramfb</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </video>
Nov 08 16:46:43 user nova-compute[74669]:     <hostdev supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='mode'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>subsystem</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='startupPolicy'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>default</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>mandatory</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>requisite</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>optional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='subsysType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>usb</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>pci</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>scsi</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='capsType'/>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='pciBackend'/>
Nov 08 16:46:43 user nova-compute[74669]:     </hostdev>
Nov 08 16:46:43 user nova-compute[74669]:     <rng supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-non-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='backendModel'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>random</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>egd</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>builtin</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </rng>
Nov 08 16:46:43 user nova-compute[74669]:     <filesystem supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='driverType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>path</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>handle</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtiofs</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </filesystem>
Nov 08 16:46:43 user nova-compute[74669]:     <tpm supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>tpm-tis</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>tpm-crb</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='backendModel'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>passthrough</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>emulator</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </tpm>
Nov 08 16:46:43 user nova-compute[74669]:   </devices>
Nov 08 16:46:43 user nova-compute[74669]:   <features>
Nov 08 16:46:43 user nova-compute[74669]:     <gic supported='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     <vmcoreinfo supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <genid supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <backingStoreInput supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <backup supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <sev supported='no'/>
Nov 08 16:46:43 user nova-compute[74669]:   </features>
Nov 08 16:46:43 user nova-compute[74669]: </domainCapabilities>
Nov 08 16:46:43 user nova-compute[74669]:  {{(pid=74669) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 08 16:46:43 user nova-compute[74669]: <domainCapabilities>
Nov 08 16:46:43 user nova-compute[74669]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 16:46:43 user nova-compute[74669]:   <domain>kvm</domain>
Nov 08 16:46:43 user nova-compute[74669]:   <machine>pc-q35-6.2</machine>
Nov 08 16:46:43 user nova-compute[74669]:   <arch>x86_64</arch>
Nov 08 16:46:43 user nova-compute[74669]:   <vcpu max='288'/>
Nov 08 16:46:43 user nova-compute[74669]:   <iothreads supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:   <os supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:     <enum name='firmware'>
Nov 08 16:46:43 user nova-compute[74669]:       <value>efi</value>
Nov 08 16:46:43 user nova-compute[74669]:     </enum>
Nov 08 16:46:43 user nova-compute[74669]:     <loader supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='type'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>rom</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>pflash</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='readonly'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>yes</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>no</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='secure'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>yes</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>no</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </loader>
Nov 08 16:46:43 user nova-compute[74669]:   </os>
Nov 08 16:46:43 user nova-compute[74669]:   <cpu>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='host-passthrough' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='hostPassthroughMigratable'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>on</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>off</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='maximum' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='maximumMigratable'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>on</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>off</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='host-model' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <vendor>Intel</vendor>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ss'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='vmx'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='pcid'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='hypervisor'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='arat'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='umip'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='md-clear'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='stibp'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ssbd'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='invtsc'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ibpb'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ibrs'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='amd-stibp'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='rsba'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='disable' name='erms'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='custom' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>qemu64</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>qemu32</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>phenom</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium3</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium2</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>n270</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>kvm64</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>kvm32</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>coreduo</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>core2duo</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>athlon</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Westmere</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Snowridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>SandyBridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Penryn</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G5</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G4</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G3</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G2</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Opteron_G1</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Nehalem</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>IvyBridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Icelake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-Rome</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-Milan</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Dhyana</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cooperlake</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Conroe</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>486</model>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:   </cpu>
Nov 08 16:46:43 user nova-compute[74669]:   <memoryBacking supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:     <enum name='sourceType'>
Nov 08 16:46:43 user nova-compute[74669]:       <value>file</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>anonymous</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>memfd</value>
Nov 08 16:46:43 user nova-compute[74669]:     </enum>
Nov 08 16:46:43 user nova-compute[74669]:   </memoryBacking>
Nov 08 16:46:43 user nova-compute[74669]:   <devices>
Nov 08 16:46:43 user nova-compute[74669]:     <disk supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='diskDevice'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>disk</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>cdrom</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>floppy</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>lun</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='bus'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>fdc</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>scsi</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>usb</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>sata</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-non-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </disk>
Nov 08 16:46:43 user nova-compute[74669]:     <graphics supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='type'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>sdl</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vnc</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>spice</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>egl-headless</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </graphics>
Nov 08 16:46:43 user nova-compute[74669]:     <video supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='modelType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vga</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>cirrus</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vmvga</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>qxl</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>none</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>bochs</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>ramfb</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </video>
Nov 08 16:46:43 user nova-compute[74669]:     <hostdev supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='mode'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>subsystem</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='startupPolicy'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>default</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>mandatory</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>requisite</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>optional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='subsysType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>usb</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>pci</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>scsi</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='capsType'/>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='pciBackend'/>
Nov 08 16:46:43 user nova-compute[74669]:     </hostdev>
Nov 08 16:46:43 user nova-compute[74669]:     <rng supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-non-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='backendModel'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>random</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>egd</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>builtin</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </rng>
Nov 08 16:46:43 user nova-compute[74669]:     <filesystem supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='driverType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>path</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>handle</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtiofs</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </filesystem>
Nov 08 16:46:43 user nova-compute[74669]:     <tpm supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>tpm-tis</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>tpm-crb</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='backendModel'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>passthrough</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>emulator</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </tpm>
Nov 08 16:46:43 user nova-compute[74669]:   </devices>
Nov 08 16:46:43 user nova-compute[74669]:   <features>
Nov 08 16:46:43 user nova-compute[74669]:     <gic supported='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     <vmcoreinfo supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <genid supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <backingStoreInput supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <backup supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <sev supported='no'/>
Nov 08 16:46:43 user nova-compute[74669]:   </features>
Nov 08 16:46:43 user nova-compute[74669]: </domainCapabilities>
Nov 08 16:46:43 user nova-compute[74669]:  {{(pid=74669) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 08 16:46:43 user nova-compute[74669]: <domainCapabilities>
Nov 08 16:46:43 user nova-compute[74669]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 16:46:43 user nova-compute[74669]:   <domain>kvm</domain>
Nov 08 16:46:43 user nova-compute[74669]:   <machine>pc-i440fx-jammy</machine>
Nov 08 16:46:43 user nova-compute[74669]:   <arch>x86_64</arch>
Nov 08 16:46:43 user nova-compute[74669]:   <vcpu max='255'/>
Nov 08 16:46:43 user nova-compute[74669]:   <iothreads supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:   <os supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:     <enum name='firmware'>
Nov 08 16:46:43 user nova-compute[74669]:       <value>efi</value>
Nov 08 16:46:43 user nova-compute[74669]:     </enum>
Nov 08 16:46:43 user nova-compute[74669]:     <loader supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='type'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>rom</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>pflash</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='readonly'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>yes</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>no</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='secure'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>no</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </loader>
Nov 08 16:46:43 user nova-compute[74669]:   </os>
Nov 08 16:46:43 user nova-compute[74669]:   <cpu>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='host-passthrough' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='hostPassthroughMigratable'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>on</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>off</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='maximum' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='maximumMigratable'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>on</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>off</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='host-model' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <vendor>Intel</vendor>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ss'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='vmx'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='pcid'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='hypervisor'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='arat'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='umip'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='md-clear'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='stibp'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ssbd'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='invtsc'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ibpb'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='ibrs'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='amd-stibp'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='rsba'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='disable' name='erms'/>
Nov 08 16:46:43 user nova-compute[74669]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:     <mode name='custom' supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>qemu64</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>qemu32</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>phenom</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium3</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium2</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>pentium</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>n270</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>kvm64</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>kvm32</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>coreduo</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>core2duo</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>athlon</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Westmere</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Snowridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Skylake-Client</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>SandyBridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Penryn</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G5</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G4</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G3</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Opteron_G2</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Opteron_G1</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Nehalem</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>IvyBridge</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Icelake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Haswell</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-Rome</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-Milan</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>EPYC</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Dhyana</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cooperlake</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>Conroe</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='no'>Broadwell</model>
Nov 08 16:46:43 user nova-compute[74669]:       <model usable='yes'>486</model>
Nov 08 16:46:43 user nova-compute[74669]:     </mode>
Nov 08 16:46:43 user nova-compute[74669]:   </cpu>
Nov 08 16:46:43 user nova-compute[74669]:   <memoryBacking supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:     <enum name='sourceType'>
Nov 08 16:46:43 user nova-compute[74669]:       <value>file</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>anonymous</value>
Nov 08 16:46:43 user nova-compute[74669]:       <value>memfd</value>
Nov 08 16:46:43 user nova-compute[74669]:     </enum>
Nov 08 16:46:43 user nova-compute[74669]:   </memoryBacking>
Nov 08 16:46:43 user nova-compute[74669]:   <devices>
Nov 08 16:46:43 user nova-compute[74669]:     <disk supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='diskDevice'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>disk</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>cdrom</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>floppy</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>lun</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='bus'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>ide</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>fdc</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>scsi</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>usb</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>sata</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-non-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </disk>
Nov 08 16:46:43 user nova-compute[74669]:     <graphics supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='type'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>sdl</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vnc</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>spice</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>egl-headless</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </graphics>
Nov 08 16:46:43 user nova-compute[74669]:     <video supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='modelType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vga</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>cirrus</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>vmvga</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>qxl</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>none</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>bochs</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>ramfb</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </video>
Nov 08 16:46:43 user nova-compute[74669]:     <hostdev supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='mode'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>subsystem</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='startupPolicy'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>default</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>mandatory</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>requisite</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>optional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='subsysType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>usb</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>pci</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>scsi</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='capsType'/>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='pciBackend'/>
Nov 08 16:46:43 user nova-compute[74669]:     </hostdev>
Nov 08 16:46:43 user nova-compute[74669]:     <rng supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtio-non-transitional</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='backendModel'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>random</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>egd</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>builtin</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </rng>
Nov 08 16:46:43 user nova-compute[74669]:     <filesystem supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='driverType'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>path</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>handle</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>virtiofs</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </filesystem>
Nov 08 16:46:43 user nova-compute[74669]:     <tpm supported='yes'>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='model'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>tpm-tis</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>tpm-crb</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:       <enum name='backendModel'>
Nov 08 16:46:43 user nova-compute[74669]:         <value>passthrough</value>
Nov 08 16:46:43 user nova-compute[74669]:         <value>emulator</value>
Nov 08 16:46:43 user nova-compute[74669]:       </enum>
Nov 08 16:46:43 user nova-compute[74669]:     </tpm>
Nov 08 16:46:43 user nova-compute[74669]:   </devices>
Nov 08 16:46:43 user nova-compute[74669]:   <features>
Nov 08 16:46:43 user nova-compute[74669]:     <gic supported='no'/>
Nov 08 16:46:43 user nova-compute[74669]:     <vmcoreinfo supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <genid supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <backingStoreInput supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <backup supported='yes'/>
Nov 08 16:46:43 user nova-compute[74669]:     <sev supported='no'/>
Nov 08 16:46:43 user nova-compute[74669]:   </features>
Nov 08 16:46:43 user nova-compute[74669]: </domainCapabilities>
Nov 08 16:46:43 user nova-compute[74669]:  {{(pid=74669) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74669) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74669) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Checking secure boot support for host arch (x86_64) {{(pid=74669) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Checking secure boot support for host arch (x86_64) {{(pid=74669) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Checking secure boot support for host arch (x86_64) {{(pid=74669) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 16:46:43 user nova-compute[74669]: INFO nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Secure Boot support detected
Nov 08 16:46:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] cpu compare xml: <cpu match="exact">
Nov 08 16:46:43 user nova-compute[74669]:   <model>Nehalem</model>
Nov 08 16:46:43 user nova-compute[74669]: </cpu>
Nov 08 16:46:43 user nova-compute[74669]:  {{(pid=74669) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 08 16:46:43 user nova-compute[74669]: INFO nova.virt.node [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Generated node identity ce26964b-e55b-43d2-801a-7221ff1fe64b
Nov 08 16:46:43 user nova-compute[74669]: INFO nova.virt.node [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Wrote node identity ce26964b-e55b-43d2-801a-7221ff1fe64b to /opt/stack/data/nova/compute_id
Nov 08 16:46:43 user nova-compute[74669]: WARNING nova.compute.manager [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Compute nodes ['ce26964b-e55b-43d2-801a-7221ff1fe64b'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 08 16:46:43 user nova-compute[74669]: INFO nova.compute.manager [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 08 16:46:44 user nova-compute[74669]: WARNING nova.compute.manager [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 08 16:46:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:46:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:46:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:46:44 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:46:44 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:46:44 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:46:44 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Hypervisor/Node resource view: name=user free_ram=10935MB free_disk=26.33108139038086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:46:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:46:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:46:44 user nova-compute[74669]: WARNING nova.compute.resource_tracker [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] No compute node record for user:ce26964b-e55b-43d2-801a-7221ff1fe64b: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host ce26964b-e55b-43d2-801a-7221ff1fe64b could not be found.
Nov 08 16:46:44 user nova-compute[74669]: INFO nova.compute.resource_tracker [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Compute node record created for user:user with uuid: ce26964b-e55b-43d2-801a-7221ff1fe64b
Nov 08 16:46:44 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:46:44 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:46:44 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] [req-e707f83b-67c3-47ad-ac9b-f1da9856a837] Created resource provider record via placement API for resource provider with UUID ce26964b-e55b-43d2-801a-7221ff1fe64b and name user.
Nov 08 16:46:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74669) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 08 16:46:44 user nova-compute[74669]: INFO nova.virt.libvirt.host [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] kernel doesn't support AMD SEV
Nov 08 16:46:44 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Updating inventory in ProviderTree for provider ce26964b-e55b-43d2-801a-7221ff1fe64b with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 16:46:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:46:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Libvirt baseline CPU <cpu>
Nov 08 16:46:44 user nova-compute[74669]:   <arch>x86_64</arch>
Nov 08 16:46:44 user nova-compute[74669]:   <model>Nehalem</model>
Nov 08 16:46:44 user nova-compute[74669]:   <vendor>Intel</vendor>
Nov 08 16:46:44 user nova-compute[74669]:   <topology sockets="6" cores="1" threads="1"/>
Nov 08 16:46:44 user nova-compute[74669]: </cpu>
Nov 08 16:46:44 user nova-compute[74669]:  {{(pid=74669) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 08 16:46:44 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Updated inventory for provider ce26964b-e55b-43d2-801a-7221ff1fe64b with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 08 16:46:44 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Updating resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b generation from 0 to 1 during operation: update_inventory {{(pid=74669) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 08 16:46:44 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Updating inventory in ProviderTree for provider ce26964b-e55b-43d2-801a-7221ff1fe64b with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 16:46:44 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Updating resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b generation from 1 to 2 during operation: update_traits {{(pid=74669) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 08 16:46:44 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:46:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:46:44 user nova-compute[74669]: DEBUG nova.service [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Creating RPC server for service compute {{(pid=74669) start /opt/stack/nova/nova/service.py:182}}
Nov 08 16:46:44 user nova-compute[74669]: DEBUG nova.service [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] Join ServiceGroup membership for this service compute {{(pid=74669) start /opt/stack/nova/nova/service.py:199}}
Nov 08 16:46:44 user nova-compute[74669]: DEBUG nova.servicegroup.drivers.db [None req-c77236c0-e658-4643-8c5e-c559e35e93ec None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74669) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 08 16:47:35 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:47:35 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:47:35 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:47:35 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Didn't find any instances for network info cache update. {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:47:36 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:47:36 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:47:36 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=10384MB free_disk=26.234848022460938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:47:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:48:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:48:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:48:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:48:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:48:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:48:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:48:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:48:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:48:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:48:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:48:36 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:48:37 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:48:37 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:48:37 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=10321MB free_disk=26.29918670654297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:48:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:48:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:48:37 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:48:37 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:48:37 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:48:37 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:48:37 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:48:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.102s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:48:38 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:48:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:48:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 16:48:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Didn't find any instances for network info cache update. {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 16:48:38 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:48:38 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:48:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:49:35 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:49:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:49:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:49:37 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:49:37 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:49:37 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:49:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:49:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:49:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:49:37 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:49:38 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:49:38 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:49:38 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=10343MB free_disk=26.051700592041016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:49:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:49:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:49:38 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:49:38 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:49:38 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:49:38 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:49:38 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:49:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:49:39 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:49:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:49:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 16:49:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Didn't find any instances for network info cache update. {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 16:49:39 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:49:39 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:49:39 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:50:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:50:37 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:50:37 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:50:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:37 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:50:38 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:50:38 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:50:38 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=9570MB free_disk=26.079395294189453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:50:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:38 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:50:38 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:50:38 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:50:38 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:50:38 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:50:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:39 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:50:39 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:50:39 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:50:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:50:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 16:50:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Didn't find any instances for network info cache update. {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 16:50:39 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:50:39 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:50:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:50:40 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:50:40 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:50:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:44 user nova-compute[74669]: DEBUG nova.compute.manager [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 16:50:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 16:50:45 user nova-compute[74669]: INFO nova.compute.claims [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Claim successful on node user
Nov 08 16:50:45 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:50:45 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:50:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:45 user nova-compute[74669]: DEBUG nova.compute.manager [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 16:50:45 user nova-compute[74669]: DEBUG nova.compute.manager [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 16:50:45 user nova-compute[74669]: DEBUG nova.network.neutron [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 16:50:45 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 16:50:45 user nova-compute[74669]: DEBUG nova.compute.manager [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 16:50:45 user nova-compute[74669]: DEBUG nova.compute.manager [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 16:50:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 16:50:45 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Creating image(s)
Nov 08 16:50:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "/opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "/opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "/opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:46 user nova-compute[74669]: DEBUG nova.policy [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bce0d71611084f1694789c5f5cd695cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa6ad206b6fa4cc099c08a01b051312c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 16:50:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956.part --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956.part --force-share --output=json" returned: 0 in 0.167s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:46 user nova-compute[74669]: DEBUG nova.virt.images [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] ee6edaa4-6206-44ab-8497-fdbc2291f87f was qcow2, converting to raw {{(pid=74669) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 16:50:46 user nova-compute[74669]: DEBUG nova.privsep.utils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74669) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 16:50:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956.part /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956.converted {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956.part /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956.converted" returned: 0 in 0.171s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956.converted --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.215s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:47 user nova-compute[74669]: INFO oslo.privsep.daemon [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqra57cg2/privsep.sock']
Nov 08 16:50:47 user sudo[83967]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqra57cg2/privsep.sock
Nov 08 16:50:47 user sudo[83967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 16:50:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Acquiring lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:47 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 16:50:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 16:50:47 user nova-compute[74669]: INFO nova.compute.claims [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Claim successful on node user
Nov 08 16:50:47 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:50:47 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:50:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:47 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 16:50:47 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 16:50:47 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 16:50:47 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 16:50:47 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 16:50:48 user nova-compute[74669]: DEBUG nova.policy [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5659ee7ffe7c4630871d1e0bcbf13bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30fcd3be58646a0b81fbc97acec8b13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 16:50:48 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 16:50:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 16:50:48 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Creating image(s)
Nov 08 16:50:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc2b779e-b58d-4e45-8789-91c4b452ee0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "/opt/stack/data/nova/instances/fc2b779e-b58d-4e45-8789-91c4b452ee0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "/opt/stack/data/nova/instances/fc2b779e-b58d-4e45-8789-91c4b452ee0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:48 user sudo[83967]: pam_unix(sudo:session): session closed for user root
Nov 08 16:50:48 user nova-compute[74669]: INFO oslo.privsep.daemon [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Spawned new privsep daemon via rootwrap
Nov 08 16:50:48 user nova-compute[74669]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 16:50:48 user nova-compute[74669]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 16:50:48 user nova-compute[74669]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 08 16:50:48 user nova-compute[74669]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83970
Nov 08 16:50:48 user nova-compute[74669]: WARNING oslo_privsep.priv_context [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] privsep daemon already running
Nov 08 16:50:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:48 user nova-compute[74669]: DEBUG nova.network.neutron [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Successfully created port: 18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.210s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.209s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.209s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/fc2b779e-b58d-4e45-8789-91c4b452ee0b/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/fc2b779e-b58d-4e45-8789-91c4b452ee0b/disk 1073741824" returned: 0 in 0.054s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.294s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.195s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.292s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc2b779e-b58d-4e45-8789-91c4b452ee0b/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b779e-b58d-4e45-8789-91c4b452ee0b/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Successfully created port: 542b5f60-bd62-4bb3-a644-b7d92762bca0 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk 1073741824" returned: 0 in 0.081s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b779e-b58d-4e45-8789-91c4b452ee0b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Cannot resize image /opt/stack/data/nova/instances/fc2b779e-b58d-4e45-8789-91c4b452ee0b/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Ensure instance console log exists: /opt/stack/data/nova/instances/fc2b779e-b58d-4e45-8789-91c4b452ee0b/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.208s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 16:50:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Cannot resize image /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Ensure instance console log exists: /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG nova.compute.manager [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 16:50:50 user nova-compute[74669]: INFO nova.compute.claims [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Claim successful on node user
Nov 08 16:50:50 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG nova.compute.manager [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG nova.compute.manager [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG nova.network.neutron [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 16:50:50 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 16:50:50 user nova-compute[74669]: DEBUG nova.compute.manager [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG nova.policy [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4836f11b0e8346a2a7e835a6012f53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d3acc026b4a869be4899a0ed2e2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG nova.compute.manager [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 16:50:50 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Creating image(s)
Nov 08 16:50:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "/opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "/opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.211s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Successfully updated port: 542b5f60-bd62-4bb3-a644-b7d92762bca0 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.179s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Acquiring lock "refresh_cache-fc2b779e-b58d-4e45-8789-91c4b452ee0b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Acquired lock "refresh_cache-fc2b779e-b58d-4e45-8789-91c4b452ee0b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk 1073741824" returned: 0 in 0.060s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.256s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 16:50:51 user nova-compute[74669]: INFO nova.compute.claims [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Claim successful on node user
Nov 08 16:50:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Cannot resize image /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Ensure instance console log exists: /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG nova.compute.manager [req-ecf27d96-b3e4-4ba0-a226-6c8937dec37b req-55f3f086-673e-440b-b185-2f2e51ccf7c4 service nova] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Received event network-changed-542b5f60-bd62-4bb3-a644-b7d92762bca0 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG nova.compute.manager [req-ecf27d96-b3e4-4ba0-a226-6c8937dec37b req-55f3f086-673e-440b-b185-2f2e51ccf7c4 service nova] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Refreshing instance network info cache due to event network-changed-542b5f60-bd62-4bb3-a644-b7d92762bca0. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:50:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ecf27d96-b3e4-4ba0-a226-6c8937dec37b req-55f3f086-673e-440b-b185-2f2e51ccf7c4 service nova] Acquiring lock "refresh_cache-fc2b779e-b58d-4e45-8789-91c4b452ee0b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Updating instance_info_cache with network_info: [{"id": "542b5f60-bd62-4bb3-a644-b7d92762bca0", "address": "fa:16:3e:74:7e:b6", "network": {"id": "7e5f6d1e-96bc-4b2c-a3a9-0b83a29d636f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-76294675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e30fcd3be58646a0b81fbc97acec8b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542b5f60-bd", "ovs_interfaceid": "542b5f60-bd62-4bb3-a644-b7d92762bca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.network.neutron [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Successfully created port: 44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.network.neutron [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Releasing lock "refresh_cache-fc2b779e-b58d-4e45-8789-91c4b452ee0b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Instance network_info: |[{"id": "542b5f60-bd62-4bb3-a644-b7d92762bca0", "address": "fa:16:3e:74:7e:b6", "network": {"id": "7e5f6d1e-96bc-4b2c-a3a9-0b83a29d636f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-76294675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e30fcd3be58646a0b81fbc97acec8b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542b5f60-bd", "ovs_interfaceid": "542b5f60-bd62-4bb3-a644-b7d92762bca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ecf27d96-b3e4-4ba0-a226-6c8937dec37b req-55f3f086-673e-440b-b185-2f2e51ccf7c4 service nova] Acquired lock "refresh_cache-fc2b779e-b58d-4e45-8789-91c4b452ee0b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.network.neutron [req-ecf27d96-b3e4-4ba0-a226-6c8937dec37b req-55f3f086-673e-440b-b185-2f2e51ccf7c4 service nova] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Refreshing network info cache for port 542b5f60-bd62-4bb3-a644-b7d92762bca0 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Start _get_guest_xml network_info=[{"id": "542b5f60-bd62-4bb3-a644-b7d92762bca0", "address": "fa:16:3e:74:7e:b6", "network": {"id": "7e5f6d1e-96bc-4b2c-a3a9-0b83a29d636f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-76294675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e30fcd3be58646a0b81fbc97acec8b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542b5f60-bd", "ovs_interfaceid": "542b5f60-bd62-4bb3-a644-b7d92762bca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:50:52 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 16:50:52 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:50:52 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.privsep.utils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74669) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1277285756',display_name='tempest-DeleteServersTestJSON-server-1277285756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1277285756',id=2,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e30fcd3be58646a0b81fbc97acec8b13',ramdisk_id='',reservation_id='r-q0ycnv0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-542902835',owner_user_name='tempest-DeleteServersTestJSON-542902835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:50:48Z,user_data=None,user_id='5659ee7ffe7c4630871d1e0bcbf13bd0',uuid=fc2b779e-b58d-4e45-8789-91c4b452ee0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "542b5f60-bd62-4bb3-a644-b7d92762bca0", "address": "fa:16:3e:74:7e:b6", "network": {"id": "7e5f6d1e-96bc-4b2c-a3a9-0b83a29d636f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-76294675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e30fcd3be58646a0b81fbc97acec8b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542b5f60-bd", "ovs_interfaceid": "542b5f60-bd62-4bb3-a644-b7d92762bca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Converting VIF {"id": "542b5f60-bd62-4bb3-a644-b7d92762bca0", "address": "fa:16:3e:74:7e:b6", "network": {"id": "7e5f6d1e-96bc-4b2c-a3a9-0b83a29d636f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-76294675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e30fcd3be58646a0b81fbc97acec8b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542b5f60-bd", "ovs_interfaceid": "542b5f60-bd62-4bb3-a644-b7d92762bca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:7e:b6,bridge_name='br-int',has_traffic_filtering=True,id=542b5f60-bd62-4bb3-a644-b7d92762bca0,network=Network(7e5f6d1e-96bc-4b2c-a3a9-0b83a29d636f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap542b5f60-bd') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.objects.instance [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lazy-loading 'pci_devices' on Instance uuid fc2b779e-b58d-4e45-8789-91c4b452ee0b {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:50:52 user nova-compute[74669]:   <uuid>fc2b779e-b58d-4e45-8789-91c4b452ee0b</uuid>
Nov 08 16:50:52 user nova-compute[74669]:   <name>instance-00000002</name>
Nov 08 16:50:52 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:50:52 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:50:52 user nova-compute[74669]:   <metadata>
Nov 08 16:50:52 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:50:52 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:50:52 user nova-compute[74669]:       <nova:name>tempest-DeleteServersTestJSON-server-1277285756</nova:name>
Nov 08 16:50:52 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:50:52</nova:creationTime>
Nov 08 16:50:52 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:50:52 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:50:52 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:50:52 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:50:52 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:50:52 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:50:52 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:50:52 user nova-compute[74669]:       <nova:owner>
Nov 08 16:50:52 user nova-compute[74669]:         <nova:user uuid="5659ee7ffe7c4630871d1e0bcbf13bd0">tempest-DeleteServersTestJSON-542902835-project-member</nova:user>
Nov 08 16:50:52 user nova-compute[74669]:         <nova:project uuid="e30fcd3be58646a0b81fbc97acec8b13">tempest-DeleteServersTestJSON-542902835</nova:project>
Nov 08 16:50:52 user nova-compute[74669]:       </nova:owner>
Nov 08 16:50:52 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:50:52 user nova-compute[74669]:       <nova:ports>
Nov 08 16:50:52 user nova-compute[74669]:         <nova:port uuid="542b5f60-bd62-4bb3-a644-b7d92762bca0">
Nov 08 16:50:52 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 16:50:52 user nova-compute[74669]:         </nova:port>
Nov 08 16:50:52 user nova-compute[74669]:       </nova:ports>
Nov 08 16:50:52 user nova-compute[74669]:     </nova:instance>
Nov 08 16:50:52 user nova-compute[74669]:   </metadata>
Nov 08 16:50:52 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:50:52 user nova-compute[74669]:     <system>
Nov 08 16:50:52 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:50:52 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:50:52 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:50:52 user nova-compute[74669]:       <entry name="serial">fc2b779e-b58d-4e45-8789-91c4b452ee0b</entry>
Nov 08 16:50:52 user nova-compute[74669]:       <entry name="uuid">fc2b779e-b58d-4e45-8789-91c4b452ee0b</entry>
Nov 08 16:50:52 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:50:52 user nova-compute[74669]:     </system>
Nov 08 16:50:52 user nova-compute[74669]:   </sysinfo>
Nov 08 16:50:52 user nova-compute[74669]:   <os>
Nov 08 16:50:52 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:50:52 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 16:50:52 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:50:52 user nova-compute[74669]:   </os>
Nov 08 16:50:52 user nova-compute[74669]:   <features>
Nov 08 16:50:52 user nova-compute[74669]:     <acpi/>
Nov 08 16:50:52 user nova-compute[74669]:     <apic/>
Nov 08 16:50:52 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:50:52 user nova-compute[74669]:   </features>
Nov 08 16:50:52 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:50:52 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:50:52 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:50:52 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:50:52 user nova-compute[74669]:   </clock>
Nov 08 16:50:52 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:50:52 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:50:52 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:50:52 user nova-compute[74669]:   </cpu>
Nov 08 16:50:52 user nova-compute[74669]:   <devices>
Nov 08 16:50:52 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:50:52 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:50:52 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/fc2b779e-b58d-4e45-8789-91c4b452ee0b/disk"/>
Nov 08 16:50:52 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:50:52 user nova-compute[74669]:     </disk>
Nov 08 16:50:52 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:50:52 user nova-compute[74669]:       <mac address="fa:16:3e:74:7e:b6"/>
Nov 08 16:50:52 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:50:52 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:50:52 user nova-compute[74669]:       <target dev="tap542b5f60-bd"/>
Nov 08 16:50:52 user nova-compute[74669]:     </interface>
Nov 08 16:50:52 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:50:52 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/fc2b779e-b58d-4e45-8789-91c4b452ee0b/console.log" append="off"/>
Nov 08 16:50:52 user nova-compute[74669]:     </serial>
Nov 08 16:50:52 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:50:52 user nova-compute[74669]:     <video>
Nov 08 16:50:52 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:50:52 user nova-compute[74669]:     </video>
Nov 08 16:50:52 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:50:52 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:50:52 user nova-compute[74669]:     </rng>
Nov 08 16:50:52 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:50:52 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:50:52 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:50:52 user nova-compute[74669]:     </memballoon>
Nov 08 16:50:52 user nova-compute[74669]:   </devices>
Nov 08 16:50:52 user nova-compute[74669]: </domain>
Nov 08 16:50:52 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1277285756',display_name='tempest-DeleteServersTestJSON-server-1277285756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1277285756',id=2,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e30fcd3be58646a0b81fbc97acec8b13',ramdisk_id='',reservation_id='r-q0ycnv0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-542902835',owner_user_name='tempest-DeleteServersTestJSON-542902835-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:50:48Z,user_data=None,user_id='5659ee7ffe7c4630871d1e0bcbf13bd0',uuid=fc2b779e-b58d-4e45-8789-91c4b452ee0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "542b5f60-bd62-4bb3-a644-b7d92762bca0", "address": "fa:16:3e:74:7e:b6", "network": {"id": "7e5f6d1e-96bc-4b2c-a3a9-0b83a29d636f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-76294675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e30fcd3be58646a0b81fbc97acec8b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542b5f60-bd", "ovs_interfaceid": "542b5f60-bd62-4bb3-a644-b7d92762bca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Converting VIF {"id": "542b5f60-bd62-4bb3-a644-b7d92762bca0", "address": "fa:16:3e:74:7e:b6", "network": {"id": "7e5f6d1e-96bc-4b2c-a3a9-0b83a29d636f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-76294675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e30fcd3be58646a0b81fbc97acec8b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542b5f60-bd", "ovs_interfaceid": "542b5f60-bd62-4bb3-a644-b7d92762bca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:7e:b6,bridge_name='br-int',has_traffic_filtering=True,id=542b5f60-bd62-4bb3-a644-b7d92762bca0,network=Network(7e5f6d1e-96bc-4b2c-a3a9-0b83a29d636f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap542b5f60-bd') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG os_vif [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:7e:b6,bridge_name='br-int',has_traffic_filtering=True,id=542b5f60-bd62-4bb3-a644-b7d92762bca0,network=Network(7e5f6d1e-96bc-4b2c-a3a9-0b83a29d636f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap542b5f60-bd') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.policy [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4836f11b0e8346a2a7e835a6012f53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d3acc026b4a869be4899a0ed2e2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 16:50:52 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Creating image(s)
Nov 08 16:50:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "/opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "/opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Created schema index Interface.name {{(pid=74669) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Created schema index Port.name {{(pid=74669) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Created schema index Bridge.name {{(pid=74669) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [POLLOUT] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.network.neutron [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Successfully updated port: 18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquired lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG nova.network.neutron [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6c55058-f1fd-5356-b465-8b90f1d912c4', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:50:52 user nova-compute[74669]: INFO oslo.privsep.daemon [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpusjneolp/privsep.sock']
Nov 08 16:50:52 user sudo[84032]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpusjneolp/privsep.sock
Nov 08 16:50:52 user sudo[84032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 16:50:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.208s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.172s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:53 user nova-compute[74669]: DEBUG nova.network.neutron [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:50:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk 1073741824" returned: 0 in 0.060s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:53 user nova-compute[74669]: DEBUG nova.compute.manager [req-2f6dd799-6b35-43cb-8d02-860649931fd3 req-bd623c06-7f13-4ade-909a-770f9394a6a1 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received event network-changed-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:50:53 user nova-compute[74669]: DEBUG nova.compute.manager [req-2f6dd799-6b35-43cb-8d02-860649931fd3 req-bd623c06-7f13-4ade-909a-770f9394a6a1 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Refreshing instance network info cache due to event network-changed-18b88bab-9376-440a-94f0-478d193b35f5. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:50:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2f6dd799-6b35-43cb-8d02-860649931fd3 req-bd623c06-7f13-4ade-909a-770f9394a6a1 service nova] Acquiring lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:50:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.229s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:53 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 16:50:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:53 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Cannot resize image /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 16:50:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 16:50:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Ensure instance console log exists: /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 16:50:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.005s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.network.neutron [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Successfully created port: 525ba5da-155c-4f87-9fae-8db52836f73e {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:50:54 user sudo[84032]: pam_unix(sudo:session): session closed for user root
Nov 08 16:50:54 user nova-compute[74669]: INFO oslo.privsep.daemon [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Spawned new privsep daemon via rootwrap
Nov 08 16:50:54 user nova-compute[74669]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 16:50:54 user nova-compute[74669]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 16:50:54 user nova-compute[74669]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 08 16:50:54 user nova-compute[74669]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84050
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.network.neutron [req-ecf27d96-b3e4-4ba0-a226-6c8937dec37b req-55f3f086-673e-440b-b185-2f2e51ccf7c4 service nova] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Updated VIF entry in instance network info cache for port 542b5f60-bd62-4bb3-a644-b7d92762bca0. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.network.neutron [req-ecf27d96-b3e4-4ba0-a226-6c8937dec37b req-55f3f086-673e-440b-b185-2f2e51ccf7c4 service nova] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Updating instance_info_cache with network_info: [{"id": "542b5f60-bd62-4bb3-a644-b7d92762bca0", "address": "fa:16:3e:74:7e:b6", "network": {"id": "7e5f6d1e-96bc-4b2c-a3a9-0b83a29d636f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-76294675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e30fcd3be58646a0b81fbc97acec8b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542b5f60-bd", "ovs_interfaceid": "542b5f60-bd62-4bb3-a644-b7d92762bca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.network.neutron [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Updating instance_info_cache with network_info: [{"id": "18b88bab-9376-440a-94f0-478d193b35f5", "address": "fa:16:3e:e0:5c:ca", "network": {"id": "7548ddaf-d550-41df-8f64-fc740e56fcd2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-954808146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa6ad206b6fa4cc099c08a01b051312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b88bab-93", "ovs_interfaceid": "18b88bab-9376-440a-94f0-478d193b35f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ecf27d96-b3e4-4ba0-a226-6c8937dec37b req-55f3f086-673e-440b-b185-2f2e51ccf7c4 service nova] Releasing lock "refresh_cache-fc2b779e-b58d-4e45-8789-91c4b452ee0b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.network.neutron [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Successfully updated port: 44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Releasing lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.compute.manager [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Instance network_info: |[{"id": "18b88bab-9376-440a-94f0-478d193b35f5", "address": "fa:16:3e:e0:5c:ca", "network": {"id": "7548ddaf-d550-41df-8f64-fc740e56fcd2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-954808146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa6ad206b6fa4cc099c08a01b051312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b88bab-93", "ovs_interfaceid": "18b88bab-9376-440a-94f0-478d193b35f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2f6dd799-6b35-43cb-8d02-860649931fd3 req-bd623c06-7f13-4ade-909a-770f9394a6a1 service nova] Acquired lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.network.neutron [req-2f6dd799-6b35-43cb-8d02-860649931fd3 req-bd623c06-7f13-4ade-909a-770f9394a6a1 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Refreshing network info cache for port 18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Start _get_guest_xml network_info=[{"id": "18b88bab-9376-440a-94f0-478d193b35f5", "address": "fa:16:3e:e0:5c:ca", "network": {"id": "7548ddaf-d550-41df-8f64-fc740e56fcd2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-954808146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa6ad206b6fa4cc099c08a01b051312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b88bab-93", "ovs_interfaceid": "18b88bab-9376-440a-94f0-478d193b35f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:50:54 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:50:54 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:50:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "refresh_cache-e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquired lock "refresh_cache-e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.network.neutron [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-293486561',display_name='tempest-ServerStableDeviceRescueTest-server-293486561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-293486561',id=1,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmu3Qb3c9l4i23U9c4l4qVC6jnYjQ9lJDCwk1SO6vmxzEZ5k3Eq2G3HcNjyCsmyUNDyUDS4LqNxryD+xx2cfvcvkOePH5phGWrbgtkBx3y3xYxDeeeP0zACi3EXNGPKUw==',key_name='tempest-keypair-1527492350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa6ad206b6fa4cc099c08a01b051312c',ramdisk_id='',reservation_id='r-sr1uui35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2011852447',owner_user_name='tempest-ServerStableDeviceRescueTest-2011852447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bce0d71611084f1694789c5f5cd695cf',uuid=45d48da2-85b1-4b7f-9661-8fe4e8346ca6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18b88bab-9376-440a-94f0-478d193b35f5", "address": "fa:16:3e:e0:5c:ca", "network": {"id": "7548ddaf-d550-41df-8f64-fc740e56fcd2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-954808146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa6ad206b6fa4cc099c08a01b051312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b88bab-93", "ovs_interfaceid": "18b88bab-9376-440a-94f0-478d193b35f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Converting VIF {"id": "18b88bab-9376-440a-94f0-478d193b35f5", "address": "fa:16:3e:e0:5c:ca", "network": {"id": "7548ddaf-d550-41df-8f64-fc740e56fcd2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-954808146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa6ad206b6fa4cc099c08a01b051312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b88bab-93", "ovs_interfaceid": "18b88bab-9376-440a-94f0-478d193b35f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:5c:ca,bridge_name='br-int',has_traffic_filtering=True,id=18b88bab-9376-440a-94f0-478d193b35f5,network=Network(7548ddaf-d550-41df-8f64-fc740e56fcd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18b88bab-93') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.objects.instance [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lazy-loading 'pci_devices' on Instance uuid 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-248b6be2-4cf1-43ca-8c9e-f12655502d42 req-4de1c925-91e4-4234-9049-1b08bfc594b9 service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received event network-changed-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-248b6be2-4cf1-43ca-8c9e-f12655502d42 req-4de1c925-91e4-4234-9049-1b08bfc594b9 service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Refreshing instance network info cache due to event network-changed-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-248b6be2-4cf1-43ca-8c9e-f12655502d42 req-4de1c925-91e4-4234-9049-1b08bfc594b9 service nova] Acquiring lock "refresh_cache-e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:50:54 user nova-compute[74669]:   <uuid>45d48da2-85b1-4b7f-9661-8fe4e8346ca6</uuid>
Nov 08 16:50:54 user nova-compute[74669]:   <name>instance-00000001</name>
Nov 08 16:50:54 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:50:54 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:50:54 user nova-compute[74669]:   <metadata>
Nov 08 16:50:54 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:50:54 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:50:54 user nova-compute[74669]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-293486561</nova:name>
Nov 08 16:50:54 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:50:54</nova:creationTime>
Nov 08 16:50:54 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:50:54 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:50:54 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:50:54 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:50:54 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:50:54 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:50:54 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:50:54 user nova-compute[74669]:       <nova:owner>
Nov 08 16:50:54 user nova-compute[74669]:         <nova:user uuid="bce0d71611084f1694789c5f5cd695cf">tempest-ServerStableDeviceRescueTest-2011852447-project-member</nova:user>
Nov 08 16:50:54 user nova-compute[74669]:         <nova:project uuid="fa6ad206b6fa4cc099c08a01b051312c">tempest-ServerStableDeviceRescueTest-2011852447</nova:project>
Nov 08 16:50:54 user nova-compute[74669]:       </nova:owner>
Nov 08 16:50:54 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:50:54 user nova-compute[74669]:       <nova:ports>
Nov 08 16:50:54 user nova-compute[74669]:         <nova:port uuid="18b88bab-9376-440a-94f0-478d193b35f5">
Nov 08 16:50:54 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 16:50:54 user nova-compute[74669]:         </nova:port>
Nov 08 16:50:54 user nova-compute[74669]:       </nova:ports>
Nov 08 16:50:54 user nova-compute[74669]:     </nova:instance>
Nov 08 16:50:54 user nova-compute[74669]:   </metadata>
Nov 08 16:50:54 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:50:54 user nova-compute[74669]:     <system>
Nov 08 16:50:54 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:50:54 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:50:54 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:50:54 user nova-compute[74669]:       <entry name="serial">45d48da2-85b1-4b7f-9661-8fe4e8346ca6</entry>
Nov 08 16:50:54 user nova-compute[74669]:       <entry name="uuid">45d48da2-85b1-4b7f-9661-8fe4e8346ca6</entry>
Nov 08 16:50:54 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:50:54 user nova-compute[74669]:     </system>
Nov 08 16:50:54 user nova-compute[74669]:   </sysinfo>
Nov 08 16:50:54 user nova-compute[74669]:   <os>
Nov 08 16:50:54 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:50:54 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 16:50:54 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:50:54 user nova-compute[74669]:   </os>
Nov 08 16:50:54 user nova-compute[74669]:   <features>
Nov 08 16:50:54 user nova-compute[74669]:     <acpi/>
Nov 08 16:50:54 user nova-compute[74669]:     <apic/>
Nov 08 16:50:54 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:50:54 user nova-compute[74669]:   </features>
Nov 08 16:50:54 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:50:54 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:50:54 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:50:54 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:50:54 user nova-compute[74669]:   </clock>
Nov 08 16:50:54 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:50:54 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:50:54 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:50:54 user nova-compute[74669]:   </cpu>
Nov 08 16:50:54 user nova-compute[74669]:   <devices>
Nov 08 16:50:54 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:50:54 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:50:54 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk"/>
Nov 08 16:50:54 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:50:54 user nova-compute[74669]:     </disk>
Nov 08 16:50:54 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:50:54 user nova-compute[74669]:       <mac address="fa:16:3e:e0:5c:ca"/>
Nov 08 16:50:54 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:50:54 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:50:54 user nova-compute[74669]:       <target dev="tap18b88bab-93"/>
Nov 08 16:50:54 user nova-compute[74669]:     </interface>
Nov 08 16:50:54 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:50:54 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/console.log" append="off"/>
Nov 08 16:50:54 user nova-compute[74669]:     </serial>
Nov 08 16:50:54 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:50:54 user nova-compute[74669]:     <video>
Nov 08 16:50:54 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:50:54 user nova-compute[74669]:     </video>
Nov 08 16:50:54 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:50:54 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:50:54 user nova-compute[74669]:     </rng>
Nov 08 16:50:54 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:50:54 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:50:54 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:50:54 user nova-compute[74669]:     </memballoon>
Nov 08 16:50:54 user nova-compute[74669]:   </devices>
Nov 08 16:50:54 user nova-compute[74669]: </domain>
Nov 08 16:50:54 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-293486561',display_name='tempest-ServerStableDeviceRescueTest-server-293486561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-293486561',id=1,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmu3Qb3c9l4i23U9c4l4qVC6jnYjQ9lJDCwk1SO6vmxzEZ5k3Eq2G3HcNjyCsmyUNDyUDS4LqNxryD+xx2cfvcvkOePH5phGWrbgtkBx3y3xYxDeeeP0zACi3EXNGPKUw==',key_name='tempest-keypair-1527492350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa6ad206b6fa4cc099c08a01b051312c',ramdisk_id='',reservation_id='r-sr1uui35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2011852447',owner_user_name='tempest-ServerStableDeviceRescueTest-2011852447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bce0d71611084f1694789c5f5cd695cf',uuid=45d48da2-85b1-4b7f-9661-8fe4e8346ca6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18b88bab-9376-440a-94f0-478d193b35f5", "address": "fa:16:3e:e0:5c:ca", "network": {"id": "7548ddaf-d550-41df-8f64-fc740e56fcd2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-954808146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa6ad206b6fa4cc099c08a01b051312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b88bab-93", "ovs_interfaceid": "18b88bab-9376-440a-94f0-478d193b35f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Converting VIF {"id": "18b88bab-9376-440a-94f0-478d193b35f5", "address": "fa:16:3e:e0:5c:ca", "network": {"id": "7548ddaf-d550-41df-8f64-fc740e56fcd2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-954808146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa6ad206b6fa4cc099c08a01b051312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b88bab-93", "ovs_interfaceid": "18b88bab-9376-440a-94f0-478d193b35f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:5c:ca,bridge_name='br-int',has_traffic_filtering=True,id=18b88bab-9376-440a-94f0-478d193b35f5,network=Network(7548ddaf-d550-41df-8f64-fc740e56fcd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18b88bab-93') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG os_vif [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:5c:ca,bridge_name='br-int',has_traffic_filtering=True,id=18b88bab-9376-440a-94f0-478d193b35f5,network=Network(7548ddaf-d550-41df-8f64-fc740e56fcd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18b88bab-93') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81b2ddc0-f375-5abd-951c-49f2a36574d6', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:50:54 user nova-compute[74669]: DEBUG nova.network.neutron [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:50:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap542b5f60-bd, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:50:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap542b5f60-bd, col_values=(('qos', UUID('4be2f4ee-77c9-4dec-ad43-c79dfcf9fa3d')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:50:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap542b5f60-bd, col_values=(('external_ids', {'iface-id': '542b5f60-bd62-4bb3-a644-b7d92762bca0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:7e:b6', 'vm-uuid': 'fc2b779e-b58d-4e45-8789-91c4b452ee0b'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:50:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:50:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:55 user nova-compute[74669]: INFO os_vif [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:7e:b6,bridge_name='br-int',has_traffic_filtering=True,id=542b5f60-bd62-4bb3-a644-b7d92762bca0,network=Network(7e5f6d1e-96bc-4b2c-a3a9-0b83a29d636f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap542b5f60-bd')
Nov 08 16:50:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18b88bab-93, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:50:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18b88bab-93, col_values=(('qos', UUID('48f54c6a-4f05-46a4-a914-d5c23ec38f65')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:50:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18b88bab-93, col_values=(('external_ids', {'iface-id': '18b88bab-9376-440a-94f0-478d193b35f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:5c:ca', 'vm-uuid': '45d48da2-85b1-4b7f-9661-8fe4e8346ca6'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:50:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:50:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:55 user nova-compute[74669]: INFO os_vif [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:5c:ca,bridge_name='br-int',has_traffic_filtering=True,id=18b88bab-9376-440a-94f0-478d193b35f5,network=Network(7548ddaf-d550-41df-8f64-fc740e56fcd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18b88bab-93')
Nov 08 16:50:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:50:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] No VIF found with MAC fa:16:3e:e0:5c:ca, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:50:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:50:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] No VIF found with MAC fa:16:3e:74:7e:b6, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:50:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "b26dbeeb-b629-414d-bcca-cdde6c207789" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:55 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 16:50:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:55 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 16:50:55 user nova-compute[74669]: INFO nova.compute.claims [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Claim successful on node user
Nov 08 16:50:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.network.neutron [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Updating instance_info_cache with network_info: [{"id": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "address": "fa:16:3e:8f:9e:16", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b48f6d-e0", "ovs_interfaceid": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.network.neutron [req-2f6dd799-6b35-43cb-8d02-860649931fd3 req-bd623c06-7f13-4ade-909a-770f9394a6a1 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Updated VIF entry in instance network info cache for port 18b88bab-9376-440a-94f0-478d193b35f5. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.network.neutron [req-2f6dd799-6b35-43cb-8d02-860649931fd3 req-bd623c06-7f13-4ade-909a-770f9394a6a1 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Updating instance_info_cache with network_info: [{"id": "18b88bab-9376-440a-94f0-478d193b35f5", "address": "fa:16:3e:e0:5c:ca", "network": {"id": "7548ddaf-d550-41df-8f64-fc740e56fcd2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-954808146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa6ad206b6fa4cc099c08a01b051312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b88bab-93", "ovs_interfaceid": "18b88bab-9376-440a-94f0-478d193b35f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Releasing lock "refresh_cache-e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.compute.manager [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Instance network_info: |[{"id": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "address": "fa:16:3e:8f:9e:16", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b48f6d-e0", "ovs_interfaceid": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-248b6be2-4cf1-43ca-8c9e-f12655502d42 req-4de1c925-91e4-4234-9049-1b08bfc594b9 service nova] Acquired lock "refresh_cache-e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.network.neutron [req-248b6be2-4cf1-43ca-8c9e-f12655502d42 req-4de1c925-91e4-4234-9049-1b08bfc594b9 service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Refreshing network info cache for port 44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Start _get_guest_xml network_info=[{"id": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "address": "fa:16:3e:8f:9e:16", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b48f6d-e0", "ovs_interfaceid": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2f6dd799-6b35-43cb-8d02-860649931fd3 req-bd623c06-7f13-4ade-909a-770f9394a6a1 service nova] Releasing lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:50:56 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:50:56 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-806433756',display_name='tempest-ServerRescueNegativeTestJSON-server-806433756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-806433756',id=3,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='632d3acc026b4a869be4899a0ed2e2e2',ramdisk_id='',reservation_id='r-zvbxh990',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1743978403',owner_user_name='tempest-ServerRescueNegativeTestJSON-1743978403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:50:51Z,user_data=None,user_id='4836f11b0e8346a2a7e835a6012f53fb',uuid=e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "address": "fa:16:3e:8f:9e:16", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b48f6d-e0", "ovs_interfaceid": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converting VIF {"id": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "address": "fa:16:3e:8f:9e:16", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b48f6d-e0", "ovs_interfaceid": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=44b48f6d-e0fe-4178-badd-f5f57cd1cd6e,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44b48f6d-e0') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.objects.instance [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'pci_devices' on Instance uuid e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:50:56 user nova-compute[74669]:   <uuid>e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a</uuid>
Nov 08 16:50:56 user nova-compute[74669]:   <name>instance-00000003</name>
Nov 08 16:50:56 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:50:56 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:50:56 user nova-compute[74669]:   <metadata>
Nov 08 16:50:56 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:50:56 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:50:56 user nova-compute[74669]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-806433756</nova:name>
Nov 08 16:50:56 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:50:56</nova:creationTime>
Nov 08 16:50:56 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:50:56 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:50:56 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:50:56 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:50:56 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:50:56 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:50:56 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:50:56 user nova-compute[74669]:       <nova:owner>
Nov 08 16:50:56 user nova-compute[74669]:         <nova:user uuid="4836f11b0e8346a2a7e835a6012f53fb">tempest-ServerRescueNegativeTestJSON-1743978403-project-member</nova:user>
Nov 08 16:50:56 user nova-compute[74669]:         <nova:project uuid="632d3acc026b4a869be4899a0ed2e2e2">tempest-ServerRescueNegativeTestJSON-1743978403</nova:project>
Nov 08 16:50:56 user nova-compute[74669]:       </nova:owner>
Nov 08 16:50:56 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:50:56 user nova-compute[74669]:       <nova:ports>
Nov 08 16:50:56 user nova-compute[74669]:         <nova:port uuid="44b48f6d-e0fe-4178-badd-f5f57cd1cd6e">
Nov 08 16:50:56 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 16:50:56 user nova-compute[74669]:         </nova:port>
Nov 08 16:50:56 user nova-compute[74669]:       </nova:ports>
Nov 08 16:50:56 user nova-compute[74669]:     </nova:instance>
Nov 08 16:50:56 user nova-compute[74669]:   </metadata>
Nov 08 16:50:56 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:50:56 user nova-compute[74669]:     <system>
Nov 08 16:50:56 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:50:56 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:50:56 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:50:56 user nova-compute[74669]:       <entry name="serial">e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a</entry>
Nov 08 16:50:56 user nova-compute[74669]:       <entry name="uuid">e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a</entry>
Nov 08 16:50:56 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:50:56 user nova-compute[74669]:     </system>
Nov 08 16:50:56 user nova-compute[74669]:   </sysinfo>
Nov 08 16:50:56 user nova-compute[74669]:   <os>
Nov 08 16:50:56 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:50:56 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 16:50:56 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:50:56 user nova-compute[74669]:   </os>
Nov 08 16:50:56 user nova-compute[74669]:   <features>
Nov 08 16:50:56 user nova-compute[74669]:     <acpi/>
Nov 08 16:50:56 user nova-compute[74669]:     <apic/>
Nov 08 16:50:56 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:50:56 user nova-compute[74669]:   </features>
Nov 08 16:50:56 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:50:56 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:50:56 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:50:56 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:50:56 user nova-compute[74669]:   </clock>
Nov 08 16:50:56 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:50:56 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:50:56 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:50:56 user nova-compute[74669]:   </cpu>
Nov 08 16:50:56 user nova-compute[74669]:   <devices>
Nov 08 16:50:56 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:50:56 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:50:56 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk"/>
Nov 08 16:50:56 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:50:56 user nova-compute[74669]:     </disk>
Nov 08 16:50:56 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:50:56 user nova-compute[74669]:       <mac address="fa:16:3e:8f:9e:16"/>
Nov 08 16:50:56 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:50:56 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:50:56 user nova-compute[74669]:       <target dev="tap44b48f6d-e0"/>
Nov 08 16:50:56 user nova-compute[74669]:     </interface>
Nov 08 16:50:56 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:50:56 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/console.log" append="off"/>
Nov 08 16:50:56 user nova-compute[74669]:     </serial>
Nov 08 16:50:56 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:50:56 user nova-compute[74669]:     <video>
Nov 08 16:50:56 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:50:56 user nova-compute[74669]:     </video>
Nov 08 16:50:56 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:50:56 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:50:56 user nova-compute[74669]:     </rng>
Nov 08 16:50:56 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:50:56 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:50:56 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:50:56 user nova-compute[74669]:     </memballoon>
Nov 08 16:50:56 user nova-compute[74669]:   </devices>
Nov 08 16:50:56 user nova-compute[74669]: </domain>
Nov 08 16:50:56 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-806433756',display_name='tempest-ServerRescueNegativeTestJSON-server-806433756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-806433756',id=3,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='632d3acc026b4a869be4899a0ed2e2e2',ramdisk_id='',reservation_id='r-zvbxh990',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1743978403',owner_user_name='tempest-ServerRescueNegativeTestJSON-1743978403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:50:51Z,user_data=None,user_id='4836f11b0e8346a2a7e835a6012f53fb',uuid=e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "address": "fa:16:3e:8f:9e:16", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b48f6d-e0", "ovs_interfaceid": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converting VIF {"id": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "address": "fa:16:3e:8f:9e:16", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b48f6d-e0", "ovs_interfaceid": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=44b48f6d-e0fe-4178-badd-f5f57cd1cd6e,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44b48f6d-e0') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG os_vif [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=44b48f6d-e0fe-4178-badd-f5f57cd1cd6e,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44b48f6d-e0') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd665648a-366c-5004-a677-699fba77c7b4', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44b48f6d-e0, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap44b48f6d-e0, col_values=(('qos', UUID('914dc754-e171-4b21-90a1-d99fd0f5c421')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap44b48f6d-e0, col_values=(('external_ids', {'iface-id': '44b48f6d-e0fe-4178-badd-f5f57cd1cd6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:9e:16', 'vm-uuid': 'e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:56 user nova-compute[74669]: INFO os_vif [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=44b48f6d-e0fe-4178-badd-f5f57cd1cd6e,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44b48f6d-e0')
Nov 08 16:50:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.743s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] No VIF found with MAC fa:16:3e:8f:9e:16, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 16:50:56 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.policy [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acb95477d6ba46d4be3b34280c5892e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bc128b2ae524ce0aff2afb7301888bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 16:50:56 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Creating image(s)
Nov 08 16:50:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "/opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "/opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "/opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.232s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.171s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk 1073741824" returned: 0 in 0.048s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.220s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG nova.network.neutron [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Successfully updated port: 525ba5da-155c-4f87-9fae-8db52836f73e {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "refresh_cache-7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquired lock "refresh_cache-7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG nova.network.neutron [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-994eb99e-2910-4895-be52-1d58c73e7b45 req-c7a84329-c48d-4e4e-bcc5-e94e91e7c4a0 service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Received event network-changed-525ba5da-155c-4f87-9fae-8db52836f73e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-994eb99e-2910-4895-be52-1d58c73e7b45 req-c7a84329-c48d-4e4e-bcc5-e94e91e7c4a0 service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Refreshing instance network info cache due to event network-changed-525ba5da-155c-4f87-9fae-8db52836f73e. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-994eb99e-2910-4895-be52-1d58c73e7b45 req-c7a84329-c48d-4e4e-bcc5-e94e91e7c4a0 service nova] Acquiring lock "refresh_cache-7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Cannot resize image /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Ensure instance console log exists: /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:57 user nova-compute[74669]: DEBUG nova.network.neutron [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.network.neutron [req-248b6be2-4cf1-43ca-8c9e-f12655502d42 req-4de1c925-91e4-4234-9049-1b08bfc594b9 service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Updated VIF entry in instance network info cache for port 44b48f6d-e0fe-4178-badd-f5f57cd1cd6e. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.network.neutron [req-248b6be2-4cf1-43ca-8c9e-f12655502d42 req-4de1c925-91e4-4234-9049-1b08bfc594b9 service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Updating instance_info_cache with network_info: [{"id": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "address": "fa:16:3e:8f:9e:16", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b48f6d-e0", "ovs_interfaceid": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-248b6be2-4cf1-43ca-8c9e-f12655502d42 req-4de1c925-91e4-4234-9049-1b08bfc594b9 service nova] Releasing lock "refresh_cache-e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Successfully created port: 47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.network.neutron [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Updating instance_info_cache with network_info: [{"id": "525ba5da-155c-4f87-9fae-8db52836f73e", "address": "fa:16:3e:7b:7c:e2", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525ba5da-15", "ovs_interfaceid": "525ba5da-155c-4f87-9fae-8db52836f73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Releasing lock "refresh_cache-7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Instance network_info: |[{"id": "525ba5da-155c-4f87-9fae-8db52836f73e", "address": "fa:16:3e:7b:7c:e2", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525ba5da-15", "ovs_interfaceid": "525ba5da-155c-4f87-9fae-8db52836f73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-994eb99e-2910-4895-be52-1d58c73e7b45 req-c7a84329-c48d-4e4e-bcc5-e94e91e7c4a0 service nova] Acquired lock "refresh_cache-7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.network.neutron [req-994eb99e-2910-4895-be52-1d58c73e7b45 req-c7a84329-c48d-4e4e-bcc5-e94e91e7c4a0 service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Refreshing network info cache for port 525ba5da-155c-4f87-9fae-8db52836f73e {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Start _get_guest_xml network_info=[{"id": "525ba5da-155c-4f87-9fae-8db52836f73e", "address": "fa:16:3e:7b:7c:e2", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525ba5da-15", "ovs_interfaceid": "525ba5da-155c-4f87-9fae-8db52836f73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:50:58 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:50:58 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-352889271',display_name='tempest-ServerRescueNegativeTestJSON-server-352889271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-352889271',id=4,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='632d3acc026b4a869be4899a0ed2e2e2',ramdisk_id='',reservation_id='r-ux3r1hfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1743978403',owner_user_name='tempest-ServerRescueNegativeTestJSON-1743978403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:50:52Z,user_data=None,user_id='4836f11b0e8346a2a7e835a6012f53fb',uuid=7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "525ba5da-155c-4f87-9fae-8db52836f73e", "address": "fa:16:3e:7b:7c:e2", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525ba5da-15", "ovs_interfaceid": "525ba5da-155c-4f87-9fae-8db52836f73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converting VIF {"id": "525ba5da-155c-4f87-9fae-8db52836f73e", "address": "fa:16:3e:7b:7c:e2", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525ba5da-15", "ovs_interfaceid": "525ba5da-155c-4f87-9fae-8db52836f73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:7c:e2,bridge_name='br-int',has_traffic_filtering=True,id=525ba5da-155c-4f87-9fae-8db52836f73e,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525ba5da-15') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.objects.instance [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:50:58 user nova-compute[74669]:   <uuid>7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8</uuid>
Nov 08 16:50:58 user nova-compute[74669]:   <name>instance-00000004</name>
Nov 08 16:50:58 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:50:58 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:50:58 user nova-compute[74669]:   <metadata>
Nov 08 16:50:58 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:50:58 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:50:58 user nova-compute[74669]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-352889271</nova:name>
Nov 08 16:50:58 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:50:58</nova:creationTime>
Nov 08 16:50:58 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:50:58 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:50:58 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:50:58 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:50:58 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:50:58 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:50:58 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:50:58 user nova-compute[74669]:       <nova:owner>
Nov 08 16:50:58 user nova-compute[74669]:         <nova:user uuid="4836f11b0e8346a2a7e835a6012f53fb">tempest-ServerRescueNegativeTestJSON-1743978403-project-member</nova:user>
Nov 08 16:50:58 user nova-compute[74669]:         <nova:project uuid="632d3acc026b4a869be4899a0ed2e2e2">tempest-ServerRescueNegativeTestJSON-1743978403</nova:project>
Nov 08 16:50:58 user nova-compute[74669]:       </nova:owner>
Nov 08 16:50:58 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:50:58 user nova-compute[74669]:       <nova:ports>
Nov 08 16:50:58 user nova-compute[74669]:         <nova:port uuid="525ba5da-155c-4f87-9fae-8db52836f73e">
Nov 08 16:50:58 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 16:50:58 user nova-compute[74669]:         </nova:port>
Nov 08 16:50:58 user nova-compute[74669]:       </nova:ports>
Nov 08 16:50:58 user nova-compute[74669]:     </nova:instance>
Nov 08 16:50:58 user nova-compute[74669]:   </metadata>
Nov 08 16:50:58 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:50:58 user nova-compute[74669]:     <system>
Nov 08 16:50:58 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:50:58 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:50:58 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:50:58 user nova-compute[74669]:       <entry name="serial">7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8</entry>
Nov 08 16:50:58 user nova-compute[74669]:       <entry name="uuid">7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8</entry>
Nov 08 16:50:58 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:50:58 user nova-compute[74669]:     </system>
Nov 08 16:50:58 user nova-compute[74669]:   </sysinfo>
Nov 08 16:50:58 user nova-compute[74669]:   <os>
Nov 08 16:50:58 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:50:58 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 16:50:58 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:50:58 user nova-compute[74669]:   </os>
Nov 08 16:50:58 user nova-compute[74669]:   <features>
Nov 08 16:50:58 user nova-compute[74669]:     <acpi/>
Nov 08 16:50:58 user nova-compute[74669]:     <apic/>
Nov 08 16:50:58 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:50:58 user nova-compute[74669]:   </features>
Nov 08 16:50:58 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:50:58 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:50:58 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:50:58 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:50:58 user nova-compute[74669]:   </clock>
Nov 08 16:50:58 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:50:58 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:50:58 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:50:58 user nova-compute[74669]:   </cpu>
Nov 08 16:50:58 user nova-compute[74669]:   <devices>
Nov 08 16:50:58 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:50:58 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:50:58 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk"/>
Nov 08 16:50:58 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:50:58 user nova-compute[74669]:     </disk>
Nov 08 16:50:58 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:50:58 user nova-compute[74669]:       <mac address="fa:16:3e:7b:7c:e2"/>
Nov 08 16:50:58 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:50:58 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:50:58 user nova-compute[74669]:       <target dev="tap525ba5da-15"/>
Nov 08 16:50:58 user nova-compute[74669]:     </interface>
Nov 08 16:50:58 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:50:58 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/console.log" append="off"/>
Nov 08 16:50:58 user nova-compute[74669]:     </serial>
Nov 08 16:50:58 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:50:58 user nova-compute[74669]:     <video>
Nov 08 16:50:58 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:50:58 user nova-compute[74669]:     </video>
Nov 08 16:50:58 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:50:58 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:50:58 user nova-compute[74669]:     </rng>
Nov 08 16:50:58 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:50:58 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:50:58 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:50:58 user nova-compute[74669]:     </memballoon>
Nov 08 16:50:58 user nova-compute[74669]:   </devices>
Nov 08 16:50:58 user nova-compute[74669]: </domain>
Nov 08 16:50:58 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-352889271',display_name='tempest-ServerRescueNegativeTestJSON-server-352889271',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-352889271',id=4,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='632d3acc026b4a869be4899a0ed2e2e2',ramdisk_id='',reservation_id='r-ux3r1hfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1743978403',owner_user_name='tempest-ServerRescueNegativeTestJSON-1743978403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:50:52Z,user_data=None,user_id='4836f11b0e8346a2a7e835a6012f53fb',uuid=7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "525ba5da-155c-4f87-9fae-8db52836f73e", "address": "fa:16:3e:7b:7c:e2", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525ba5da-15", "ovs_interfaceid": "525ba5da-155c-4f87-9fae-8db52836f73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converting VIF {"id": "525ba5da-155c-4f87-9fae-8db52836f73e", "address": "fa:16:3e:7b:7c:e2", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525ba5da-15", "ovs_interfaceid": "525ba5da-155c-4f87-9fae-8db52836f73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:7c:e2,bridge_name='br-int',has_traffic_filtering=True,id=525ba5da-155c-4f87-9fae-8db52836f73e,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525ba5da-15') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG os_vif [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:7c:e2,bridge_name='br-int',has_traffic_filtering=True,id=525ba5da-155c-4f87-9fae-8db52836f73e,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525ba5da-15') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e914e19-b9a5-5fa3-a6e5-fd26051905aa', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap525ba5da-15, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap525ba5da-15, col_values=(('qos', UUID('edbc5498-ab36-4e49-b071-eb5910d781ae')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap525ba5da-15, col_values=(('external_ids', {'iface-id': '525ba5da-155c-4f87-9fae-8db52836f73e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:7c:e2', 'vm-uuid': '7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:59 user nova-compute[74669]: INFO os_vif [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:7c:e2,bridge_name='br-int',has_traffic_filtering=True,id=525ba5da-155c-4f87-9fae-8db52836f73e,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525ba5da-15')
Nov 08 16:50:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:50:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] No VIF found with MAC fa:16:3e:7b:7c:e2, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:50:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:50:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-29748257-c3a7-476f-99ad-c2c592a49f03 req-fe8a9021-ebae-41d5-839b-7517767d6563 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:50:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-29748257-c3a7-476f-99ad-c2c592a49f03 req-fe8a9021-ebae-41d5-839b-7517767d6563 service nova] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:50:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-29748257-c3a7-476f-99ad-c2c592a49f03 req-fe8a9021-ebae-41d5-839b-7517767d6563 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:50:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-29748257-c3a7-476f-99ad-c2c592a49f03 req-fe8a9021-ebae-41d5-839b-7517767d6563 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:50:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-29748257-c3a7-476f-99ad-c2c592a49f03 req-fe8a9021-ebae-41d5-839b-7517767d6563 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] No waiting events found dispatching network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:50:59 user nova-compute[74669]: WARNING nova.compute.manager [req-29748257-c3a7-476f-99ad-c2c592a49f03 req-fe8a9021-ebae-41d5-839b-7517767d6563 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received unexpected event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 for instance with vm_state building and task_state spawning.
Nov 08 16:51:00 user nova-compute[74669]: DEBUG nova.network.neutron [req-994eb99e-2910-4895-be52-1d58c73e7b45 req-c7a84329-c48d-4e4e-bcc5-e94e91e7c4a0 service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Updated VIF entry in instance network info cache for port 525ba5da-155c-4f87-9fae-8db52836f73e. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:51:00 user nova-compute[74669]: DEBUG nova.network.neutron [req-994eb99e-2910-4895-be52-1d58c73e7b45 req-c7a84329-c48d-4e4e-bcc5-e94e91e7c4a0 service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Updating instance_info_cache with network_info: [{"id": "525ba5da-155c-4f87-9fae-8db52836f73e", "address": "fa:16:3e:7b:7c:e2", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525ba5da-15", "ovs_interfaceid": "525ba5da-155c-4f87-9fae-8db52836f73e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:51:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-994eb99e-2910-4895-be52-1d58c73e7b45 req-c7a84329-c48d-4e4e-bcc5-e94e91e7c4a0 service nova] Releasing lock "refresh_cache-7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:51:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:00 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Successfully updated port: 47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:51:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:51:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquired lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:51:00 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:51:00 user nova-compute[74669]: DEBUG nova.compute.manager [req-0c95d769-de24-4a3d-99bc-d31377cfe415 req-1859e309-a794-463a-9a96-5498c4030320 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received event network-changed-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:51:00 user nova-compute[74669]: DEBUG nova.compute.manager [req-0c95d769-de24-4a3d-99bc-d31377cfe415 req-1859e309-a794-463a-9a96-5498c4030320 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Refreshing instance network info cache due to event network-changed-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:51:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0c95d769-de24-4a3d-99bc-d31377cfe415 req-1859e309-a794-463a-9a96-5498c4030320 service nova] Acquiring lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:51:00 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:51:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Updating instance_info_cache with network_info: [{"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Releasing lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Instance network_info: |[{"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0c95d769-de24-4a3d-99bc-d31377cfe415 req-1859e309-a794-463a-9a96-5498c4030320 service nova] Acquired lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.network.neutron [req-0c95d769-de24-4a3d-99bc-d31377cfe415 req-1859e309-a794-463a-9a96-5498c4030320 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Refreshing network info cache for port 47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Start _get_guest_xml network_info=[{"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:51:01 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:51:01 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-82074997',display_name='tempest-ServerActionsTestOtherB-server-82074997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-82074997',id=5,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVVAiZ/J+loI4/5CGCEcHyBdao/VDdeBeozCcJvl0eh7qycgoJCVfo066fltlkQiowyw4815L1dFrqeYMGOPhwhd9fpfcyVQWgEILP3lJeo6lsJtZZ3WMWpczoYeL0t+w==',key_name='tempest-keypair-1692388907',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bc128b2ae524ce0aff2afb7301888bf',ramdisk_id='',reservation_id='r-fjmhrntp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-839528249',owner_user_name='tempest-ServerActionsTestOtherB-839528249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acb95477d6ba46d4be3b34280c5892e5',uuid=b26dbeeb-b629-414d-bcca-cdde6c207789,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Converting VIF {"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:33:ae,bridge_name='br-int',has_traffic_filtering=True,id=47c9314f-4ea9-49c3-9b34-2fb94cc1eac4,network=Network(35a879d8-439e-4ac4-a8ae-292e3b9a1966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9314f-4e') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.objects.instance [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lazy-loading 'pci_devices' on Instance uuid b26dbeeb-b629-414d-bcca-cdde6c207789 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:51:01 user nova-compute[74669]:   <uuid>b26dbeeb-b629-414d-bcca-cdde6c207789</uuid>
Nov 08 16:51:01 user nova-compute[74669]:   <name>instance-00000005</name>
Nov 08 16:51:01 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:51:01 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:51:01 user nova-compute[74669]:   <metadata>
Nov 08 16:51:01 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:51:01 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:51:01 user nova-compute[74669]:       <nova:name>tempest-ServerActionsTestOtherB-server-82074997</nova:name>
Nov 08 16:51:01 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:51:01</nova:creationTime>
Nov 08 16:51:01 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:51:01 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:51:01 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:51:01 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:51:01 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:51:01 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:51:01 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:51:01 user nova-compute[74669]:       <nova:owner>
Nov 08 16:51:01 user nova-compute[74669]:         <nova:user uuid="acb95477d6ba46d4be3b34280c5892e5">tempest-ServerActionsTestOtherB-839528249-project-member</nova:user>
Nov 08 16:51:01 user nova-compute[74669]:         <nova:project uuid="9bc128b2ae524ce0aff2afb7301888bf">tempest-ServerActionsTestOtherB-839528249</nova:project>
Nov 08 16:51:01 user nova-compute[74669]:       </nova:owner>
Nov 08 16:51:01 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:51:01 user nova-compute[74669]:       <nova:ports>
Nov 08 16:51:01 user nova-compute[74669]:         <nova:port uuid="47c9314f-4ea9-49c3-9b34-2fb94cc1eac4">
Nov 08 16:51:01 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 16:51:01 user nova-compute[74669]:         </nova:port>
Nov 08 16:51:01 user nova-compute[74669]:       </nova:ports>
Nov 08 16:51:01 user nova-compute[74669]:     </nova:instance>
Nov 08 16:51:01 user nova-compute[74669]:   </metadata>
Nov 08 16:51:01 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:51:01 user nova-compute[74669]:     <system>
Nov 08 16:51:01 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:51:01 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:51:01 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:51:01 user nova-compute[74669]:       <entry name="serial">b26dbeeb-b629-414d-bcca-cdde6c207789</entry>
Nov 08 16:51:01 user nova-compute[74669]:       <entry name="uuid">b26dbeeb-b629-414d-bcca-cdde6c207789</entry>
Nov 08 16:51:01 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:51:01 user nova-compute[74669]:     </system>
Nov 08 16:51:01 user nova-compute[74669]:   </sysinfo>
Nov 08 16:51:01 user nova-compute[74669]:   <os>
Nov 08 16:51:01 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:51:01 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 16:51:01 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:51:01 user nova-compute[74669]:   </os>
Nov 08 16:51:01 user nova-compute[74669]:   <features>
Nov 08 16:51:01 user nova-compute[74669]:     <acpi/>
Nov 08 16:51:01 user nova-compute[74669]:     <apic/>
Nov 08 16:51:01 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:51:01 user nova-compute[74669]:   </features>
Nov 08 16:51:01 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:51:01 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:51:01 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:51:01 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:51:01 user nova-compute[74669]:   </clock>
Nov 08 16:51:01 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:51:01 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:51:01 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:51:01 user nova-compute[74669]:   </cpu>
Nov 08 16:51:01 user nova-compute[74669]:   <devices>
Nov 08 16:51:01 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:51:01 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:51:01 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk"/>
Nov 08 16:51:01 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:51:01 user nova-compute[74669]:     </disk>
Nov 08 16:51:01 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:51:01 user nova-compute[74669]:       <mac address="fa:16:3e:33:33:ae"/>
Nov 08 16:51:01 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:51:01 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:51:01 user nova-compute[74669]:       <target dev="tap47c9314f-4e"/>
Nov 08 16:51:01 user nova-compute[74669]:     </interface>
Nov 08 16:51:01 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:51:01 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/console.log" append="off"/>
Nov 08 16:51:01 user nova-compute[74669]:     </serial>
Nov 08 16:51:01 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:51:01 user nova-compute[74669]:     <video>
Nov 08 16:51:01 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:51:01 user nova-compute[74669]:     </video>
Nov 08 16:51:01 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:51:01 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:51:01 user nova-compute[74669]:     </rng>
Nov 08 16:51:01 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:51:01 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:51:01 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:51:01 user nova-compute[74669]:     </memballoon>
Nov 08 16:51:01 user nova-compute[74669]:   </devices>
Nov 08 16:51:01 user nova-compute[74669]: </domain>
Nov 08 16:51:01 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-82074997',display_name='tempest-ServerActionsTestOtherB-server-82074997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-82074997',id=5,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVVAiZ/J+loI4/5CGCEcHyBdao/VDdeBeozCcJvl0eh7qycgoJCVfo066fltlkQiowyw4815L1dFrqeYMGOPhwhd9fpfcyVQWgEILP3lJeo6lsJtZZ3WMWpczoYeL0t+w==',key_name='tempest-keypair-1692388907',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bc128b2ae524ce0aff2afb7301888bf',ramdisk_id='',reservation_id='r-fjmhrntp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-839528249',owner_user_name='tempest-ServerActionsTestOtherB-839528249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acb95477d6ba46d4be3b34280c5892e5',uuid=b26dbeeb-b629-414d-bcca-cdde6c207789,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Converting VIF {"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:33:ae,bridge_name='br-int',has_traffic_filtering=True,id=47c9314f-4ea9-49c3-9b34-2fb94cc1eac4,network=Network(35a879d8-439e-4ac4-a8ae-292e3b9a1966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9314f-4e') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG os_vif [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:33:ae,bridge_name='br-int',has_traffic_filtering=True,id=47c9314f-4ea9-49c3-9b34-2fb94cc1eac4,network=Network(35a879d8-439e-4ac4-a8ae-292e3b9a1966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9314f-4e') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af7b870c-ed84-5da9-bbc3-4b1f6e3df14b', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47c9314f-4e, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47c9314f-4e, col_values=(('qos', UUID('cc67e742-5269-4865-8f4e-ef4ed89bdc1f')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47c9314f-4e, col_values=(('external_ids', {'iface-id': '47c9314f-4ea9-49c3-9b34-2fb94cc1eac4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:33:ae', 'vm-uuid': 'b26dbeeb-b629-414d-bcca-cdde6c207789'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:01 user nova-compute[74669]: INFO os_vif [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:33:ae,bridge_name='br-int',has_traffic_filtering=True,id=47c9314f-4ea9-49c3-9b34-2fb94cc1eac4,network=Network(35a879d8-439e-4ac4-a8ae-292e3b9a1966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9314f-4e')
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-163d35d4-1503-4513-858d-bc9f8f508c48 req-619aa3fb-d3fd-459c-8baa-3f0c692b015d service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-163d35d4-1503-4513-858d-bc9f8f508c48 req-619aa3fb-d3fd-459c-8baa-3f0c692b015d service nova] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-163d35d4-1503-4513-858d-bc9f8f508c48 req-619aa3fb-d3fd-459c-8baa-3f0c692b015d service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-163d35d4-1503-4513-858d-bc9f8f508c48 req-619aa3fb-d3fd-459c-8baa-3f0c692b015d service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-163d35d4-1503-4513-858d-bc9f8f508c48 req-619aa3fb-d3fd-459c-8baa-3f0c692b015d service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] No waiting events found dispatching network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:51:01 user nova-compute[74669]: WARNING nova.compute.manager [req-163d35d4-1503-4513-858d-bc9f8f508c48 req-619aa3fb-d3fd-459c-8baa-3f0c692b015d service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received unexpected event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 for instance with vm_state building and task_state spawning.
Nov 08 16:51:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:51:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] No VIF found with MAC fa:16:3e:33:33:ae, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:51:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:02 user nova-compute[74669]: DEBUG nova.compute.manager [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 16:51:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 16:51:02 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Instance spawned successfully.
Nov 08 16:51:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 16:51:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:02 user nova-compute[74669]: INFO nova.compute.manager [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Took 11.87 seconds to spawn the instance on the hypervisor.
Nov 08 16:51:02 user nova-compute[74669]: DEBUG nova.compute.manager [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:51:02 user nova-compute[74669]: DEBUG nova.network.neutron [req-0c95d769-de24-4a3d-99bc-d31377cfe415 req-1859e309-a794-463a-9a96-5498c4030320 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Updated VIF entry in instance network info cache for port 47c9314f-4ea9-49c3-9b34-2fb94cc1eac4. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:51:02 user nova-compute[74669]: DEBUG nova.network.neutron [req-0c95d769-de24-4a3d-99bc-d31377cfe415 req-1859e309-a794-463a-9a96-5498c4030320 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Updating instance_info_cache with network_info: [{"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:51:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0c95d769-de24-4a3d-99bc-d31377cfe415 req-1859e309-a794-463a-9a96-5498c4030320 service nova] Releasing lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:51:03 user nova-compute[74669]: INFO nova.compute.manager [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Took 12.72 seconds to build instance.
Nov 08 16:51:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c12ec6a8-b39b-45e9-bac8-6b212abc5c71 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.854s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:03 user nova-compute[74669]: DEBUG nova.compute.manager [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 16:51:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 16:51:03 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Instance spawned successfully.
Nov 08 16:51:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 16:51:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:04 user nova-compute[74669]: INFO nova.compute.manager [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Took 18.55 seconds to spawn the instance on the hypervisor.
Nov 08 16:51:04 user nova-compute[74669]: DEBUG nova.compute.manager [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:51:04 user nova-compute[74669]: INFO nova.compute.manager [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Took 19.90 seconds to build instance.
Nov 08 16:51:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-01f32687-30d3-4e7a-812f-805d8d84ccb1 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.234s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Acquiring lock "725977e4-d011-4c79-b8bc-39bed9649515" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Lock "725977e4-d011-4c79-b8bc-39bed9649515" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:05 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 16:51:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:05 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 16:51:05 user nova-compute[74669]: INFO nova.compute.claims [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Claim successful on node user
Nov 08 16:51:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:51:06 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Instance spawned successfully.
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.644s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 16:51:06 user nova-compute[74669]: INFO nova.compute.manager [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Took 18.37 seconds to spawn the instance on the hypervisor.
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 16:51:06 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Instance spawned successfully.
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 16:51:06 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.policy [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb8d9223b6c148158b55f12592e2a800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3efb4b77179e4bb293fb6c2c78f9c4b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 16:51:06 user nova-compute[74669]: INFO nova.compute.manager [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Took 14.22 seconds to spawn the instance on the hypervisor.
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 16:51:06 user nova-compute[74669]: INFO nova.compute.manager [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Took 19.41 seconds to build instance.
Nov 08 16:51:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a3e9ac8d-ce1e-445d-871c-1b8cc46dfa2b tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.585s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 16:51:06 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Creating image(s)
Nov 08 16:51:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Acquiring lock "/opt/stack/data/nova/instances/725977e4-d011-4c79-b8bc-39bed9649515/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Lock "/opt/stack/data/nova/instances/725977e4-d011-4c79-b8bc-39bed9649515/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Lock "/opt/stack/data/nova/instances/725977e4-d011-4c79-b8bc-39bed9649515/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:07 user nova-compute[74669]: INFO nova.compute.manager [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Took 15.31 seconds to build instance.
Nov 08 16:51:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e942795b-abeb-40b7-8b39-5e6b8896acd9 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.611s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.293s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:07 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 16:51:07 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 16:51:07 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Instance spawned successfully.
Nov 08 16:51:07 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 16:51:07 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:07 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:07 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:07 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:07 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:07 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.295s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/725977e4-d011-4c79-b8bc-39bed9649515/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:07 user nova-compute[74669]: INFO nova.compute.manager [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Took 10.71 seconds to spawn the instance on the hypervisor.
Nov 08 16:51:07 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:51:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/725977e4-d011-4c79-b8bc-39bed9649515/disk 1073741824" returned: 0 in 0.168s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.467s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:07 user nova-compute[74669]: INFO nova.compute.manager [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Took 12.11 seconds to build instance.
Nov 08 16:51:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac70e719-9386-4ee2-8266-dd948fbb4c82 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.286s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:07 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Successfully created port: 85a996ca-5cd2-468a-a1b1-55f5c882a624 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:51:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.330s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:08 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Checking if we can resize image /opt/stack/data/nova/instances/725977e4-d011-4c79-b8bc-39bed9649515/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 16:51:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725977e4-d011-4c79-b8bc-39bed9649515/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725977e4-d011-4c79-b8bc-39bed9649515/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:08 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Cannot resize image /opt/stack/data/nova/instances/725977e4-d011-4c79-b8bc-39bed9649515/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 16:51:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 16:51:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Ensure instance console log exists: /opt/stack/data/nova/instances/725977e4-d011-4c79-b8bc-39bed9649515/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 16:51:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:09 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Successfully updated port: 85a996ca-5cd2-468a-a1b1-55f5c882a624 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:51:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Acquiring lock "refresh_cache-725977e4-d011-4c79-b8bc-39bed9649515" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:51:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Acquired lock "refresh_cache-725977e4-d011-4c79-b8bc-39bed9649515" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:51:09 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:51:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-266e8e3b-2bdd-4c03-9cb8-43d62d31d842 req-b1f72144-ccd1-469c-8cb5-773f5fa7f3cd service nova] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Received event network-changed-85a996ca-5cd2-468a-a1b1-55f5c882a624 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:51:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-266e8e3b-2bdd-4c03-9cb8-43d62d31d842 req-b1f72144-ccd1-469c-8cb5-773f5fa7f3cd service nova] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Refreshing instance network info cache due to event network-changed-85a996ca-5cd2-468a-a1b1-55f5c882a624. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:51:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-266e8e3b-2bdd-4c03-9cb8-43d62d31d842 req-b1f72144-ccd1-469c-8cb5-773f5fa7f3cd service nova] Acquiring lock "refresh_cache-725977e4-d011-4c79-b8bc-39bed9649515" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:51:09 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:51:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Updating instance_info_cache with network_info: [{"id": "85a996ca-5cd2-468a-a1b1-55f5c882a624", "address": "fa:16:3e:69:c3:30", "network": {"id": "47a98eee-3da5-4b15-891c-f11bee25b2ce", "bridge": "br-int", "label": "tempest-VolumesActionsTest-829228011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efb4b77179e4bb293fb6c2c78f9c4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a996ca-5c", "ovs_interfaceid": "85a996ca-5cd2-468a-a1b1-55f5c882a624", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Releasing lock "refresh_cache-725977e4-d011-4c79-b8bc-39bed9649515" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Instance network_info: |[{"id": "85a996ca-5cd2-468a-a1b1-55f5c882a624", "address": "fa:16:3e:69:c3:30", "network": {"id": "47a98eee-3da5-4b15-891c-f11bee25b2ce", "bridge": "br-int", "label": "tempest-VolumesActionsTest-829228011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efb4b77179e4bb293fb6c2c78f9c4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a996ca-5c", "ovs_interfaceid": "85a996ca-5cd2-468a-a1b1-55f5c882a624", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-266e8e3b-2bdd-4c03-9cb8-43d62d31d842 req-b1f72144-ccd1-469c-8cb5-773f5fa7f3cd service nova] Acquired lock "refresh_cache-725977e4-d011-4c79-b8bc-39bed9649515" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.network.neutron [req-266e8e3b-2bdd-4c03-9cb8-43d62d31d842 req-b1f72144-ccd1-469c-8cb5-773f5fa7f3cd service nova] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Refreshing network info cache for port 85a996ca-5cd2-468a-a1b1-55f5c882a624 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Start _get_guest_xml network_info=[{"id": "85a996ca-5cd2-468a-a1b1-55f5c882a624", "address": "fa:16:3e:69:c3:30", "network": {"id": "47a98eee-3da5-4b15-891c-f11bee25b2ce", "bridge": "br-int", "label": "tempest-VolumesActionsTest-829228011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efb4b77179e4bb293fb6c2c78f9c4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a996ca-5c", "ovs_interfaceid": "85a996ca-5cd2-468a-a1b1-55f5c882a624", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:51:10 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:51:10 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:51:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1781888160',display_name='tempest-VolumesActionsTest-instance-1781888160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1781888160',id=6,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3efb4b77179e4bb293fb6c2c78f9c4b3',ramdisk_id='',reservation_id='r-tcviqwz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-137413693',owner_user_name='tempest-VolumesActionsTest-137413693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:51:07Z,user_data=None,user_id='fb8d9223b6c148158b55f12592e2a800',uuid=725977e4-d011-4c79-b8bc-39bed9649515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85a996ca-5cd2-468a-a1b1-55f5c882a624", "address": "fa:16:3e:69:c3:30", "network": {"id": "47a98eee-3da5-4b15-891c-f11bee25b2ce", "bridge": "br-int", "label": "tempest-VolumesActionsTest-829228011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efb4b77179e4bb293fb6c2c78f9c4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a996ca-5c", "ovs_interfaceid": "85a996ca-5cd2-468a-a1b1-55f5c882a624", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Converting VIF {"id": "85a996ca-5cd2-468a-a1b1-55f5c882a624", "address": "fa:16:3e:69:c3:30", "network": {"id": "47a98eee-3da5-4b15-891c-f11bee25b2ce", "bridge": "br-int", "label": "tempest-VolumesActionsTest-829228011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efb4b77179e4bb293fb6c2c78f9c4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a996ca-5c", "ovs_interfaceid": "85a996ca-5cd2-468a-a1b1-55f5c882a624", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:c3:30,bridge_name='br-int',has_traffic_filtering=True,id=85a996ca-5cd2-468a-a1b1-55f5c882a624,network=Network(47a98eee-3da5-4b15-891c-f11bee25b2ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a996ca-5c') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.objects.instance [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Lazy-loading 'pci_devices' on Instance uuid 725977e4-d011-4c79-b8bc-39bed9649515 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.compute.manager [req-1b6687f2-ad39-46ac-b25e-a74214f172bd req-b5d3ea60-a895-48a2-8bec-e5eb5c1990b0 service nova] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Received event network-vif-plugged-542b5f60-bd62-4bb3-a644-b7d92762bca0 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1b6687f2-ad39-46ac-b25e-a74214f172bd req-b5d3ea60-a895-48a2-8bec-e5eb5c1990b0 service nova] Acquiring lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1b6687f2-ad39-46ac-b25e-a74214f172bd req-b5d3ea60-a895-48a2-8bec-e5eb5c1990b0 service nova] Lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1b6687f2-ad39-46ac-b25e-a74214f172bd req-b5d3ea60-a895-48a2-8bec-e5eb5c1990b0 service nova] Lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.compute.manager [req-1b6687f2-ad39-46ac-b25e-a74214f172bd req-b5d3ea60-a895-48a2-8bec-e5eb5c1990b0 service nova] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] No waiting events found dispatching network-vif-plugged-542b5f60-bd62-4bb3-a644-b7d92762bca0 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:51:10 user nova-compute[74669]: WARNING nova.compute.manager [req-1b6687f2-ad39-46ac-b25e-a74214f172bd req-b5d3ea60-a895-48a2-8bec-e5eb5c1990b0 service nova] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Received unexpected event network-vif-plugged-542b5f60-bd62-4bb3-a644-b7d92762bca0 for instance with vm_state active and task_state None.
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:51:10 user nova-compute[74669]:   <uuid>725977e4-d011-4c79-b8bc-39bed9649515</uuid>
Nov 08 16:51:10 user nova-compute[74669]:   <name>instance-00000006</name>
Nov 08 16:51:10 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:51:10 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:51:10 user nova-compute[74669]:   <metadata>
Nov 08 16:51:10 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:51:10 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:51:10 user nova-compute[74669]:       <nova:name>tempest-VolumesActionsTest-instance-1781888160</nova:name>
Nov 08 16:51:10 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:51:10</nova:creationTime>
Nov 08 16:51:10 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:51:10 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:51:10 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:51:10 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:51:10 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:51:10 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:51:10 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:51:10 user nova-compute[74669]:       <nova:owner>
Nov 08 16:51:10 user nova-compute[74669]:         <nova:user uuid="fb8d9223b6c148158b55f12592e2a800">tempest-VolumesActionsTest-137413693-project-member</nova:user>
Nov 08 16:51:10 user nova-compute[74669]:         <nova:project uuid="3efb4b77179e4bb293fb6c2c78f9c4b3">tempest-VolumesActionsTest-137413693</nova:project>
Nov 08 16:51:10 user nova-compute[74669]:       </nova:owner>
Nov 08 16:51:10 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:51:10 user nova-compute[74669]:       <nova:ports>
Nov 08 16:51:10 user nova-compute[74669]:         <nova:port uuid="85a996ca-5cd2-468a-a1b1-55f5c882a624">
Nov 08 16:51:10 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 16:51:10 user nova-compute[74669]:         </nova:port>
Nov 08 16:51:10 user nova-compute[74669]:       </nova:ports>
Nov 08 16:51:10 user nova-compute[74669]:     </nova:instance>
Nov 08 16:51:10 user nova-compute[74669]:   </metadata>
Nov 08 16:51:10 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:51:10 user nova-compute[74669]:     <system>
Nov 08 16:51:10 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:51:10 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:51:10 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:51:10 user nova-compute[74669]:       <entry name="serial">725977e4-d011-4c79-b8bc-39bed9649515</entry>
Nov 08 16:51:10 user nova-compute[74669]:       <entry name="uuid">725977e4-d011-4c79-b8bc-39bed9649515</entry>
Nov 08 16:51:10 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:51:10 user nova-compute[74669]:     </system>
Nov 08 16:51:10 user nova-compute[74669]:   </sysinfo>
Nov 08 16:51:10 user nova-compute[74669]:   <os>
Nov 08 16:51:10 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:51:10 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 16:51:10 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:51:10 user nova-compute[74669]:   </os>
Nov 08 16:51:10 user nova-compute[74669]:   <features>
Nov 08 16:51:10 user nova-compute[74669]:     <acpi/>
Nov 08 16:51:10 user nova-compute[74669]:     <apic/>
Nov 08 16:51:10 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:51:10 user nova-compute[74669]:   </features>
Nov 08 16:51:10 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:51:10 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:51:10 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:51:10 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:51:10 user nova-compute[74669]:   </clock>
Nov 08 16:51:10 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:51:10 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:51:10 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:51:10 user nova-compute[74669]:   </cpu>
Nov 08 16:51:10 user nova-compute[74669]:   <devices>
Nov 08 16:51:10 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:51:10 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:51:10 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/725977e4-d011-4c79-b8bc-39bed9649515/disk"/>
Nov 08 16:51:10 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:51:10 user nova-compute[74669]:     </disk>
Nov 08 16:51:10 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:51:10 user nova-compute[74669]:       <mac address="fa:16:3e:69:c3:30"/>
Nov 08 16:51:10 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:51:10 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:51:10 user nova-compute[74669]:       <target dev="tap85a996ca-5c"/>
Nov 08 16:51:10 user nova-compute[74669]:     </interface>
Nov 08 16:51:10 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:51:10 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/725977e4-d011-4c79-b8bc-39bed9649515/console.log" append="off"/>
Nov 08 16:51:10 user nova-compute[74669]:     </serial>
Nov 08 16:51:10 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:51:10 user nova-compute[74669]:     <video>
Nov 08 16:51:10 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:51:10 user nova-compute[74669]:     </video>
Nov 08 16:51:10 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:51:10 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:51:10 user nova-compute[74669]:     </rng>
Nov 08 16:51:10 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:51:10 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:51:10 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:51:10 user nova-compute[74669]:     </memballoon>
Nov 08 16:51:10 user nova-compute[74669]:   </devices>
Nov 08 16:51:10 user nova-compute[74669]: </domain>
Nov 08 16:51:10 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:51:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1781888160',display_name='tempest-VolumesActionsTest-instance-1781888160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1781888160',id=6,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3efb4b77179e4bb293fb6c2c78f9c4b3',ramdisk_id='',reservation_id='r-tcviqwz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-137413693',owner_user_name='tempest-VolumesActionsTest-137413693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:51:07Z,user_data=None,user_id='fb8d9223b6c148158b55f12592e2a800',uuid=725977e4-d011-4c79-b8bc-39bed9649515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85a996ca-5cd2-468a-a1b1-55f5c882a624", "address": "fa:16:3e:69:c3:30", "network": {"id": "47a98eee-3da5-4b15-891c-f11bee25b2ce", "bridge": "br-int", "label": "tempest-VolumesActionsTest-829228011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efb4b77179e4bb293fb6c2c78f9c4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a996ca-5c", "ovs_interfaceid": "85a996ca-5cd2-468a-a1b1-55f5c882a624", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Converting VIF {"id": "85a996ca-5cd2-468a-a1b1-55f5c882a624", "address": "fa:16:3e:69:c3:30", "network": {"id": "47a98eee-3da5-4b15-891c-f11bee25b2ce", "bridge": "br-int", "label": "tempest-VolumesActionsTest-829228011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efb4b77179e4bb293fb6c2c78f9c4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a996ca-5c", "ovs_interfaceid": "85a996ca-5cd2-468a-a1b1-55f5c882a624", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:c3:30,bridge_name='br-int',has_traffic_filtering=True,id=85a996ca-5cd2-468a-a1b1-55f5c882a624,network=Network(47a98eee-3da5-4b15-891c-f11bee25b2ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a996ca-5c') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG os_vif [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c3:30,bridge_name='br-int',has_traffic_filtering=True,id=85a996ca-5cd2-468a-a1b1-55f5c882a624,network=Network(47a98eee-3da5-4b15-891c-f11bee25b2ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a996ca-5c') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a383de5-d394-5db7-b1e3-13f4a9883f75', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85a996ca-5c, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85a996ca-5c, col_values=(('qos', UUID('e98dcd6c-4dd3-440c-93fc-72fee0cec66c')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85a996ca-5c, col_values=(('external_ids', {'iface-id': '85a996ca-5cd2-468a-a1b1-55f5c882a624', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:c3:30', 'vm-uuid': '725977e4-d011-4c79-b8bc-39bed9649515'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:10 user nova-compute[74669]: INFO os_vif [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c3:30,bridge_name='br-int',has_traffic_filtering=True,id=85a996ca-5cd2-468a-a1b1-55f5c882a624,network=Network(47a98eee-3da5-4b15-891c-f11bee25b2ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a996ca-5c')
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] No VIF found with MAC fa:16:3e:69:c3:30, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.compute.manager [req-6c6b0304-37b7-496c-b5c3-7c998041b0ad req-e669f3c0-7a37-429f-9ec2-e8b1f8747f93 service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received event network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6c6b0304-37b7-496c-b5c3-7c998041b0ad req-e669f3c0-7a37-429f-9ec2-e8b1f8747f93 service nova] Acquiring lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6c6b0304-37b7-496c-b5c3-7c998041b0ad req-e669f3c0-7a37-429f-9ec2-e8b1f8747f93 service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6c6b0304-37b7-496c-b5c3-7c998041b0ad req-e669f3c0-7a37-429f-9ec2-e8b1f8747f93 service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:10 user nova-compute[74669]: DEBUG nova.compute.manager [req-6c6b0304-37b7-496c-b5c3-7c998041b0ad req-e669f3c0-7a37-429f-9ec2-e8b1f8747f93 service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] No waiting events found dispatching network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:51:10 user nova-compute[74669]: WARNING nova.compute.manager [req-6c6b0304-37b7-496c-b5c3-7c998041b0ad req-e669f3c0-7a37-429f-9ec2-e8b1f8747f93 service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received unexpected event network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e for instance with vm_state active and task_state None.
Nov 08 16:51:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:12 user nova-compute[74669]: DEBUG nova.network.neutron [req-266e8e3b-2bdd-4c03-9cb8-43d62d31d842 req-b1f72144-ccd1-469c-8cb5-773f5fa7f3cd service nova] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Updated VIF entry in instance network info cache for port 85a996ca-5cd2-468a-a1b1-55f5c882a624. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:51:12 user nova-compute[74669]: DEBUG nova.network.neutron [req-266e8e3b-2bdd-4c03-9cb8-43d62d31d842 req-b1f72144-ccd1-469c-8cb5-773f5fa7f3cd service nova] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Updating instance_info_cache with network_info: [{"id": "85a996ca-5cd2-468a-a1b1-55f5c882a624", "address": "fa:16:3e:69:c3:30", "network": {"id": "47a98eee-3da5-4b15-891c-f11bee25b2ce", "bridge": "br-int", "label": "tempest-VolumesActionsTest-829228011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efb4b77179e4bb293fb6c2c78f9c4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a996ca-5c", "ovs_interfaceid": "85a996ca-5cd2-468a-a1b1-55f5c882a624", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:51:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-266e8e3b-2bdd-4c03-9cb8-43d62d31d842 req-b1f72144-ccd1-469c-8cb5-773f5fa7f3cd service nova] Releasing lock "refresh_cache-725977e4-d011-4c79-b8bc-39bed9649515" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:51:12 user nova-compute[74669]: DEBUG nova.compute.manager [req-69f32e9b-019f-448e-b100-88a7d07be25a req-a2ee01a0-1b98-4300-8e1f-72966bf73e77 service nova] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Received event network-vif-plugged-542b5f60-bd62-4bb3-a644-b7d92762bca0 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:51:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-69f32e9b-019f-448e-b100-88a7d07be25a req-a2ee01a0-1b98-4300-8e1f-72966bf73e77 service nova] Acquiring lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-69f32e9b-019f-448e-b100-88a7d07be25a req-a2ee01a0-1b98-4300-8e1f-72966bf73e77 service nova] Lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-69f32e9b-019f-448e-b100-88a7d07be25a req-a2ee01a0-1b98-4300-8e1f-72966bf73e77 service nova] Lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:12 user nova-compute[74669]: DEBUG nova.compute.manager [req-69f32e9b-019f-448e-b100-88a7d07be25a req-a2ee01a0-1b98-4300-8e1f-72966bf73e77 service nova] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] No waiting events found dispatching network-vif-plugged-542b5f60-bd62-4bb3-a644-b7d92762bca0 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:51:12 user nova-compute[74669]: WARNING nova.compute.manager [req-69f32e9b-019f-448e-b100-88a7d07be25a req-a2ee01a0-1b98-4300-8e1f-72966bf73e77 service nova] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Received unexpected event network-vif-plugged-542b5f60-bd62-4bb3-a644-b7d92762bca0 for instance with vm_state active and task_state None.
Nov 08 16:51:12 user nova-compute[74669]: DEBUG nova.compute.manager [req-69f32e9b-019f-448e-b100-88a7d07be25a req-a2ee01a0-1b98-4300-8e1f-72966bf73e77 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received event network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:51:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-69f32e9b-019f-448e-b100-88a7d07be25a req-a2ee01a0-1b98-4300-8e1f-72966bf73e77 service nova] Acquiring lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-69f32e9b-019f-448e-b100-88a7d07be25a req-a2ee01a0-1b98-4300-8e1f-72966bf73e77 service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-69f32e9b-019f-448e-b100-88a7d07be25a req-a2ee01a0-1b98-4300-8e1f-72966bf73e77 service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:12 user nova-compute[74669]: DEBUG nova.compute.manager [req-69f32e9b-019f-448e-b100-88a7d07be25a req-a2ee01a0-1b98-4300-8e1f-72966bf73e77 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] No waiting events found dispatching network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:51:12 user nova-compute[74669]: WARNING nova.compute.manager [req-69f32e9b-019f-448e-b100-88a7d07be25a req-a2ee01a0-1b98-4300-8e1f-72966bf73e77 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received unexpected event network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 for instance with vm_state active and task_state None.
Nov 08 16:51:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:13 user nova-compute[74669]: DEBUG nova.compute.manager [req-ff8a7167-d283-4869-9682-01f83fd9ebd6 req-6adef99b-3c99-4e15-8614-a2a8e1d8c2e0 service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received event network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:51:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff8a7167-d283-4869-9682-01f83fd9ebd6 req-6adef99b-3c99-4e15-8614-a2a8e1d8c2e0 service nova] Acquiring lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff8a7167-d283-4869-9682-01f83fd9ebd6 req-6adef99b-3c99-4e15-8614-a2a8e1d8c2e0 service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff8a7167-d283-4869-9682-01f83fd9ebd6 req-6adef99b-3c99-4e15-8614-a2a8e1d8c2e0 service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:13 user nova-compute[74669]: DEBUG nova.compute.manager [req-ff8a7167-d283-4869-9682-01f83fd9ebd6 req-6adef99b-3c99-4e15-8614-a2a8e1d8c2e0 service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] No waiting events found dispatching network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:51:13 user nova-compute[74669]: WARNING nova.compute.manager [req-ff8a7167-d283-4869-9682-01f83fd9ebd6 req-6adef99b-3c99-4e15-8614-a2a8e1d8c2e0 service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received unexpected event network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e for instance with vm_state active and task_state None.
Nov 08 16:51:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:14 user nova-compute[74669]: DEBUG nova.compute.manager [req-705951bc-6c27-4d73-8f5e-1b11abf261cf req-ed92b86c-84f5-4102-8c2f-039c473402c6 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received event network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:51:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-705951bc-6c27-4d73-8f5e-1b11abf261cf req-ed92b86c-84f5-4102-8c2f-039c473402c6 service nova] Acquiring lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-705951bc-6c27-4d73-8f5e-1b11abf261cf req-ed92b86c-84f5-4102-8c2f-039c473402c6 service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-705951bc-6c27-4d73-8f5e-1b11abf261cf req-ed92b86c-84f5-4102-8c2f-039c473402c6 service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:14 user nova-compute[74669]: DEBUG nova.compute.manager [req-705951bc-6c27-4d73-8f5e-1b11abf261cf req-ed92b86c-84f5-4102-8c2f-039c473402c6 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] No waiting events found dispatching network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:51:14 user nova-compute[74669]: WARNING nova.compute.manager [req-705951bc-6c27-4d73-8f5e-1b11abf261cf req-ed92b86c-84f5-4102-8c2f-039c473402c6 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received unexpected event network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 for instance with vm_state active and task_state None.
Nov 08 16:51:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:16 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 16:51:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 16:51:16 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Instance spawned successfully.
Nov 08 16:51:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 16:51:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:16 user nova-compute[74669]: INFO nova.compute.manager [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Took 9.59 seconds to spawn the instance on the hypervisor.
Nov 08 16:51:16 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:51:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:16 user nova-compute[74669]: INFO nova.compute.manager [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Took 11.05 seconds to build instance.
Nov 08 16:51:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a403021c-30f6-47f5-80c8-0037520dbe93 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Lock "725977e4-d011-4c79-b8bc-39bed9649515" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.339s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:19 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 16:51:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 16:51:19 user nova-compute[74669]: INFO nova.compute.claims [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Claim successful on node user
Nov 08 16:51:20 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:51:20 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.648s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:20 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 16:51:20 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 16:51:20 user nova-compute[74669]: DEBUG nova.network.neutron [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 16:51:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:20 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 16:51:20 user nova-compute[74669]: DEBUG nova.policy [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '420018de00394687bba8a1ca64ea51f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f55d1187334b6b9099a9fd647aa721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 16:51:20 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 16:51:20 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 16:51:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 16:51:20 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Creating image(s)
Nov 08 16:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "/opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "/opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.287s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.303s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk 1073741824" returned: 0 in 0.084s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.400s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:21 user nova-compute[74669]: DEBUG nova.network.neutron [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Successfully created port: 23885293-c9aa-41f9-a4b3-1d2fe6a5819e {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:51:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.307s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:21 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 16:51:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:22 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Cannot resize image /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 16:51:22 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 16:51:22 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Ensure instance console log exists: /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 16:51:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.network.neutron [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Successfully updated port: 23885293-c9aa-41f9-a4b3-1d2fe6a5819e {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "refresh_cache-2d42d5ce-db73-40e6-9b35-f662a3cf0091" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquired lock "refresh_cache-2d42d5ce-db73-40e6-9b35-f662a3cf0091" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.network.neutron [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.compute.manager [req-c61b6999-4abe-46a8-836c-08694185ba79 req-1769e22f-4cf6-4099-9152-db6690a2f248 service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Received event network-changed-23885293-c9aa-41f9-a4b3-1d2fe6a5819e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.compute.manager [req-c61b6999-4abe-46a8-836c-08694185ba79 req-1769e22f-4cf6-4099-9152-db6690a2f248 service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Refreshing instance network info cache due to event network-changed-23885293-c9aa-41f9-a4b3-1d2fe6a5819e. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c61b6999-4abe-46a8-836c-08694185ba79 req-1769e22f-4cf6-4099-9152-db6690a2f248 service nova] Acquiring lock "refresh_cache-2d42d5ce-db73-40e6-9b35-f662a3cf0091" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.network.neutron [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.network.neutron [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Updating instance_info_cache with network_info: [{"id": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "address": "fa:16:3e:53:bc:e0", "network": {"id": "387522d7-947f-4a57-b80b-cefb0257df3e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-177095636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6f55d1187334b6b9099a9fd647aa721", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23885293-c9", "ovs_interfaceid": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Releasing lock "refresh_cache-2d42d5ce-db73-40e6-9b35-f662a3cf0091" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Instance network_info: |[{"id": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "address": "fa:16:3e:53:bc:e0", "network": {"id": "387522d7-947f-4a57-b80b-cefb0257df3e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-177095636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6f55d1187334b6b9099a9fd647aa721", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23885293-c9", "ovs_interfaceid": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c61b6999-4abe-46a8-836c-08694185ba79 req-1769e22f-4cf6-4099-9152-db6690a2f248 service nova] Acquired lock "refresh_cache-2d42d5ce-db73-40e6-9b35-f662a3cf0091" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.network.neutron [req-c61b6999-4abe-46a8-836c-08694185ba79 req-1769e22f-4cf6-4099-9152-db6690a2f248 service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Refreshing network info cache for port 23885293-c9aa-41f9-a4b3-1d2fe6a5819e {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Start _get_guest_xml network_info=[{"id": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "address": "fa:16:3e:53:bc:e0", "network": {"id": "387522d7-947f-4a57-b80b-cefb0257df3e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-177095636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6f55d1187334b6b9099a9fd647aa721", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23885293-c9", "ovs_interfaceid": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:51:23 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:51:23 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:51:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-57229404',display_name='tempest-VolumesAdminNegativeTest-server-57229404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-57229404',id=7,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3YJ5XuS1oUI5EPebNprylxsR9cbC3Q6iKMmc2IZ/6rbdt4c08IqjeUv+zoFgHpOhiltXfKjCmH2W9xYkvpnx+EAI8SEMuzsEXdl8lkDTY80GuG2JB4GHJBIFItq78LJg==',key_name='tempest-keypair-491670234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6f55d1187334b6b9099a9fd647aa721',ramdisk_id='',reservation_id='r-c8e7k00d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1861077985',owner_user_name='tempest-VolumesAdminNegativeTest-1861077985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:51:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='420018de00394687bba8a1ca64ea51f3',uuid=2d42d5ce-db73-40e6-9b35-f662a3cf0091,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "address": "fa:16:3e:53:bc:e0", "network": {"id": "387522d7-947f-4a57-b80b-cefb0257df3e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-177095636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6f55d1187334b6b9099a9fd647aa721", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23885293-c9", "ovs_interfaceid": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Converting VIF {"id": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "address": "fa:16:3e:53:bc:e0", "network": {"id": "387522d7-947f-4a57-b80b-cefb0257df3e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-177095636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6f55d1187334b6b9099a9fd647aa721", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23885293-c9", "ovs_interfaceid": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:bc:e0,bridge_name='br-int',has_traffic_filtering=True,id=23885293-c9aa-41f9-a4b3-1d2fe6a5819e,network=Network(387522d7-947f-4a57-b80b-cefb0257df3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23885293-c9') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.objects.instance [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d42d5ce-db73-40e6-9b35-f662a3cf0091 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:51:23 user nova-compute[74669]:   <uuid>2d42d5ce-db73-40e6-9b35-f662a3cf0091</uuid>
Nov 08 16:51:23 user nova-compute[74669]:   <name>instance-00000007</name>
Nov 08 16:51:23 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:51:23 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:51:23 user nova-compute[74669]:   <metadata>
Nov 08 16:51:23 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:51:23 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:51:23 user nova-compute[74669]:       <nova:name>tempest-VolumesAdminNegativeTest-server-57229404</nova:name>
Nov 08 16:51:23 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:51:23</nova:creationTime>
Nov 08 16:51:23 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:51:23 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:51:23 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:51:23 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:51:23 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:51:23 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:51:23 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:51:23 user nova-compute[74669]:       <nova:owner>
Nov 08 16:51:23 user nova-compute[74669]:         <nova:user uuid="420018de00394687bba8a1ca64ea51f3">tempest-VolumesAdminNegativeTest-1861077985-project-member</nova:user>
Nov 08 16:51:23 user nova-compute[74669]:         <nova:project uuid="a6f55d1187334b6b9099a9fd647aa721">tempest-VolumesAdminNegativeTest-1861077985</nova:project>
Nov 08 16:51:23 user nova-compute[74669]:       </nova:owner>
Nov 08 16:51:23 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:51:23 user nova-compute[74669]:       <nova:ports>
Nov 08 16:51:23 user nova-compute[74669]:         <nova:port uuid="23885293-c9aa-41f9-a4b3-1d2fe6a5819e">
Nov 08 16:51:23 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 16:51:23 user nova-compute[74669]:         </nova:port>
Nov 08 16:51:23 user nova-compute[74669]:       </nova:ports>
Nov 08 16:51:23 user nova-compute[74669]:     </nova:instance>
Nov 08 16:51:23 user nova-compute[74669]:   </metadata>
Nov 08 16:51:23 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:51:23 user nova-compute[74669]:     <system>
Nov 08 16:51:23 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:51:23 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:51:23 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:51:23 user nova-compute[74669]:       <entry name="serial">2d42d5ce-db73-40e6-9b35-f662a3cf0091</entry>
Nov 08 16:51:23 user nova-compute[74669]:       <entry name="uuid">2d42d5ce-db73-40e6-9b35-f662a3cf0091</entry>
Nov 08 16:51:23 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:51:23 user nova-compute[74669]:     </system>
Nov 08 16:51:23 user nova-compute[74669]:   </sysinfo>
Nov 08 16:51:23 user nova-compute[74669]:   <os>
Nov 08 16:51:23 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:51:23 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 16:51:23 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:51:23 user nova-compute[74669]:   </os>
Nov 08 16:51:23 user nova-compute[74669]:   <features>
Nov 08 16:51:23 user nova-compute[74669]:     <acpi/>
Nov 08 16:51:23 user nova-compute[74669]:     <apic/>
Nov 08 16:51:23 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:51:23 user nova-compute[74669]:   </features>
Nov 08 16:51:23 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:51:23 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:51:23 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:51:23 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:51:23 user nova-compute[74669]:   </clock>
Nov 08 16:51:23 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:51:23 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:51:23 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:51:23 user nova-compute[74669]:   </cpu>
Nov 08 16:51:23 user nova-compute[74669]:   <devices>
Nov 08 16:51:23 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:51:23 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:51:23 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk"/>
Nov 08 16:51:23 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:51:23 user nova-compute[74669]:     </disk>
Nov 08 16:51:23 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:51:23 user nova-compute[74669]:       <mac address="fa:16:3e:53:bc:e0"/>
Nov 08 16:51:23 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:51:23 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:51:23 user nova-compute[74669]:       <target dev="tap23885293-c9"/>
Nov 08 16:51:23 user nova-compute[74669]:     </interface>
Nov 08 16:51:23 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:51:23 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/console.log" append="off"/>
Nov 08 16:51:23 user nova-compute[74669]:     </serial>
Nov 08 16:51:23 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:51:23 user nova-compute[74669]:     <video>
Nov 08 16:51:23 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:51:23 user nova-compute[74669]:     </video>
Nov 08 16:51:23 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:51:23 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:51:23 user nova-compute[74669]:     </rng>
Nov 08 16:51:23 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:51:23 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:51:23 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:51:23 user nova-compute[74669]:     </memballoon>
Nov 08 16:51:23 user nova-compute[74669]:   </devices>
Nov 08 16:51:23 user nova-compute[74669]: </domain>
Nov 08 16:51:23 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:51:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-57229404',display_name='tempest-VolumesAdminNegativeTest-server-57229404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-57229404',id=7,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3YJ5XuS1oUI5EPebNprylxsR9cbC3Q6iKMmc2IZ/6rbdt4c08IqjeUv+zoFgHpOhiltXfKjCmH2W9xYkvpnx+EAI8SEMuzsEXdl8lkDTY80GuG2JB4GHJBIFItq78LJg==',key_name='tempest-keypair-491670234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6f55d1187334b6b9099a9fd647aa721',ramdisk_id='',reservation_id='r-c8e7k00d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1861077985',owner_user_name='tempest-VolumesAdminNegativeTest-1861077985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:51:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='420018de00394687bba8a1ca64ea51f3',uuid=2d42d5ce-db73-40e6-9b35-f662a3cf0091,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "address": "fa:16:3e:53:bc:e0", "network": {"id": "387522d7-947f-4a57-b80b-cefb0257df3e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-177095636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6f55d1187334b6b9099a9fd647aa721", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23885293-c9", "ovs_interfaceid": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Converting VIF {"id": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "address": "fa:16:3e:53:bc:e0", "network": {"id": "387522d7-947f-4a57-b80b-cefb0257df3e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-177095636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6f55d1187334b6b9099a9fd647aa721", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23885293-c9", "ovs_interfaceid": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:bc:e0,bridge_name='br-int',has_traffic_filtering=True,id=23885293-c9aa-41f9-a4b3-1d2fe6a5819e,network=Network(387522d7-947f-4a57-b80b-cefb0257df3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23885293-c9') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG os_vif [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:bc:e0,bridge_name='br-int',has_traffic_filtering=True,id=23885293-c9aa-41f9-a4b3-1d2fe6a5819e,network=Network(387522d7-947f-4a57-b80b-cefb0257df3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23885293-c9') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0491a579-daaa-5186-8862-f7bad9bbfa81', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23885293-c9, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23885293-c9, col_values=(('qos', UUID('5c6e9478-faf0-4f72-9f3c-3eccd294c183')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23885293-c9, col_values=(('external_ids', {'iface-id': '23885293-c9aa-41f9-a4b3-1d2fe6a5819e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:bc:e0', 'vm-uuid': '2d42d5ce-db73-40e6-9b35-f662a3cf0091'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:51:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:23 user nova-compute[74669]: INFO os_vif [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:bc:e0,bridge_name='br-int',has_traffic_filtering=True,id=23885293-c9aa-41f9-a4b3-1d2fe6a5819e,network=Network(387522d7-947f-4a57-b80b-cefb0257df3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23885293-c9')
Nov 08 16:51:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:51:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] No VIF found with MAC fa:16:3e:53:bc:e0, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:51:24 user nova-compute[74669]: DEBUG nova.network.neutron [req-c61b6999-4abe-46a8-836c-08694185ba79 req-1769e22f-4cf6-4099-9152-db6690a2f248 service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Updated VIF entry in instance network info cache for port 23885293-c9aa-41f9-a4b3-1d2fe6a5819e. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:51:24 user nova-compute[74669]: DEBUG nova.network.neutron [req-c61b6999-4abe-46a8-836c-08694185ba79 req-1769e22f-4cf6-4099-9152-db6690a2f248 service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Updating instance_info_cache with network_info: [{"id": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "address": "fa:16:3e:53:bc:e0", "network": {"id": "387522d7-947f-4a57-b80b-cefb0257df3e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-177095636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6f55d1187334b6b9099a9fd647aa721", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23885293-c9", "ovs_interfaceid": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:51:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c61b6999-4abe-46a8-836c-08694185ba79 req-1769e22f-4cf6-4099-9152-db6690a2f248 service nova] Releasing lock "refresh_cache-2d42d5ce-db73-40e6-9b35-f662a3cf0091" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:51:25 user nova-compute[74669]: DEBUG nova.compute.manager [req-c9642911-fb90-4fe2-9f4f-f863b6607101 req-b53b887f-5634-4286-b501-d718def00f3b service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Received event network-vif-plugged-525ba5da-155c-4f87-9fae-8db52836f73e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:51:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c9642911-fb90-4fe2-9f4f-f863b6607101 req-b53b887f-5634-4286-b501-d718def00f3b service nova] Acquiring lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c9642911-fb90-4fe2-9f4f-f863b6607101 req-b53b887f-5634-4286-b501-d718def00f3b service nova] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c9642911-fb90-4fe2-9f4f-f863b6607101 req-b53b887f-5634-4286-b501-d718def00f3b service nova] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:25 user nova-compute[74669]: DEBUG nova.compute.manager [req-c9642911-fb90-4fe2-9f4f-f863b6607101 req-b53b887f-5634-4286-b501-d718def00f3b service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] No waiting events found dispatching network-vif-plugged-525ba5da-155c-4f87-9fae-8db52836f73e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:51:25 user nova-compute[74669]: WARNING nova.compute.manager [req-c9642911-fb90-4fe2-9f4f-f863b6607101 req-b53b887f-5634-4286-b501-d718def00f3b service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Received unexpected event network-vif-plugged-525ba5da-155c-4f87-9fae-8db52836f73e for instance with vm_state active and task_state None.
Nov 08 16:51:25 user nova-compute[74669]: DEBUG nova.compute.manager [req-c9642911-fb90-4fe2-9f4f-f863b6607101 req-b53b887f-5634-4286-b501-d718def00f3b service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Received event network-vif-plugged-525ba5da-155c-4f87-9fae-8db52836f73e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:51:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c9642911-fb90-4fe2-9f4f-f863b6607101 req-b53b887f-5634-4286-b501-d718def00f3b service nova] Acquiring lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c9642911-fb90-4fe2-9f4f-f863b6607101 req-b53b887f-5634-4286-b501-d718def00f3b service nova] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c9642911-fb90-4fe2-9f4f-f863b6607101 req-b53b887f-5634-4286-b501-d718def00f3b service nova] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:25 user nova-compute[74669]: DEBUG nova.compute.manager [req-c9642911-fb90-4fe2-9f4f-f863b6607101 req-b53b887f-5634-4286-b501-d718def00f3b service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] No waiting events found dispatching network-vif-plugged-525ba5da-155c-4f87-9fae-8db52836f73e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:51:25 user nova-compute[74669]: WARNING nova.compute.manager [req-c9642911-fb90-4fe2-9f4f-f863b6607101 req-b53b887f-5634-4286-b501-d718def00f3b service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Received unexpected event network-vif-plugged-525ba5da-155c-4f87-9fae-8db52836f73e for instance with vm_state active and task_state None.
Nov 08 16:51:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-949871d2-3c37-4552-a09b-1a893923aae9 req-a7a2e7ad-e76c-4b34-ac12-93e9ad5b46b0 service nova] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Received event network-vif-plugged-85a996ca-5cd2-468a-a1b1-55f5c882a624 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:51:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-949871d2-3c37-4552-a09b-1a893923aae9 req-a7a2e7ad-e76c-4b34-ac12-93e9ad5b46b0 service nova] Acquiring lock "725977e4-d011-4c79-b8bc-39bed9649515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-949871d2-3c37-4552-a09b-1a893923aae9 req-a7a2e7ad-e76c-4b34-ac12-93e9ad5b46b0 service nova] Lock "725977e4-d011-4c79-b8bc-39bed9649515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-949871d2-3c37-4552-a09b-1a893923aae9 req-a7a2e7ad-e76c-4b34-ac12-93e9ad5b46b0 service nova] Lock "725977e4-d011-4c79-b8bc-39bed9649515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-949871d2-3c37-4552-a09b-1a893923aae9 req-a7a2e7ad-e76c-4b34-ac12-93e9ad5b46b0 service nova] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] No waiting events found dispatching network-vif-plugged-85a996ca-5cd2-468a-a1b1-55f5c882a624 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:51:27 user nova-compute[74669]: WARNING nova.compute.manager [req-949871d2-3c37-4552-a09b-1a893923aae9 req-a7a2e7ad-e76c-4b34-ac12-93e9ad5b46b0 service nova] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Received unexpected event network-vif-plugged-85a996ca-5cd2-468a-a1b1-55f5c882a624 for instance with vm_state active and task_state None.
Nov 08 16:51:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-949871d2-3c37-4552-a09b-1a893923aae9 req-a7a2e7ad-e76c-4b34-ac12-93e9ad5b46b0 service nova] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Received event network-vif-plugged-85a996ca-5cd2-468a-a1b1-55f5c882a624 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:51:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-949871d2-3c37-4552-a09b-1a893923aae9 req-a7a2e7ad-e76c-4b34-ac12-93e9ad5b46b0 service nova] Acquiring lock "725977e4-d011-4c79-b8bc-39bed9649515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-949871d2-3c37-4552-a09b-1a893923aae9 req-a7a2e7ad-e76c-4b34-ac12-93e9ad5b46b0 service nova] Lock "725977e4-d011-4c79-b8bc-39bed9649515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-949871d2-3c37-4552-a09b-1a893923aae9 req-a7a2e7ad-e76c-4b34-ac12-93e9ad5b46b0 service nova] Lock "725977e4-d011-4c79-b8bc-39bed9649515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-949871d2-3c37-4552-a09b-1a893923aae9 req-a7a2e7ad-e76c-4b34-ac12-93e9ad5b46b0 service nova] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] No waiting events found dispatching network-vif-plugged-85a996ca-5cd2-468a-a1b1-55f5c882a624 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:51:27 user nova-compute[74669]: WARNING nova.compute.manager [req-949871d2-3c37-4552-a09b-1a893923aae9 req-a7a2e7ad-e76c-4b34-ac12-93e9ad5b46b0 service nova] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Received unexpected event network-vif-plugged-85a996ca-5cd2-468a-a1b1-55f5c882a624 for instance with vm_state active and task_state None.
Nov 08 16:51:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:28 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 16:51:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 16:51:28 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Instance spawned successfully.
Nov 08 16:51:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 16:51:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:28 user nova-compute[74669]: INFO nova.compute.manager [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Took 7.91 seconds to spawn the instance on the hypervisor.
Nov 08 16:51:28 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:51:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:28 user nova-compute[74669]: INFO nova.compute.manager [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Took 9.29 seconds to build instance.
Nov 08 16:51:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b733a8b-3f0f-40fc-99bc-c00885f023e2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.499s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Acquiring lock "af94bfaa-45bc-4bac-9594-f363fce8727e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Lock "af94bfaa-45bc-4bac-9594-f363fce8727e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:29 user nova-compute[74669]: DEBUG nova.compute.manager [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 16:51:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:29 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 16:51:29 user nova-compute[74669]: INFO nova.compute.claims [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Claim successful on node user
Nov 08 16:51:30 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:51:30 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:51:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:30 user nova-compute[74669]: DEBUG nova.compute.manager [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 16:51:30 user nova-compute[74669]: DEBUG nova.compute.manager [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 16:51:30 user nova-compute[74669]: DEBUG nova.network.neutron [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 16:51:30 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 16:51:30 user nova-compute[74669]: DEBUG nova.compute.manager [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 16:51:30 user nova-compute[74669]: DEBUG nova.policy [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b33fb251aa84d589b91f762cb3fbe62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48aa79104ae4b668b0b73c6b3e2b18c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 16:51:30 user nova-compute[74669]: DEBUG nova.compute.manager [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 16:51:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 16:51:30 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Creating image(s)
Nov 08 16:51:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Acquiring lock "/opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Lock "/opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Lock "/opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.236s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG nova.compute.manager [req-9e8c1750-e28f-4cf1-b673-aa26029e6fe5 req-5e6df618-88e8-43fb-9313-a22f535fd58d service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Received event network-vif-plugged-23885293-c9aa-41f9-a4b3-1d2fe6a5819e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9e8c1750-e28f-4cf1-b673-aa26029e6fe5 req-5e6df618-88e8-43fb-9313-a22f535fd58d service nova] Acquiring lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9e8c1750-e28f-4cf1-b673-aa26029e6fe5 req-5e6df618-88e8-43fb-9313-a22f535fd58d service nova] Lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9e8c1750-e28f-4cf1-b673-aa26029e6fe5 req-5e6df618-88e8-43fb-9313-a22f535fd58d service nova] Lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG nova.compute.manager [req-9e8c1750-e28f-4cf1-b673-aa26029e6fe5 req-5e6df618-88e8-43fb-9313-a22f535fd58d service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] No waiting events found dispatching network-vif-plugged-23885293-c9aa-41f9-a4b3-1d2fe6a5819e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:51:31 user nova-compute[74669]: WARNING nova.compute.manager [req-9e8c1750-e28f-4cf1-b673-aa26029e6fe5 req-5e6df618-88e8-43fb-9313-a22f535fd58d service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Received unexpected event network-vif-plugged-23885293-c9aa-41f9-a4b3-1d2fe6a5819e for instance with vm_state active and task_state None.
Nov 08 16:51:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.182s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk 1073741824" returned: 0 in 0.062s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.224s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Cannot resize image /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Ensure instance console log exists: /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:31 user nova-compute[74669]: DEBUG nova.network.neutron [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Successfully created port: 1b0ec571-edb1-4c11-bbeb-24123bd96f09 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:51:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:32 user nova-compute[74669]: DEBUG nova.network.neutron [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Successfully updated port: 1b0ec571-edb1-4c11-bbeb-24123bd96f09 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:51:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Acquiring lock "refresh_cache-af94bfaa-45bc-4bac-9594-f363fce8727e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:51:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Acquired lock "refresh_cache-af94bfaa-45bc-4bac-9594-f363fce8727e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:51:32 user nova-compute[74669]: DEBUG nova.network.neutron [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:51:32 user nova-compute[74669]: DEBUG nova.compute.manager [req-4b226cad-5309-4f27-9218-0abd9cf9433b req-f669ee3c-d55e-4c4e-82ec-f5cad65534be service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Received event network-changed-1b0ec571-edb1-4c11-bbeb-24123bd96f09 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:51:32 user nova-compute[74669]: DEBUG nova.compute.manager [req-4b226cad-5309-4f27-9218-0abd9cf9433b req-f669ee3c-d55e-4c4e-82ec-f5cad65534be service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Refreshing instance network info cache due to event network-changed-1b0ec571-edb1-4c11-bbeb-24123bd96f09. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:51:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4b226cad-5309-4f27-9218-0abd9cf9433b req-f669ee3c-d55e-4c4e-82ec-f5cad65534be service nova] Acquiring lock "refresh_cache-af94bfaa-45bc-4bac-9594-f363fce8727e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:51:32 user nova-compute[74669]: DEBUG nova.network.neutron [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.network.neutron [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Updating instance_info_cache with network_info: [{"id": "1b0ec571-edb1-4c11-bbeb-24123bd96f09", "address": "fa:16:3e:2c:9a:3e", "network": {"id": "d4ab50d4-89ec-4706-b8bc-2fd83ae1d0df", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2136930753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48aa79104ae4b668b0b73c6b3e2b18c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0ec571-ed", "ovs_interfaceid": "1b0ec571-edb1-4c11-bbeb-24123bd96f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.compute.manager [req-4fe2ce1e-9f33-4fb8-b47d-7a3c63399017 req-969fed9f-3253-4ef8-9716-701f914d8d91 service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Received event network-vif-plugged-23885293-c9aa-41f9-a4b3-1d2fe6a5819e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4fe2ce1e-9f33-4fb8-b47d-7a3c63399017 req-969fed9f-3253-4ef8-9716-701f914d8d91 service nova] Acquiring lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4fe2ce1e-9f33-4fb8-b47d-7a3c63399017 req-969fed9f-3253-4ef8-9716-701f914d8d91 service nova] Lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4fe2ce1e-9f33-4fb8-b47d-7a3c63399017 req-969fed9f-3253-4ef8-9716-701f914d8d91 service nova] Lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.compute.manager [req-4fe2ce1e-9f33-4fb8-b47d-7a3c63399017 req-969fed9f-3253-4ef8-9716-701f914d8d91 service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] No waiting events found dispatching network-vif-plugged-23885293-c9aa-41f9-a4b3-1d2fe6a5819e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:51:33 user nova-compute[74669]: WARNING nova.compute.manager [req-4fe2ce1e-9f33-4fb8-b47d-7a3c63399017 req-969fed9f-3253-4ef8-9716-701f914d8d91 service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Received unexpected event network-vif-plugged-23885293-c9aa-41f9-a4b3-1d2fe6a5819e for instance with vm_state active and task_state None.
Nov 08 16:51:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Releasing lock "refresh_cache-af94bfaa-45bc-4bac-9594-f363fce8727e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.compute.manager [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Instance network_info: |[{"id": "1b0ec571-edb1-4c11-bbeb-24123bd96f09", "address": "fa:16:3e:2c:9a:3e", "network": {"id": "d4ab50d4-89ec-4706-b8bc-2fd83ae1d0df", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2136930753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48aa79104ae4b668b0b73c6b3e2b18c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0ec571-ed", "ovs_interfaceid": "1b0ec571-edb1-4c11-bbeb-24123bd96f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4b226cad-5309-4f27-9218-0abd9cf9433b req-f669ee3c-d55e-4c4e-82ec-f5cad65534be service nova] Acquired lock "refresh_cache-af94bfaa-45bc-4bac-9594-f363fce8727e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.network.neutron [req-4b226cad-5309-4f27-9218-0abd9cf9433b req-f669ee3c-d55e-4c4e-82ec-f5cad65534be service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Refreshing network info cache for port 1b0ec571-edb1-4c11-bbeb-24123bd96f09 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Start _get_guest_xml network_info=[{"id": "1b0ec571-edb1-4c11-bbeb-24123bd96f09", "address": "fa:16:3e:2c:9a:3e", "network": {"id": "d4ab50d4-89ec-4706-b8bc-2fd83ae1d0df", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2136930753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48aa79104ae4b668b0b73c6b3e2b18c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0ec571-ed", "ovs_interfaceid": "1b0ec571-edb1-4c11-bbeb-24123bd96f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:51:33 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:51:33 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:51:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1775156653',display_name='tempest-VolumesAssistedSnapshotsTest-server-1775156653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1775156653',id=8,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmSbruixunUh0wgAmxAi2Vzmxnz0NTwsHdOv+/2oPjHP2AN9io1uFHxfWV+VvGwYLJNurPO0k7aXhG4sxIqnU0XVFtAPwc9yY10A4kwxsd8x1UPiBFQxW758gaHileDqg==',key_name='tempest-keypair-477436463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b48aa79104ae4b668b0b73c6b3e2b18c',ramdisk_id='',reservation_id='r-xeg0euij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-733888851',owner_user_name='tempest-VolumesAssistedSnapshotsTest-733888851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:51:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b33fb251aa84d589b91f762cb3fbe62',uuid=af94bfaa-45bc-4bac-9594-f363fce8727e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b0ec571-edb1-4c11-bbeb-24123bd96f09", "address": "fa:16:3e:2c:9a:3e", "network": {"id": "d4ab50d4-89ec-4706-b8bc-2fd83ae1d0df", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2136930753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48aa79104ae4b668b0b73c6b3e2b18c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0ec571-ed", "ovs_interfaceid": "1b0ec571-edb1-4c11-bbeb-24123bd96f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Converting VIF {"id": "1b0ec571-edb1-4c11-bbeb-24123bd96f09", "address": "fa:16:3e:2c:9a:3e", "network": {"id": "d4ab50d4-89ec-4706-b8bc-2fd83ae1d0df", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2136930753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48aa79104ae4b668b0b73c6b3e2b18c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0ec571-ed", "ovs_interfaceid": "1b0ec571-edb1-4c11-bbeb-24123bd96f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:9a:3e,bridge_name='br-int',has_traffic_filtering=True,id=1b0ec571-edb1-4c11-bbeb-24123bd96f09,network=Network(d4ab50d4-89ec-4706-b8bc-2fd83ae1d0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0ec571-ed') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.objects.instance [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Lazy-loading 'pci_devices' on Instance uuid af94bfaa-45bc-4bac-9594-f363fce8727e {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:51:33 user nova-compute[74669]:   <uuid>af94bfaa-45bc-4bac-9594-f363fce8727e</uuid>
Nov 08 16:51:33 user nova-compute[74669]:   <name>instance-00000008</name>
Nov 08 16:51:33 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:51:33 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:51:33 user nova-compute[74669]:   <metadata>
Nov 08 16:51:33 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:51:33 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:51:33 user nova-compute[74669]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1775156653</nova:name>
Nov 08 16:51:33 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:51:33</nova:creationTime>
Nov 08 16:51:33 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:51:33 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:51:33 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:51:33 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:51:33 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:51:33 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:51:33 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:51:33 user nova-compute[74669]:       <nova:owner>
Nov 08 16:51:33 user nova-compute[74669]:         <nova:user uuid="2b33fb251aa84d589b91f762cb3fbe62">tempest-VolumesAssistedSnapshotsTest-733888851-project-member</nova:user>
Nov 08 16:51:33 user nova-compute[74669]:         <nova:project uuid="b48aa79104ae4b668b0b73c6b3e2b18c">tempest-VolumesAssistedSnapshotsTest-733888851</nova:project>
Nov 08 16:51:33 user nova-compute[74669]:       </nova:owner>
Nov 08 16:51:33 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:51:33 user nova-compute[74669]:       <nova:ports>
Nov 08 16:51:33 user nova-compute[74669]:         <nova:port uuid="1b0ec571-edb1-4c11-bbeb-24123bd96f09">
Nov 08 16:51:33 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 16:51:33 user nova-compute[74669]:         </nova:port>
Nov 08 16:51:33 user nova-compute[74669]:       </nova:ports>
Nov 08 16:51:33 user nova-compute[74669]:     </nova:instance>
Nov 08 16:51:33 user nova-compute[74669]:   </metadata>
Nov 08 16:51:33 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:51:33 user nova-compute[74669]:     <system>
Nov 08 16:51:33 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:51:33 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:51:33 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:51:33 user nova-compute[74669]:       <entry name="serial">af94bfaa-45bc-4bac-9594-f363fce8727e</entry>
Nov 08 16:51:33 user nova-compute[74669]:       <entry name="uuid">af94bfaa-45bc-4bac-9594-f363fce8727e</entry>
Nov 08 16:51:33 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:51:33 user nova-compute[74669]:     </system>
Nov 08 16:51:33 user nova-compute[74669]:   </sysinfo>
Nov 08 16:51:33 user nova-compute[74669]:   <os>
Nov 08 16:51:33 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:51:33 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 16:51:33 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:51:33 user nova-compute[74669]:   </os>
Nov 08 16:51:33 user nova-compute[74669]:   <features>
Nov 08 16:51:33 user nova-compute[74669]:     <acpi/>
Nov 08 16:51:33 user nova-compute[74669]:     <apic/>
Nov 08 16:51:33 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:51:33 user nova-compute[74669]:   </features>
Nov 08 16:51:33 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:51:33 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:51:33 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:51:33 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:51:33 user nova-compute[74669]:   </clock>
Nov 08 16:51:33 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:51:33 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:51:33 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:51:33 user nova-compute[74669]:   </cpu>
Nov 08 16:51:33 user nova-compute[74669]:   <devices>
Nov 08 16:51:33 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:51:33 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:51:33 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk"/>
Nov 08 16:51:33 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:51:33 user nova-compute[74669]:     </disk>
Nov 08 16:51:33 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:51:33 user nova-compute[74669]:       <mac address="fa:16:3e:2c:9a:3e"/>
Nov 08 16:51:33 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:51:33 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:51:33 user nova-compute[74669]:       <target dev="tap1b0ec571-ed"/>
Nov 08 16:51:33 user nova-compute[74669]:     </interface>
Nov 08 16:51:33 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:51:33 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/console.log" append="off"/>
Nov 08 16:51:33 user nova-compute[74669]:     </serial>
Nov 08 16:51:33 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:51:33 user nova-compute[74669]:     <video>
Nov 08 16:51:33 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:51:33 user nova-compute[74669]:     </video>
Nov 08 16:51:33 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:51:33 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:51:33 user nova-compute[74669]:     </rng>
Nov 08 16:51:33 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:51:33 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:51:33 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:51:33 user nova-compute[74669]:     </memballoon>
Nov 08 16:51:33 user nova-compute[74669]:   </devices>
Nov 08 16:51:33 user nova-compute[74669]: </domain>
Nov 08 16:51:33 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:51:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1775156653',display_name='tempest-VolumesAssistedSnapshotsTest-server-1775156653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1775156653',id=8,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmSbruixunUh0wgAmxAi2Vzmxnz0NTwsHdOv+/2oPjHP2AN9io1uFHxfWV+VvGwYLJNurPO0k7aXhG4sxIqnU0XVFtAPwc9yY10A4kwxsd8x1UPiBFQxW758gaHileDqg==',key_name='tempest-keypair-477436463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b48aa79104ae4b668b0b73c6b3e2b18c',ramdisk_id='',reservation_id='r-xeg0euij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-733888851',owner_user_name='tempest-VolumesAssistedSnapshotsTest-733888851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:51:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b33fb251aa84d589b91f762cb3fbe62',uuid=af94bfaa-45bc-4bac-9594-f363fce8727e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b0ec571-edb1-4c11-bbeb-24123bd96f09", "address": "fa:16:3e:2c:9a:3e", "network": {"id": "d4ab50d4-89ec-4706-b8bc-2fd83ae1d0df", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2136930753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48aa79104ae4b668b0b73c6b3e2b18c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0ec571-ed", "ovs_interfaceid": "1b0ec571-edb1-4c11-bbeb-24123bd96f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Converting VIF {"id": "1b0ec571-edb1-4c11-bbeb-24123bd96f09", "address": "fa:16:3e:2c:9a:3e", "network": {"id": "d4ab50d4-89ec-4706-b8bc-2fd83ae1d0df", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2136930753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48aa79104ae4b668b0b73c6b3e2b18c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0ec571-ed", "ovs_interfaceid": "1b0ec571-edb1-4c11-bbeb-24123bd96f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:9a:3e,bridge_name='br-int',has_traffic_filtering=True,id=1b0ec571-edb1-4c11-bbeb-24123bd96f09,network=Network(d4ab50d4-89ec-4706-b8bc-2fd83ae1d0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0ec571-ed') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG os_vif [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:9a:3e,bridge_name='br-int',has_traffic_filtering=True,id=1b0ec571-edb1-4c11-bbeb-24123bd96f09,network=Network(d4ab50d4-89ec-4706-b8bc-2fd83ae1d0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0ec571-ed') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a76fe52-a101-5e7b-a7de-7a2b87bd68df', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b0ec571-ed, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b0ec571-ed, col_values=(('qos', UUID('440ce77b-554b-4d1c-8774-720087f7bf14')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b0ec571-ed, col_values=(('external_ids', {'iface-id': '1b0ec571-edb1-4c11-bbeb-24123bd96f09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:9a:3e', 'vm-uuid': 'af94bfaa-45bc-4bac-9594-f363fce8727e'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:33 user nova-compute[74669]: INFO os_vif [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:9a:3e,bridge_name='br-int',has_traffic_filtering=True,id=1b0ec571-edb1-4c11-bbeb-24123bd96f09,network=Network(d4ab50d4-89ec-4706-b8bc-2fd83ae1d0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0ec571-ed')
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] No VIF found with MAC fa:16:3e:2c:9a:3e, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.network.neutron [req-4b226cad-5309-4f27-9218-0abd9cf9433b req-f669ee3c-d55e-4c4e-82ec-f5cad65534be service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Updated VIF entry in instance network info cache for port 1b0ec571-edb1-4c11-bbeb-24123bd96f09. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG nova.network.neutron [req-4b226cad-5309-4f27-9218-0abd9cf9433b req-f669ee3c-d55e-4c4e-82ec-f5cad65534be service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Updating instance_info_cache with network_info: [{"id": "1b0ec571-edb1-4c11-bbeb-24123bd96f09", "address": "fa:16:3e:2c:9a:3e", "network": {"id": "d4ab50d4-89ec-4706-b8bc-2fd83ae1d0df", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2136930753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48aa79104ae4b668b0b73c6b3e2b18c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0ec571-ed", "ovs_interfaceid": "1b0ec571-edb1-4c11-bbeb-24123bd96f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:51:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4b226cad-5309-4f27-9218-0abd9cf9433b req-f669ee3c-d55e-4c4e-82ec-f5cad65534be service nova] Releasing lock "refresh_cache-af94bfaa-45bc-4bac-9594-f363fce8727e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:51:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:35 user nova-compute[74669]: DEBUG nova.compute.manager [req-69a5a7bf-98fd-465a-b4e5-5aa2981ccf0b req-5c287aa2-cb96-44b3-8a79-b63f6d68e654 service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Received event network-vif-plugged-1b0ec571-edb1-4c11-bbeb-24123bd96f09 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:51:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-69a5a7bf-98fd-465a-b4e5-5aa2981ccf0b req-5c287aa2-cb96-44b3-8a79-b63f6d68e654 service nova] Acquiring lock "af94bfaa-45bc-4bac-9594-f363fce8727e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-69a5a7bf-98fd-465a-b4e5-5aa2981ccf0b req-5c287aa2-cb96-44b3-8a79-b63f6d68e654 service nova] Lock "af94bfaa-45bc-4bac-9594-f363fce8727e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-69a5a7bf-98fd-465a-b4e5-5aa2981ccf0b req-5c287aa2-cb96-44b3-8a79-b63f6d68e654 service nova] Lock "af94bfaa-45bc-4bac-9594-f363fce8727e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:35 user nova-compute[74669]: DEBUG nova.compute.manager [req-69a5a7bf-98fd-465a-b4e5-5aa2981ccf0b req-5c287aa2-cb96-44b3-8a79-b63f6d68e654 service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] No waiting events found dispatching network-vif-plugged-1b0ec571-edb1-4c11-bbeb-24123bd96f09 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:51:35 user nova-compute[74669]: WARNING nova.compute.manager [req-69a5a7bf-98fd-465a-b4e5-5aa2981ccf0b req-5c287aa2-cb96-44b3-8a79-b63f6d68e654 service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Received unexpected event network-vif-plugged-1b0ec571-edb1-4c11-bbeb-24123bd96f09 for instance with vm_state building and task_state spawning.
Nov 08 16:51:35 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:51:35 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 16:51:35 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] There are 0 instances to clean {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 16:51:35 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:51:35 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74669) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 16:51:35 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:51:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:37 user nova-compute[74669]: DEBUG nova.compute.manager [req-3768d8e6-904e-4690-810f-0d5eac31171a req-7054bfa1-af4e-45ee-bb0a-ccfae5300411 service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Received event network-vif-plugged-1b0ec571-edb1-4c11-bbeb-24123bd96f09 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:51:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3768d8e6-904e-4690-810f-0d5eac31171a req-7054bfa1-af4e-45ee-bb0a-ccfae5300411 service nova] Acquiring lock "af94bfaa-45bc-4bac-9594-f363fce8727e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3768d8e6-904e-4690-810f-0d5eac31171a req-7054bfa1-af4e-45ee-bb0a-ccfae5300411 service nova] Lock "af94bfaa-45bc-4bac-9594-f363fce8727e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3768d8e6-904e-4690-810f-0d5eac31171a req-7054bfa1-af4e-45ee-bb0a-ccfae5300411 service nova] Lock "af94bfaa-45bc-4bac-9594-f363fce8727e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:37 user nova-compute[74669]: DEBUG nova.compute.manager [req-3768d8e6-904e-4690-810f-0d5eac31171a req-7054bfa1-af4e-45ee-bb0a-ccfae5300411 service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] No waiting events found dispatching network-vif-plugged-1b0ec571-edb1-4c11-bbeb-24123bd96f09 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:51:37 user nova-compute[74669]: WARNING nova.compute.manager [req-3768d8e6-904e-4690-810f-0d5eac31171a req-7054bfa1-af4e-45ee-bb0a-ccfae5300411 service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Received unexpected event network-vif-plugged-1b0ec571-edb1-4c11-bbeb-24123bd96f09 for instance with vm_state building and task_state spawning.
Nov 08 16:51:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:37 user nova-compute[74669]: DEBUG nova.compute.manager [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 16:51:37 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 16:51:37 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Instance spawned successfully.
Nov 08 16:51:37 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 16:51:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:38 user nova-compute[74669]: INFO nova.compute.manager [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Took 7.35 seconds to spawn the instance on the hypervisor.
Nov 08 16:51:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:51:38 user nova-compute[74669]: INFO nova.compute.manager [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Took 8.43 seconds to build instance.
Nov 08 16:51:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9327291f-1271-41db-8c50-614509ee983a tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Lock "af94bfaa-45bc-4bac-9594-f363fce8727e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.574s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:38 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:51:38 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:51:39 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:51:39 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:51:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:51:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 16:51:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:51:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:51:39 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 16:51:39 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lazy-loading 'info_cache' on Instance uuid 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:51:40 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Updating instance_info_cache with network_info: [{"id": "18b88bab-9376-440a-94f0-478d193b35f5", "address": "fa:16:3e:e0:5c:ca", "network": {"id": "7548ddaf-d550-41df-8f64-fc740e56fcd2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-954808146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa6ad206b6fa4cc099c08a01b051312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b88bab-93", "ovs_interfaceid": "18b88bab-9376-440a-94f0-478d193b35f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:51:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:51:40 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 16:51:40 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:51:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:40 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:51:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b779e-b58d-4e45-8789-91c4b452ee0b/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b779e-b58d-4e45-8789-91c4b452ee0b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b779e-b58d-4e45-8789-91c4b452ee0b/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b779e-b58d-4e45-8789-91c4b452ee0b/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725977e4-d011-4c79-b8bc-39bed9649515/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Acquiring lock "3ef7e79a-203b-4608-a430-1dc99f46e326" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:44 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 16:51:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725977e4-d011-4c79-b8bc-39bed9649515/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725977e4-d011-4c79-b8bc-39bed9649515/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725977e4-d011-4c79-b8bc-39bed9649515/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.009s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 16:51:44 user nova-compute[74669]: INFO nova.compute.claims [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Claim successful on node user
Nov 08 16:51:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:44 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Refreshing inventories for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 16:51:44 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Updating ProviderTree inventory for provider ce26964b-e55b-43d2-801a-7221ff1fe64b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 16:51:44 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Updating inventory in ProviderTree for provider ce26964b-e55b-43d2-801a-7221ff1fe64b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 16:51:45 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Refreshing aggregate associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, aggregates: None {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 16:51:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:45 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Refreshing trait associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, traits: HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 16:51:45 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:51:45 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:51:45 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=7578MB free_disk=25.820953369140625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:51:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:45 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:51:45 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.300s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.405s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 16:51:46 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 16:51:46 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 3ef7e79a-203b-4608-a430-1dc99f46e326 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 725977e4-d011-4c79-b8bc-39bed9649515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b26dbeeb-b629-414d-bcca-cdde6c207789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2d42d5ce-db73-40e6-9b35-f662a3cf0091 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance af94bfaa-45bc-4bac-9594-f363fce8727e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance fc2b779e-b58d-4e45-8789-91c4b452ee0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG nova.policy [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f25ebab8f83408d8cee32efb4cd93ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363debcc70b64500b0822f6dd6f27ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 16:51:46 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Creating image(s)
Nov 08 16:51:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "/opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "/opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.206s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.773s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.216s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk 1073741824" returned: 0 in 0.061s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:51:46 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:51:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.273s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:47 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 16:51:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:47 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Successfully created port: bdd3c052-b244-491c-ae59-dcea51d10b48 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:51:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:47 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Cannot resize image /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 16:51:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 16:51:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Ensure instance console log exists: /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 16:51:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:47 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Successfully updated port: bdd3c052-b244-491c-ae59-dcea51d10b48 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:51:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Acquiring lock "refresh_cache-3ef7e79a-203b-4608-a430-1dc99f46e326" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:51:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Acquired lock "refresh_cache-3ef7e79a-203b-4608-a430-1dc99f46e326" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:51:47 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:51:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-42175fb4-0f37-4603-8bc0-b6d97682d7ed req-c3540111-459c-471d-97c9-bbc8e9870e65 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Received event network-changed-bdd3c052-b244-491c-ae59-dcea51d10b48 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:51:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-42175fb4-0f37-4603-8bc0-b6d97682d7ed req-c3540111-459c-471d-97c9-bbc8e9870e65 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Refreshing instance network info cache due to event network-changed-bdd3c052-b244-491c-ae59-dcea51d10b48. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:51:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-42175fb4-0f37-4603-8bc0-b6d97682d7ed req-c3540111-459c-471d-97c9-bbc8e9870e65 service nova] Acquiring lock "refresh_cache-3ef7e79a-203b-4608-a430-1dc99f46e326" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:51:47 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Updating instance_info_cache with network_info: [{"id": "bdd3c052-b244-491c-ae59-dcea51d10b48", "address": "fa:16:3e:c7:e2:a1", "network": {"id": "bdc4b376-712f-45e1-aaf4-64336de2ba9b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-338712334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd3c052-b2", "ovs_interfaceid": "bdd3c052-b244-491c-ae59-dcea51d10b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Releasing lock "refresh_cache-3ef7e79a-203b-4608-a430-1dc99f46e326" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Instance network_info: |[{"id": "bdd3c052-b244-491c-ae59-dcea51d10b48", "address": "fa:16:3e:c7:e2:a1", "network": {"id": "bdc4b376-712f-45e1-aaf4-64336de2ba9b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-338712334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd3c052-b2", "ovs_interfaceid": "bdd3c052-b244-491c-ae59-dcea51d10b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-42175fb4-0f37-4603-8bc0-b6d97682d7ed req-c3540111-459c-471d-97c9-bbc8e9870e65 service nova] Acquired lock "refresh_cache-3ef7e79a-203b-4608-a430-1dc99f46e326" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.network.neutron [req-42175fb4-0f37-4603-8bc0-b6d97682d7ed req-c3540111-459c-471d-97c9-bbc8e9870e65 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Refreshing network info cache for port bdd3c052-b244-491c-ae59-dcea51d10b48 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Start _get_guest_xml network_info=[{"id": "bdd3c052-b244-491c-ae59-dcea51d10b48", "address": "fa:16:3e:c7:e2:a1", "network": {"id": "bdc4b376-712f-45e1-aaf4-64336de2ba9b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-338712334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd3c052-b2", "ovs_interfaceid": "bdd3c052-b244-491c-ae59-dcea51d10b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:51:48 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:51:48 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:51:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1645332005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1645332005',id=9,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB3a26wXBmbxS9Ie0rPCqATNjmL9SLaLhAobRJrF3o3vA4h0CU2n8HUE7/qd69ompZDoYTJsZEmW00PGjMGmRpCjD/lO91lrU6txPCpNQUdBwQTXu0cZgfMZw/6mElCMQ==',key_name='tempest-keypair-961371252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='363debcc70b64500b0822f6dd6f27ae2',ramdisk_id='',reservation_id='r-gineojlh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1985002595',owner_user_name='tempest-TaggedAttachmentsTest-1985002595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:51:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f25ebab8f83408d8cee32efb4cd93ad',uuid=3ef7e79a-203b-4608-a430-1dc99f46e326,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdd3c052-b244-491c-ae59-dcea51d10b48", "address": "fa:16:3e:c7:e2:a1", "network": {"id": "bdc4b376-712f-45e1-aaf4-64336de2ba9b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-338712334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd3c052-b2", "ovs_interfaceid": "bdd3c052-b244-491c-ae59-dcea51d10b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Converting VIF {"id": "bdd3c052-b244-491c-ae59-dcea51d10b48", "address": "fa:16:3e:c7:e2:a1", "network": {"id": "bdc4b376-712f-45e1-aaf4-64336de2ba9b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-338712334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd3c052-b2", "ovs_interfaceid": "bdd3c052-b244-491c-ae59-dcea51d10b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e2:a1,bridge_name='br-int',has_traffic_filtering=True,id=bdd3c052-b244-491c-ae59-dcea51d10b48,network=Network(bdc4b376-712f-45e1-aaf4-64336de2ba9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd3c052-b2') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.objects.instance [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ef7e79a-203b-4608-a430-1dc99f46e326 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:51:48 user nova-compute[74669]:   <uuid>3ef7e79a-203b-4608-a430-1dc99f46e326</uuid>
Nov 08 16:51:48 user nova-compute[74669]:   <name>instance-00000009</name>
Nov 08 16:51:48 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:51:48 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:51:48 user nova-compute[74669]:   <metadata>
Nov 08 16:51:48 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:51:48 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:51:48 user nova-compute[74669]:       <nova:name>tempest-device-tagging-server-1645332005</nova:name>
Nov 08 16:51:48 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:51:48</nova:creationTime>
Nov 08 16:51:48 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:51:48 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:51:48 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:51:48 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:51:48 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:51:48 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:51:48 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:51:48 user nova-compute[74669]:       <nova:owner>
Nov 08 16:51:48 user nova-compute[74669]:         <nova:user uuid="1f25ebab8f83408d8cee32efb4cd93ad">tempest-TaggedAttachmentsTest-1985002595-project-member</nova:user>
Nov 08 16:51:48 user nova-compute[74669]:         <nova:project uuid="363debcc70b64500b0822f6dd6f27ae2">tempest-TaggedAttachmentsTest-1985002595</nova:project>
Nov 08 16:51:48 user nova-compute[74669]:       </nova:owner>
Nov 08 16:51:48 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:51:48 user nova-compute[74669]:       <nova:ports>
Nov 08 16:51:48 user nova-compute[74669]:         <nova:port uuid="bdd3c052-b244-491c-ae59-dcea51d10b48">
Nov 08 16:51:48 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 16:51:48 user nova-compute[74669]:         </nova:port>
Nov 08 16:51:48 user nova-compute[74669]:       </nova:ports>
Nov 08 16:51:48 user nova-compute[74669]:     </nova:instance>
Nov 08 16:51:48 user nova-compute[74669]:   </metadata>
Nov 08 16:51:48 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:51:48 user nova-compute[74669]:     <system>
Nov 08 16:51:48 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:51:48 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:51:48 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:51:48 user nova-compute[74669]:       <entry name="serial">3ef7e79a-203b-4608-a430-1dc99f46e326</entry>
Nov 08 16:51:48 user nova-compute[74669]:       <entry name="uuid">3ef7e79a-203b-4608-a430-1dc99f46e326</entry>
Nov 08 16:51:48 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:51:48 user nova-compute[74669]:     </system>
Nov 08 16:51:48 user nova-compute[74669]:   </sysinfo>
Nov 08 16:51:48 user nova-compute[74669]:   <os>
Nov 08 16:51:48 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:51:48 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 16:51:48 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:51:48 user nova-compute[74669]:   </os>
Nov 08 16:51:48 user nova-compute[74669]:   <features>
Nov 08 16:51:48 user nova-compute[74669]:     <acpi/>
Nov 08 16:51:48 user nova-compute[74669]:     <apic/>
Nov 08 16:51:48 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:51:48 user nova-compute[74669]:   </features>
Nov 08 16:51:48 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:51:48 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:51:48 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:51:48 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:51:48 user nova-compute[74669]:   </clock>
Nov 08 16:51:48 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:51:48 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:51:48 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:51:48 user nova-compute[74669]:   </cpu>
Nov 08 16:51:48 user nova-compute[74669]:   <devices>
Nov 08 16:51:48 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:51:48 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:51:48 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk"/>
Nov 08 16:51:48 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:51:48 user nova-compute[74669]:     </disk>
Nov 08 16:51:48 user nova-compute[74669]:     <disk type="file" device="cdrom">
Nov 08 16:51:48 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 16:51:48 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk.config"/>
Nov 08 16:51:48 user nova-compute[74669]:       <target dev="hda" bus="ide"/>
Nov 08 16:51:48 user nova-compute[74669]:     </disk>
Nov 08 16:51:48 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:51:48 user nova-compute[74669]:       <mac address="fa:16:3e:c7:e2:a1"/>
Nov 08 16:51:48 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:51:48 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:51:48 user nova-compute[74669]:       <target dev="tapbdd3c052-b2"/>
Nov 08 16:51:48 user nova-compute[74669]:     </interface>
Nov 08 16:51:48 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:51:48 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/console.log" append="off"/>
Nov 08 16:51:48 user nova-compute[74669]:     </serial>
Nov 08 16:51:48 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:51:48 user nova-compute[74669]:     <video>
Nov 08 16:51:48 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:51:48 user nova-compute[74669]:     </video>
Nov 08 16:51:48 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:51:48 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:51:48 user nova-compute[74669]:     </rng>
Nov 08 16:51:48 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:51:48 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:51:48 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:51:48 user nova-compute[74669]:     </memballoon>
Nov 08 16:51:48 user nova-compute[74669]:   </devices>
Nov 08 16:51:48 user nova-compute[74669]: </domain>
Nov 08 16:51:48 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:51:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1645332005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1645332005',id=9,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB3a26wXBmbxS9Ie0rPCqATNjmL9SLaLhAobRJrF3o3vA4h0CU2n8HUE7/qd69ompZDoYTJsZEmW00PGjMGmRpCjD/lO91lrU6txPCpNQUdBwQTXu0cZgfMZw/6mElCMQ==',key_name='tempest-keypair-961371252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='363debcc70b64500b0822f6dd6f27ae2',ramdisk_id='',reservation_id='r-gineojlh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1985002595',owner_user_name='tempest-TaggedAttachmentsTest-1985002595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:51:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f25ebab8f83408d8cee32efb4cd93ad',uuid=3ef7e79a-203b-4608-a430-1dc99f46e326,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdd3c052-b244-491c-ae59-dcea51d10b48", "address": "fa:16:3e:c7:e2:a1", "network": {"id": "bdc4b376-712f-45e1-aaf4-64336de2ba9b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-338712334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd3c052-b2", "ovs_interfaceid": "bdd3c052-b244-491c-ae59-dcea51d10b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Converting VIF {"id": "bdd3c052-b244-491c-ae59-dcea51d10b48", "address": "fa:16:3e:c7:e2:a1", "network": {"id": "bdc4b376-712f-45e1-aaf4-64336de2ba9b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-338712334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd3c052-b2", "ovs_interfaceid": "bdd3c052-b244-491c-ae59-dcea51d10b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e2:a1,bridge_name='br-int',has_traffic_filtering=True,id=bdd3c052-b244-491c-ae59-dcea51d10b48,network=Network(bdc4b376-712f-45e1-aaf4-64336de2ba9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd3c052-b2') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG os_vif [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e2:a1,bridge_name='br-int',has_traffic_filtering=True,id=bdd3c052-b244-491c-ae59-dcea51d10b48,network=Network(bdc4b376-712f-45e1-aaf4-64336de2ba9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd3c052-b2') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4f04349-bfa2-51bc-a735-0955f145817e', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbdd3c052-b2, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbdd3c052-b2, col_values=(('qos', UUID('4015eef9-31e9-4ab5-86a3-4fdb0c59a86f')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbdd3c052-b2, col_values=(('external_ids', {'iface-id': 'bdd3c052-b244-491c-ae59-dcea51d10b48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:e2:a1', 'vm-uuid': '3ef7e79a-203b-4608-a430-1dc99f46e326'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:48 user nova-compute[74669]: INFO os_vif [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e2:a1,bridge_name='br-int',has_traffic_filtering=True,id=bdd3c052-b244-491c-ae59-dcea51d10b48,network=Network(bdc4b376-712f-45e1-aaf4-64336de2ba9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd3c052-b2')
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] No BDM found with device name hda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] No VIF found with MAC fa:16:3e:c7:e2:a1, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:51:48 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Using config drive
Nov 08 16:51:48 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Creating config drive at /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk.config
Nov 08 16:51:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpk0_w6f_w {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpk0_w6f_w" returned: 0 in 0.063s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.network.neutron [req-42175fb4-0f37-4603-8bc0-b6d97682d7ed req-c3540111-459c-471d-97c9-bbc8e9870e65 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Updated VIF entry in instance network info cache for port bdd3c052-b244-491c-ae59-dcea51d10b48. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG nova.network.neutron [req-42175fb4-0f37-4603-8bc0-b6d97682d7ed req-c3540111-459c-471d-97c9-bbc8e9870e65 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Updating instance_info_cache with network_info: [{"id": "bdd3c052-b244-491c-ae59-dcea51d10b48", "address": "fa:16:3e:c7:e2:a1", "network": {"id": "bdc4b376-712f-45e1-aaf4-64336de2ba9b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-338712334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd3c052-b2", "ovs_interfaceid": "bdd3c052-b244-491c-ae59-dcea51d10b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:51:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-42175fb4-0f37-4603-8bc0-b6d97682d7ed req-c3540111-459c-471d-97c9-bbc8e9870e65 service nova] Releasing lock "refresh_cache-3ef7e79a-203b-4608-a430-1dc99f46e326" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:51:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:50 user nova-compute[74669]: DEBUG nova.compute.manager [req-1ab2a11b-fed4-473a-a660-36db6de309fb req-f78ea390-911b-4ea1-ae02-d4ff37915bae service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Received event network-vif-plugged-bdd3c052-b244-491c-ae59-dcea51d10b48 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:51:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1ab2a11b-fed4-473a-a660-36db6de309fb req-f78ea390-911b-4ea1-ae02-d4ff37915bae service nova] Acquiring lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1ab2a11b-fed4-473a-a660-36db6de309fb req-f78ea390-911b-4ea1-ae02-d4ff37915bae service nova] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1ab2a11b-fed4-473a-a660-36db6de309fb req-f78ea390-911b-4ea1-ae02-d4ff37915bae service nova] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:50 user nova-compute[74669]: DEBUG nova.compute.manager [req-1ab2a11b-fed4-473a-a660-36db6de309fb req-f78ea390-911b-4ea1-ae02-d4ff37915bae service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] No waiting events found dispatching network-vif-plugged-bdd3c052-b244-491c-ae59-dcea51d10b48 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:51:50 user nova-compute[74669]: WARNING nova.compute.manager [req-1ab2a11b-fed4-473a-a660-36db6de309fb req-f78ea390-911b-4ea1-ae02-d4ff37915bae service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Received unexpected event network-vif-plugged-bdd3c052-b244-491c-ae59-dcea51d10b48 for instance with vm_state building and task_state spawning.
Nov 08 16:51:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:52 user nova-compute[74669]: DEBUG nova.compute.manager [req-48018935-7794-41cf-9ec3-dbe1fb1aff2c req-1252d443-1995-4c10-91e5-fbc852039506 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Received event network-vif-plugged-bdd3c052-b244-491c-ae59-dcea51d10b48 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:51:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-48018935-7794-41cf-9ec3-dbe1fb1aff2c req-1252d443-1995-4c10-91e5-fbc852039506 service nova] Acquiring lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:51:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-48018935-7794-41cf-9ec3-dbe1fb1aff2c req-1252d443-1995-4c10-91e5-fbc852039506 service nova] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:51:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-48018935-7794-41cf-9ec3-dbe1fb1aff2c req-1252d443-1995-4c10-91e5-fbc852039506 service nova] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:52 user nova-compute[74669]: DEBUG nova.compute.manager [req-48018935-7794-41cf-9ec3-dbe1fb1aff2c req-1252d443-1995-4c10-91e5-fbc852039506 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] No waiting events found dispatching network-vif-plugged-bdd3c052-b244-491c-ae59-dcea51d10b48 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:51:52 user nova-compute[74669]: WARNING nova.compute.manager [req-48018935-7794-41cf-9ec3-dbe1fb1aff2c req-1252d443-1995-4c10-91e5-fbc852039506 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Received unexpected event network-vif-plugged-bdd3c052-b244-491c-ae59-dcea51d10b48 for instance with vm_state building and task_state spawning.
Nov 08 16:51:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:53 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 16:51:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 16:51:53 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Instance spawned successfully.
Nov 08 16:51:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 16:51:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:51:53 user nova-compute[74669]: INFO nova.compute.manager [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Took 6.82 seconds to spawn the instance on the hypervisor.
Nov 08 16:51:53 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:51:53 user nova-compute[74669]: INFO nova.compute.manager [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Took 8.90 seconds to build instance.
Nov 08 16:51:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a182e527-4c88-4c50-a5da-ab0ad964cbc5 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.047s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:51:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:51:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:52:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:35 user nova-compute[74669]: DEBUG nova.compute.manager [req-511d9a7b-2d0b-43d5-b489-c57a5ba0d393 req-d4242143-4e9d-489b-9a8f-79567f3e6954 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received event network-changed-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:52:35 user nova-compute[74669]: DEBUG nova.compute.manager [req-511d9a7b-2d0b-43d5-b489-c57a5ba0d393 req-d4242143-4e9d-489b-9a8f-79567f3e6954 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Refreshing instance network info cache due to event network-changed-18b88bab-9376-440a-94f0-478d193b35f5. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:52:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-511d9a7b-2d0b-43d5-b489-c57a5ba0d393 req-d4242143-4e9d-489b-9a8f-79567f3e6954 service nova] Acquiring lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:52:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-511d9a7b-2d0b-43d5-b489-c57a5ba0d393 req-d4242143-4e9d-489b-9a8f-79567f3e6954 service nova] Acquired lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:52:35 user nova-compute[74669]: DEBUG nova.network.neutron [req-511d9a7b-2d0b-43d5-b489-c57a5ba0d393 req-d4242143-4e9d-489b-9a8f-79567f3e6954 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Refreshing network info cache for port 18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:52:36 user nova-compute[74669]: DEBUG nova.network.neutron [req-511d9a7b-2d0b-43d5-b489-c57a5ba0d393 req-d4242143-4e9d-489b-9a8f-79567f3e6954 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Updated VIF entry in instance network info cache for port 18b88bab-9376-440a-94f0-478d193b35f5. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:52:36 user nova-compute[74669]: DEBUG nova.network.neutron [req-511d9a7b-2d0b-43d5-b489-c57a5ba0d393 req-d4242143-4e9d-489b-9a8f-79567f3e6954 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Updating instance_info_cache with network_info: [{"id": "18b88bab-9376-440a-94f0-478d193b35f5", "address": "fa:16:3e:e0:5c:ca", "network": {"id": "7548ddaf-d550-41df-8f64-fc740e56fcd2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-954808146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa6ad206b6fa4cc099c08a01b051312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b88bab-93", "ovs_interfaceid": "18b88bab-9376-440a-94f0-478d193b35f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:52:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-511d9a7b-2d0b-43d5-b489-c57a5ba0d393 req-d4242143-4e9d-489b-9a8f-79567f3e6954 service nova] Releasing lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:52:37 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:52:37 user nova-compute[74669]: INFO nova.compute.manager [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] instance snapshotting
Nov 08 16:52:37 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Beginning live snapshot process
Nov 08 16:52:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json -f qcow2 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json -f qcow2 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json -f qcow2" returned: 0 in 0.219s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.179s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppxzdc8n3/7f31f918c90a4f7caa607b3ad6ffc662.delta 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppxzdc8n3/7f31f918c90a4f7caa607b3ad6ffc662.delta 1073741824" returned: 0 in 0.057s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:38 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 16:52:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74669) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 08 16:52:38 user nova-compute[74669]: INFO nova.virt.libvirt.host [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] UEFI support detected
Nov 08 16:52:38 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:52:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74669) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 16:52:39 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:52:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:52:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:52:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:52:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:52:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74669) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 16:52:40 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 16:52:40 user nova-compute[74669]: DEBUG nova.privsep.utils [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74669) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 16:52:40 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppxzdc8n3/7f31f918c90a4f7caa607b3ad6ffc662.delta /opt/stack/data/nova/instances/snapshots/tmppxzdc8n3/7f31f918c90a4f7caa607b3ad6ffc662 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:40 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:40 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:40 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:40 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:40 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppxzdc8n3/7f31f918c90a4f7caa607b3ad6ffc662.delta /opt/stack/data/nova/instances/snapshots/tmppxzdc8n3/7f31f918c90a4f7caa607b3ad6ffc662" returned: 0 in 0.899s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:41 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Snapshot extracted, beginning image upload
Nov 08 16:52:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:42 user nova-compute[74669]: INFO nova.compute.manager [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Rescuing
Nov 08 16:52:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "refresh_cache-7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:52:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquired lock "refresh_cache-7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:52:42 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:52:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b779e-b58d-4e45-8789-91c4b452ee0b/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b779e-b58d-4e45-8789-91c4b452ee0b/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b779e-b58d-4e45-8789-91c4b452ee0b/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc2b779e-b58d-4e45-8789-91c4b452ee0b/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:42 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Updating instance_info_cache with network_info: [{"id": "525ba5da-155c-4f87-9fae-8db52836f73e", "address": "fa:16:3e:7b:7c:e2", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525ba5da-15", "ovs_interfaceid": "525ba5da-155c-4f87-9fae-8db52836f73e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:52:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Releasing lock "refresh_cache-7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:52:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG nova.compute.manager [req-2458b125-deab-4d17-ba29-85952d783bf4 req-b88f0307-3661-440f-898c-bdac6ce09e08 service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Received event network-vif-unplugged-525ba5da-155c-4f87-9fae-8db52836f73e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2458b125-deab-4d17-ba29-85952d783bf4 req-b88f0307-3661-440f-898c-bdac6ce09e08 service nova] Acquiring lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2458b125-deab-4d17-ba29-85952d783bf4 req-b88f0307-3661-440f-898c-bdac6ce09e08 service nova] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2458b125-deab-4d17-ba29-85952d783bf4 req-b88f0307-3661-440f-898c-bdac6ce09e08 service nova] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG nova.compute.manager [req-2458b125-deab-4d17-ba29-85952d783bf4 req-b88f0307-3661-440f-898c-bdac6ce09e08 service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] No waiting events found dispatching network-vif-unplugged-525ba5da-155c-4f87-9fae-8db52836f73e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:52:43 user nova-compute[74669]: WARNING nova.compute.manager [req-2458b125-deab-4d17-ba29-85952d783bf4 req-b88f0307-3661-440f-898c-bdac6ce09e08 service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Received unexpected event network-vif-unplugged-525ba5da-155c-4f87-9fae-8db52836f73e for instance with vm_state active and task_state rescuing.
Nov 08 16:52:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725977e4-d011-4c79-b8bc-39bed9649515/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:43 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Instance destroyed successfully.
Nov 08 16:52:43 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Attempting rescue
Nov 08 16:52:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74669) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Instance directory exists: not creating {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 16:52:43 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Creating image(s)
Nov 08 16:52:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "/opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "/opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG nova.objects.instance [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725977e4-d011-4c79-b8bc-39bed9649515/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725977e4-d011-4c79-b8bc-39bed9649515/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.189s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue" returned: 0 in 0.052s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.objects.instance [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'migration_context' on Instance uuid 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.objects.base [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Object Instance<7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Start _get_guest_xml network_info=[{"id": "525ba5da-155c-4f87-9fae-8db52836f73e", "address": "fa:16:3e:7b:7c:e2", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "vif_mac": "fa:16:3e:7b:7c:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525ba5da-15", "ovs_interfaceid": "525ba5da-155c-4f87-9fae-8db52836f73e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.objects.instance [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'resources' on Instance uuid 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/725977e4-d011-4c79-b8bc-39bed9649515/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.objects.base [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Object Instance<7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.objects.instance [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'numa_topology' on Instance uuid 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.objects.base [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Object Instance<7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:52:44 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:52:44 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.objects.instance [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.objects.base [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Object Instance<7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-352889271',display_name='tempest-ServerRescueNegativeTestJSON-server-352889271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-352889271',id=4,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:51:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='632d3acc026b4a869be4899a0ed2e2e2',ramdisk_id='',reservation_id='r-ux3r1hfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1743978403',owner_user_name='tempest-ServerRescueNegativeTestJSON-1743978403-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:51:07Z,user_data=None,user_id='4836f11b0e8346a2a7e835a6012f53fb',uuid=7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "525ba5da-155c-4f87-9fae-8db52836f73e", "address": "fa:16:3e:7b:7c:e2", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "vif_mac": "fa:16:3e:7b:7c:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525ba5da-15", "ovs_interfaceid": "525ba5da-155c-4f87-9fae-8db52836f73e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converting VIF {"id": "525ba5da-155c-4f87-9fae-8db52836f73e", "address": "fa:16:3e:7b:7c:e2", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "vif_mac": "fa:16:3e:7b:7c:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525ba5da-15", "ovs_interfaceid": "525ba5da-155c-4f87-9fae-8db52836f73e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:7c:e2,bridge_name='br-int',has_traffic_filtering=True,id=525ba5da-155c-4f87-9fae-8db52836f73e,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525ba5da-15') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.objects.instance [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.objects.base [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Object Instance<7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:52:44 user nova-compute[74669]:   <uuid>7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8</uuid>
Nov 08 16:52:44 user nova-compute[74669]:   <name>instance-00000004</name>
Nov 08 16:52:44 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:52:44 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:52:44 user nova-compute[74669]:   <metadata>
Nov 08 16:52:44 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:52:44 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:52:44 user nova-compute[74669]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-352889271</nova:name>
Nov 08 16:52:44 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:52:44</nova:creationTime>
Nov 08 16:52:44 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:52:44 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:52:44 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:52:44 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:52:44 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:52:44 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:52:44 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:52:44 user nova-compute[74669]:       <nova:owner>
Nov 08 16:52:44 user nova-compute[74669]:         <nova:user uuid="4836f11b0e8346a2a7e835a6012f53fb">tempest-ServerRescueNegativeTestJSON-1743978403-project-member</nova:user>
Nov 08 16:52:44 user nova-compute[74669]:         <nova:project uuid="632d3acc026b4a869be4899a0ed2e2e2">tempest-ServerRescueNegativeTestJSON-1743978403</nova:project>
Nov 08 16:52:44 user nova-compute[74669]:       </nova:owner>
Nov 08 16:52:44 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:52:44 user nova-compute[74669]:       <nova:ports>
Nov 08 16:52:44 user nova-compute[74669]:         <nova:port uuid="525ba5da-155c-4f87-9fae-8db52836f73e">
Nov 08 16:52:44 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 16:52:44 user nova-compute[74669]:         </nova:port>
Nov 08 16:52:44 user nova-compute[74669]:       </nova:ports>
Nov 08 16:52:44 user nova-compute[74669]:     </nova:instance>
Nov 08 16:52:44 user nova-compute[74669]:   </metadata>
Nov 08 16:52:44 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:52:44 user nova-compute[74669]:     <system>
Nov 08 16:52:44 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:52:44 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:52:44 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:52:44 user nova-compute[74669]:       <entry name="serial">7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8</entry>
Nov 08 16:52:44 user nova-compute[74669]:       <entry name="uuid">7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8</entry>
Nov 08 16:52:44 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:52:44 user nova-compute[74669]:     </system>
Nov 08 16:52:44 user nova-compute[74669]:   </sysinfo>
Nov 08 16:52:44 user nova-compute[74669]:   <os>
Nov 08 16:52:44 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:52:44 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:52:44 user nova-compute[74669]:   </os>
Nov 08 16:52:44 user nova-compute[74669]:   <features>
Nov 08 16:52:44 user nova-compute[74669]:     <acpi/>
Nov 08 16:52:44 user nova-compute[74669]:     <apic/>
Nov 08 16:52:44 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:52:44 user nova-compute[74669]:   </features>
Nov 08 16:52:44 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:52:44 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:52:44 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:52:44 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:52:44 user nova-compute[74669]:   </clock>
Nov 08 16:52:44 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:52:44 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:52:44 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:52:44 user nova-compute[74669]:   </cpu>
Nov 08 16:52:44 user nova-compute[74669]:   <devices>
Nov 08 16:52:44 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:52:44 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:52:44 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue"/>
Nov 08 16:52:44 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:52:44 user nova-compute[74669]:     </disk>
Nov 08 16:52:44 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:52:44 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:52:44 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk"/>
Nov 08 16:52:44 user nova-compute[74669]:       <target dev="vdb" bus="virtio"/>
Nov 08 16:52:44 user nova-compute[74669]:     </disk>
Nov 08 16:52:44 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:52:44 user nova-compute[74669]:       <mac address="fa:16:3e:7b:7c:e2"/>
Nov 08 16:52:44 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:52:44 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:52:44 user nova-compute[74669]:       <target dev="tap525ba5da-15"/>
Nov 08 16:52:44 user nova-compute[74669]:     </interface>
Nov 08 16:52:44 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:52:44 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/console.log" append="off"/>
Nov 08 16:52:44 user nova-compute[74669]:     </serial>
Nov 08 16:52:44 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:52:44 user nova-compute[74669]:     <video>
Nov 08 16:52:44 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:52:44 user nova-compute[74669]:     </video>
Nov 08 16:52:44 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:52:44 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:52:44 user nova-compute[74669]:     </rng>
Nov 08 16:52:44 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:52:44 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:52:44 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:52:44 user nova-compute[74669]:     </memballoon>
Nov 08 16:52:44 user nova-compute[74669]:   </devices>
Nov 08 16:52:44 user nova-compute[74669]: </domain>
Nov 08 16:52:44 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:52:44 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Instance destroyed successfully.
Nov 08 16:52:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] No VIF found with MAC fa:16:3e:7b:7c:e2, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:52:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-658baa5b-5bf8-445a-a625-e99b5a181b26 req-c480c65b-47eb-4275-b498-e1dd33d07cb2 service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Received event network-vif-plugged-525ba5da-155c-4f87-9fae-8db52836f73e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-658baa5b-5bf8-445a-a625-e99b5a181b26 req-c480c65b-47eb-4275-b498-e1dd33d07cb2 service nova] Acquiring lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-658baa5b-5bf8-445a-a625-e99b5a181b26 req-c480c65b-47eb-4275-b498-e1dd33d07cb2 service nova] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-658baa5b-5bf8-445a-a625-e99b5a181b26 req-c480c65b-47eb-4275-b498-e1dd33d07cb2 service nova] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-658baa5b-5bf8-445a-a625-e99b5a181b26 req-c480c65b-47eb-4275-b498-e1dd33d07cb2 service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] No waiting events found dispatching network-vif-plugged-525ba5da-155c-4f87-9fae-8db52836f73e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:52:48 user nova-compute[74669]: WARNING nova.compute.manager [req-658baa5b-5bf8-445a-a625-e99b5a181b26 req-c480c65b-47eb-4275-b498-e1dd33d07cb2 service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Received unexpected event network-vif-plugged-525ba5da-155c-4f87-9fae-8db52836f73e for instance with vm_state active and task_state rescuing.
Nov 08 16:52:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-7d430b5f-4fd8-4bee-babf-36305c660404 req-438b5ec0-918d-4f62-a613-33572ae8a8bb service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Received event network-vif-plugged-525ba5da-155c-4f87-9fae-8db52836f73e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-7d430b5f-4fd8-4bee-babf-36305c660404 req-438b5ec0-918d-4f62-a613-33572ae8a8bb service nova] Acquiring lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-7d430b5f-4fd8-4bee-babf-36305c660404 req-438b5ec0-918d-4f62-a613-33572ae8a8bb service nova] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-7d430b5f-4fd8-4bee-babf-36305c660404 req-438b5ec0-918d-4f62-a613-33572ae8a8bb service nova] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-7d430b5f-4fd8-4bee-babf-36305c660404 req-438b5ec0-918d-4f62-a613-33572ae8a8bb service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] No waiting events found dispatching network-vif-plugged-525ba5da-155c-4f87-9fae-8db52836f73e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:52:48 user nova-compute[74669]: WARNING nova.compute.manager [req-7d430b5f-4fd8-4bee-babf-36305c660404 req-438b5ec0-918d-4f62-a613-33572ae8a8bb service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Received unexpected event network-vif-plugged-525ba5da-155c-4f87-9fae-8db52836f73e for instance with vm_state active and task_state rescuing.
Nov 08 16:52:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-7d430b5f-4fd8-4bee-babf-36305c660404 req-438b5ec0-918d-4f62-a613-33572ae8a8bb service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Received event network-vif-plugged-525ba5da-155c-4f87-9fae-8db52836f73e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-7d430b5f-4fd8-4bee-babf-36305c660404 req-438b5ec0-918d-4f62-a613-33572ae8a8bb service nova] Acquiring lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-7d430b5f-4fd8-4bee-babf-36305c660404 req-438b5ec0-918d-4f62-a613-33572ae8a8bb service nova] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-7d430b5f-4fd8-4bee-babf-36305c660404 req-438b5ec0-918d-4f62-a613-33572ae8a8bb service nova] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-7d430b5f-4fd8-4bee-babf-36305c660404 req-438b5ec0-918d-4f62-a613-33572ae8a8bb service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] No waiting events found dispatching network-vif-plugged-525ba5da-155c-4f87-9fae-8db52836f73e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:52:48 user nova-compute[74669]: WARNING nova.compute.manager [req-7d430b5f-4fd8-4bee-babf-36305c660404 req-438b5ec0-918d-4f62-a613-33572ae8a8bb service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Received unexpected event network-vif-plugged-525ba5da-155c-4f87-9fae-8db52836f73e for instance with vm_state active and task_state rescuing.
Nov 08 16:52:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-c5be9a33-4e78-41db-8fe7-cc9abc27f34a req-83dd627e-0912-4a36-9f2f-7dd95b639b98 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received event network-changed-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-c5be9a33-4e78-41db-8fe7-cc9abc27f34a req-83dd627e-0912-4a36-9f2f-7dd95b639b98 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Refreshing instance network info cache due to event network-changed-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c5be9a33-4e78-41db-8fe7-cc9abc27f34a req-83dd627e-0912-4a36-9f2f-7dd95b639b98 service nova] Acquiring lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c5be9a33-4e78-41db-8fe7-cc9abc27f34a req-83dd627e-0912-4a36-9f2f-7dd95b639b98 service nova] Acquired lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG nova.network.neutron [req-c5be9a33-4e78-41db-8fe7-cc9abc27f34a req-83dd627e-0912-4a36-9f2f-7dd95b639b98 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Refreshing network info cache for port 47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Acquiring lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG nova.compute.manager [None req-3239e34f-7861-4675-b767-5a7077a6e0f5 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:52:48 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:52:48 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:52:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=7194MB free_disk=25.72063446044922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:52:48 user nova-compute[74669]: DEBUG nova.objects.instance [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lazy-loading 'flavor' on Instance uuid fc2b779e-b58d-4e45-8789-91c4b452ee0b {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:52:49 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Snapshot image upload complete
Nov 08 16:52:49 user nova-compute[74669]: INFO nova.compute.manager [None req-d42436ff-34a0-4854-878b-c60f8b2de62b tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Took 11.49 seconds to snapshot the instance on the hypervisor.
Nov 08 16:52:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.351s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:52:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:52:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance fc2b779e-b58d-4e45-8789-91c4b452ee0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:52:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:52:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:52:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b26dbeeb-b629-414d-bcca-cdde6c207789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:52:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 725977e4-d011-4c79-b8bc-39bed9649515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:52:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2d42d5ce-db73-40e6-9b35-f662a3cf0091 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:52:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance af94bfaa-45bc-4bac-9594-f363fce8727e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:52:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 3ef7e79a-203b-4608-a430-1dc99f46e326 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:52:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:52:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:52:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Acquiring lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:52:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:52:49 user nova-compute[74669]: INFO nova.compute.manager [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Attaching volume edecd289-026b-4f6a-9984-dd105f8e72ed to /dev/vdb
Nov 08 16:52:49 user nova-compute[74669]: DEBUG os_brick.utils [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:52:49 user nova-compute[74669]: INFO oslo.privsep.daemon [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpecca58_c/privsep.sock']
Nov 08 16:52:49 user sudo[86104]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpecca58_c/privsep.sock
Nov 08 16:52:49 user sudo[86104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 16:52:49 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:52:49 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:52:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:52:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.897s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:52:49 user nova-compute[74669]: DEBUG nova.network.neutron [req-c5be9a33-4e78-41db-8fe7-cc9abc27f34a req-83dd627e-0912-4a36-9f2f-7dd95b639b98 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Updated VIF entry in instance network info cache for port 47c9314f-4ea9-49c3-9b34-2fb94cc1eac4. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:52:49 user nova-compute[74669]: DEBUG nova.network.neutron [req-c5be9a33-4e78-41db-8fe7-cc9abc27f34a req-83dd627e-0912-4a36-9f2f-7dd95b639b98 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Updating instance_info_cache with network_info: [{"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:52:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c5be9a33-4e78-41db-8fe7-cc9abc27f34a req-83dd627e-0912-4a36-9f2f-7dd95b639b98 service nova] Releasing lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:52:50 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:52:50 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:52:50 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:52:50 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:52:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-fc2b779e-b58d-4e45-8789-91c4b452ee0b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:52:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-fc2b779e-b58d-4e45-8789-91c4b452ee0b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:52:50 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Updating instance_info_cache with network_info: [{"id": "542b5f60-bd62-4bb3-a644-b7d92762bca0", "address": "fa:16:3e:74:7e:b6", "network": {"id": "7e5f6d1e-96bc-4b2c-a3a9-0b83a29d636f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-76294675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e30fcd3be58646a0b81fbc97acec8b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542b5f60-bd", "ovs_interfaceid": "542b5f60-bd62-4bb3-a644-b7d92762bca0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-fc2b779e-b58d-4e45-8789-91c4b452ee0b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:52:51 user sudo[86104]: pam_unix(sudo:session): session closed for user root
Nov 08 16:52:51 user nova-compute[74669]: INFO oslo.privsep.daemon [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Spawned new privsep daemon via rootwrap
Nov 08 16:52:51 user nova-compute[74669]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 16:52:51 user nova-compute[74669]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 16:52:51 user nova-compute[74669]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 08 16:52:51 user nova-compute[74669]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86107
Nov 08 16:52:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2be1cb-37ef-46f8-b3c7-e8fda8d7119d]: (2,) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7f333c-c57f-46cc-b111-b7232d1c7fa0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:52:51 user nova-compute[74669]: WARNING os_brick.initiator.connectors.nvmeof [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 08 16:52:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0595dea8-b2ce-429f-bbe2-350b374751a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a69db90-65f2-4c85-8f49-c9f97ed95f87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94013c1-dac6-46d3-9e80-6d1241b20235]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:52:51 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 16:52:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26e7dc5-b282-4b4f-9e82-82754c3ff683]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG os_brick.utils [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] <== get_connector_properties: return (2241ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:52:51 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Updating existing volume attachment record: 1cf3b148-ac07-4bf1-a84d-e93ae86fc6d0 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 16:52:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "0829b734-daec-4dc6-b24b-cbe89000160c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:52:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "0829b734-daec-4dc6-b24b-cbe89000160c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:52:56 user nova-compute[74669]: DEBUG nova.compute.manager [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 16:52:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:52:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:52:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 16:52:56 user nova-compute[74669]: INFO nova.compute.claims [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Claim successful on node user
Nov 08 16:52:56 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:52:57 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:52:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:52:57 user nova-compute[74669]: DEBUG nova.compute.manager [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 16:52:57 user nova-compute[74669]: DEBUG nova.compute.manager [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 16:52:57 user nova-compute[74669]: DEBUG nova.network.neutron [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 16:52:57 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 16:52:57 user nova-compute[74669]: DEBUG nova.compute.manager [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 16:52:57 user nova-compute[74669]: DEBUG nova.policy [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6fd033f262943cdabb12db63b11eca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39bcebfdde5c48dc8857824275b0082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 16:52:57 user nova-compute[74669]: DEBUG nova.compute.manager [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 16:52:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 16:52:57 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Creating image(s)
Nov 08 16:52:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "/opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:52:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "/opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:52:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "/opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:52:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "77f42b4b9d8a55c61f5c6daafa24b193b585b71c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:52:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "77f42b4b9d8a55c61f5c6daafa24b193b585b71c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:52:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77f42b4b9d8a55c61f5c6daafa24b193b585b71c.part --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:57 user nova-compute[74669]: DEBUG nova.network.neutron [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Successfully created port: bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:52:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77f42b4b9d8a55c61f5c6daafa24b193b585b71c.part --force-share --output=json" returned: 0 in 0.229s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:58 user nova-compute[74669]: DEBUG nova.virt.images [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] 3366e51a-0116-435e-986c-98029c349c7c was qcow2, converting to raw {{(pid=74669) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 16:52:58 user nova-compute[74669]: DEBUG nova.privsep.utils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74669) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 16:52:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/77f42b4b9d8a55c61f5c6daafa24b193b585b71c.part /opt/stack/data/nova/instances/_base/77f42b4b9d8a55c61f5c6daafa24b193b585b71c.converted {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/77f42b4b9d8a55c61f5c6daafa24b193b585b71c.part /opt/stack/data/nova/instances/_base/77f42b4b9d8a55c61f5c6daafa24b193b585b71c.converted" returned: 0 in 0.214s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77f42b4b9d8a55c61f5c6daafa24b193b585b71c.converted --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77f42b4b9d8a55c61f5c6daafa24b193b585b71c.converted --force-share --output=json" returned: 0 in 0.250s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "77f42b4b9d8a55c61f5c6daafa24b193b585b71c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.215s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:52:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77f42b4b9d8a55c61f5c6daafa24b193b585b71c --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:52:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77f42b4b9d8a55c61f5c6daafa24b193b585b71c --force-share --output=json" returned: 0 in 0.255s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "77f42b4b9d8a55c61f5c6daafa24b193b585b71c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:52:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "77f42b4b9d8a55c61f5c6daafa24b193b585b71c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:52:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77f42b4b9d8a55c61f5c6daafa24b193b585b71c --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:58 user nova-compute[74669]: DEBUG nova.network.neutron [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Successfully updated port: bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:52:58 user nova-compute[74669]: DEBUG nova.compute.manager [req-db4bfa20-cbe2-4263-8093-4ddad4bd8b4c req-40bf5dd5-7a4f-40a7-baa1-a496c823e8ad service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received event network-changed-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:52:58 user nova-compute[74669]: DEBUG nova.compute.manager [req-db4bfa20-cbe2-4263-8093-4ddad4bd8b4c req-40bf5dd5-7a4f-40a7-baa1-a496c823e8ad service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Refreshing instance network info cache due to event network-changed-bf29f8cc-1793-457b-a4a6-8158d048eac9. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:52:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-db4bfa20-cbe2-4263-8093-4ddad4bd8b4c req-40bf5dd5-7a4f-40a7-baa1-a496c823e8ad service nova] Acquiring lock "refresh_cache-0829b734-daec-4dc6-b24b-cbe89000160c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:52:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-db4bfa20-cbe2-4263-8093-4ddad4bd8b4c req-40bf5dd5-7a4f-40a7-baa1-a496c823e8ad service nova] Acquired lock "refresh_cache-0829b734-daec-4dc6-b24b-cbe89000160c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:52:58 user nova-compute[74669]: DEBUG nova.network.neutron [req-db4bfa20-cbe2-4263-8093-4ddad4bd8b4c req-40bf5dd5-7a4f-40a7-baa1-a496c823e8ad service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Refreshing network info cache for port bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:52:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "refresh_cache-0829b734-daec-4dc6-b24b-cbe89000160c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG nova.network.neutron [req-db4bfa20-cbe2-4263-8093-4ddad4bd8b4c req-40bf5dd5-7a4f-40a7-baa1-a496c823e8ad service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77f42b4b9d8a55c61f5c6daafa24b193b585b71c --force-share --output=json" returned: 0 in 0.200s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77f42b4b9d8a55c61f5c6daafa24b193b585b71c,backing_fmt=raw /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77f42b4b9d8a55c61f5c6daafa24b193b585b71c,backing_fmt=raw /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk 1073741824" returned: 0 in 0.059s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "77f42b4b9d8a55c61f5c6daafa24b193b585b71c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77f42b4b9d8a55c61f5c6daafa24b193b585b71c --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77f42b4b9d8a55c61f5c6daafa24b193b585b71c --force-share --output=json" returned: 0 in 0.238s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG nova.network.neutron [req-db4bfa20-cbe2-4263-8093-4ddad4bd8b4c req-40bf5dd5-7a4f-40a7-baa1-a496c823e8ad service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-db4bfa20-cbe2-4263-8093-4ddad4bd8b4c req-40bf5dd5-7a4f-40a7-baa1-a496c823e8ad service nova] Releasing lock "refresh_cache-0829b734-daec-4dc6-b24b-cbe89000160c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquired lock "refresh_cache-0829b734-daec-4dc6-b24b-cbe89000160c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG nova.network.neutron [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG nova.network.neutron [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Cannot resize image /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Ensure instance console log exists: /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG nova.network.neutron [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Updating instance_info_cache with network_info: [{"id": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "address": "fa:16:3e:36:41:2f", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29f8cc-17", "ovs_interfaceid": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Releasing lock "refresh_cache-0829b734-daec-4dc6-b24b-cbe89000160c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG nova.compute.manager [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Instance network_info: |[{"id": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "address": "fa:16:3e:36:41:2f", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29f8cc-17", "ovs_interfaceid": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 16:52:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Start _get_guest_xml network_info=[{"id": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "address": "fa:16:3e:36:41:2f", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29f8cc-17", "ovs_interfaceid": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:52:52Z,direct_url=<?>,disk_format='qcow2',id=3366e51a-0116-435e-986c-98029c349c7c,min_disk=0,min_ram=0,name='tempest-scenario-img--1653981701',owner='39bcebfdde5c48dc8857824275b0082e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '3366e51a-0116-435e-986c-98029c349c7c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:52:59 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:52:59 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:52:52Z,direct_url=<?>,disk_format='qcow2',id=3366e51a-0116-435e-986c-98029c349c7c,min_disk=0,min_ram=0,name='tempest-scenario-img--1653981701',owner='39bcebfdde5c48dc8857824275b0082e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2095546845',display_name='tempest-TestMinimumBasicScenario-server-2095546845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2095546845',id=10,image_ref='3366e51a-0116-435e-986c-98029c349c7c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDCQBYjn/Hods1dA/c0oPfDp3cwT4dyVCGcb0ID5M60Gd7dyV3FAvOuBsZNEfm3X2qGrL/Vod9cs6+bU5t30ezJJY5GG8nc+IhfueGtZ6S/Q4AyYX+J0/Eq1unC6wT6mw==',key_name='tempest-TestMinimumBasicScenario-1047548378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39bcebfdde5c48dc8857824275b0082e',ramdisk_id='',reservation_id='r-qvrwnzz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3366e51a-0116-435e-986c-98029c349c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1167063302',owner_user_name='tempest-TestMinimumBasicScenario-1167063302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:52:57Z,user_data=None,user_id='d6fd033f262943cdabb12db63b11eca8',uuid=0829b734-daec-4dc6-b24b-cbe89000160c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "address": "fa:16:3e:36:41:2f", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29f8cc-17", "ovs_interfaceid": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Converting VIF {"id": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "address": "fa:16:3e:36:41:2f", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29f8cc-17", "ovs_interfaceid": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:41:2f,bridge_name='br-int',has_traffic_filtering=True,id=bf29f8cc-1793-457b-a4a6-8158d048eac9,network=Network(c618e3db-19f3-4b21-aa37-98985a7bf610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf29f8cc-17') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.objects.instance [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lazy-loading 'pci_devices' on Instance uuid 0829b734-daec-4dc6-b24b-cbe89000160c {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:53:00 user nova-compute[74669]:   <uuid>0829b734-daec-4dc6-b24b-cbe89000160c</uuid>
Nov 08 16:53:00 user nova-compute[74669]:   <name>instance-0000000a</name>
Nov 08 16:53:00 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:53:00 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:53:00 user nova-compute[74669]:   <metadata>
Nov 08 16:53:00 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:53:00 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:53:00 user nova-compute[74669]:       <nova:name>tempest-TestMinimumBasicScenario-server-2095546845</nova:name>
Nov 08 16:53:00 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:52:59</nova:creationTime>
Nov 08 16:53:00 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:53:00 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:53:00 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:53:00 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:53:00 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:53:00 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:53:00 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:53:00 user nova-compute[74669]:       <nova:owner>
Nov 08 16:53:00 user nova-compute[74669]:         <nova:user uuid="d6fd033f262943cdabb12db63b11eca8">tempest-TestMinimumBasicScenario-1167063302-project-member</nova:user>
Nov 08 16:53:00 user nova-compute[74669]:         <nova:project uuid="39bcebfdde5c48dc8857824275b0082e">tempest-TestMinimumBasicScenario-1167063302</nova:project>
Nov 08 16:53:00 user nova-compute[74669]:       </nova:owner>
Nov 08 16:53:00 user nova-compute[74669]:       <nova:root type="image" uuid="3366e51a-0116-435e-986c-98029c349c7c"/>
Nov 08 16:53:00 user nova-compute[74669]:       <nova:ports>
Nov 08 16:53:00 user nova-compute[74669]:         <nova:port uuid="bf29f8cc-1793-457b-a4a6-8158d048eac9">
Nov 08 16:53:00 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 16:53:00 user nova-compute[74669]:         </nova:port>
Nov 08 16:53:00 user nova-compute[74669]:       </nova:ports>
Nov 08 16:53:00 user nova-compute[74669]:     </nova:instance>
Nov 08 16:53:00 user nova-compute[74669]:   </metadata>
Nov 08 16:53:00 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:53:00 user nova-compute[74669]:     <system>
Nov 08 16:53:00 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:53:00 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:53:00 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:53:00 user nova-compute[74669]:       <entry name="serial">0829b734-daec-4dc6-b24b-cbe89000160c</entry>
Nov 08 16:53:00 user nova-compute[74669]:       <entry name="uuid">0829b734-daec-4dc6-b24b-cbe89000160c</entry>
Nov 08 16:53:00 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:53:00 user nova-compute[74669]:     </system>
Nov 08 16:53:00 user nova-compute[74669]:   </sysinfo>
Nov 08 16:53:00 user nova-compute[74669]:   <os>
Nov 08 16:53:00 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:53:00 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 16:53:00 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:53:00 user nova-compute[74669]:   </os>
Nov 08 16:53:00 user nova-compute[74669]:   <features>
Nov 08 16:53:00 user nova-compute[74669]:     <acpi/>
Nov 08 16:53:00 user nova-compute[74669]:     <apic/>
Nov 08 16:53:00 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:53:00 user nova-compute[74669]:   </features>
Nov 08 16:53:00 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:53:00 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:53:00 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:53:00 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:53:00 user nova-compute[74669]:   </clock>
Nov 08 16:53:00 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:53:00 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:53:00 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:53:00 user nova-compute[74669]:   </cpu>
Nov 08 16:53:00 user nova-compute[74669]:   <devices>
Nov 08 16:53:00 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:53:00 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:53:00 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk"/>
Nov 08 16:53:00 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:53:00 user nova-compute[74669]:     </disk>
Nov 08 16:53:00 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:53:00 user nova-compute[74669]:       <mac address="fa:16:3e:36:41:2f"/>
Nov 08 16:53:00 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:53:00 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:53:00 user nova-compute[74669]:       <target dev="tapbf29f8cc-17"/>
Nov 08 16:53:00 user nova-compute[74669]:     </interface>
Nov 08 16:53:00 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:53:00 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/console.log" append="off"/>
Nov 08 16:53:00 user nova-compute[74669]:     </serial>
Nov 08 16:53:00 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:53:00 user nova-compute[74669]:     <video>
Nov 08 16:53:00 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:53:00 user nova-compute[74669]:     </video>
Nov 08 16:53:00 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:53:00 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:53:00 user nova-compute[74669]:     </rng>
Nov 08 16:53:00 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:53:00 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:53:00 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:53:00 user nova-compute[74669]:     </memballoon>
Nov 08 16:53:00 user nova-compute[74669]:   </devices>
Nov 08 16:53:00 user nova-compute[74669]: </domain>
Nov 08 16:53:00 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2095546845',display_name='tempest-TestMinimumBasicScenario-server-2095546845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2095546845',id=10,image_ref='3366e51a-0116-435e-986c-98029c349c7c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDCQBYjn/Hods1dA/c0oPfDp3cwT4dyVCGcb0ID5M60Gd7dyV3FAvOuBsZNEfm3X2qGrL/Vod9cs6+bU5t30ezJJY5GG8nc+IhfueGtZ6S/Q4AyYX+J0/Eq1unC6wT6mw==',key_name='tempest-TestMinimumBasicScenario-1047548378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39bcebfdde5c48dc8857824275b0082e',ramdisk_id='',reservation_id='r-qvrwnzz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3366e51a-0116-435e-986c-98029c349c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1167063302',owner_user_name='tempest-TestMinimumBasicScenario-1167063302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:52:57Z,user_data=None,user_id='d6fd033f262943cdabb12db63b11eca8',uuid=0829b734-daec-4dc6-b24b-cbe89000160c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "address": "fa:16:3e:36:41:2f", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29f8cc-17", "ovs_interfaceid": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Converting VIF {"id": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "address": "fa:16:3e:36:41:2f", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29f8cc-17", "ovs_interfaceid": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:41:2f,bridge_name='br-int',has_traffic_filtering=True,id=bf29f8cc-1793-457b-a4a6-8158d048eac9,network=Network(c618e3db-19f3-4b21-aa37-98985a7bf610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf29f8cc-17') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG os_vif [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:41:2f,bridge_name='br-int',has_traffic_filtering=True,id=bf29f8cc-1793-457b-a4a6-8158d048eac9,network=Network(c618e3db-19f3-4b21-aa37-98985a7bf610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf29f8cc-17') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0fe86aec-a97c-5504-92e1-7e08a9959425', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf29f8cc-17, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf29f8cc-17, col_values=(('qos', UUID('67ac924d-e69b-463a-af44-3db8799054eb')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf29f8cc-17, col_values=(('external_ids', {'iface-id': 'bf29f8cc-1793-457b-a4a6-8158d048eac9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:41:2f', 'vm-uuid': '0829b734-daec-4dc6-b24b-cbe89000160c'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:00 user nova-compute[74669]: INFO os_vif [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:41:2f,bridge_name='br-int',has_traffic_filtering=True,id=bf29f8cc-1793-457b-a4a6-8158d048eac9,network=Network(c618e3db-19f3-4b21-aa37-98985a7bf610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf29f8cc-17')
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] No VIF found with MAC fa:16:3e:36:41:2f, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "220b317c-a111-4600-b1e2-2a63e22de78a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.compute.manager [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 16:53:00 user nova-compute[74669]: INFO nova.compute.claims [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Claim successful on node user
Nov 08 16:53:01 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:53:01 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:53:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.571s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 16:53:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 16:53:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 16:53:01 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 16:53:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 16:53:01 user nova-compute[74669]: INFO nova.virt.block_device [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Booting with volume 734606a5-2915-4dc6-97dd-7ab519822f6e at /dev/vda
Nov 08 16:53:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:01 user nova-compute[74669]: DEBUG nova.policy [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04d5080c9af64051ab23b87414b5ec48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef553fbdfa6a49f5bb2bdde29020e6ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 16:53:01 user nova-compute[74669]: DEBUG os_brick.utils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:53:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f38fa8-97de-418a-9cf5-82edbc472e05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf47d35-7729-4a4f-8fd5-add2c4cfe042]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68d94e0-8f70-42a9-9a16-e5a366e86c0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a184d63-ed0a-4d6f-8f10-e7a3b3f702c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:53:02 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 16:53:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:53:02 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 16:53:02 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff400c14-5970-4691-acda-606ce13725be]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:02 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 16:53:02 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 16:53:02 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 16:53:02 user nova-compute[74669]: DEBUG os_brick.utils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] <== get_connector_properties: return (198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:53:02 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Updating existing volume attachment record: 6d9b072a-8ceb-442e-a815-f6976316e228 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 16:53:02 user nova-compute[74669]: DEBUG nova.compute.manager [req-ed2b54d9-d5c1-4427-83f6-4f83c8148b99 req-bcdda479-68dc-4e2b-b97e-264c7da1e0f0 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received event network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:53:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ed2b54d9-d5c1-4427-83f6-4f83c8148b99 req-bcdda479-68dc-4e2b-b97e-264c7da1e0f0 service nova] Acquiring lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ed2b54d9-d5c1-4427-83f6-4f83c8148b99 req-bcdda479-68dc-4e2b-b97e-264c7da1e0f0 service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ed2b54d9-d5c1-4427-83f6-4f83c8148b99 req-bcdda479-68dc-4e2b-b97e-264c7da1e0f0 service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:02 user nova-compute[74669]: DEBUG nova.compute.manager [req-ed2b54d9-d5c1-4427-83f6-4f83c8148b99 req-bcdda479-68dc-4e2b-b97e-264c7da1e0f0 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] No waiting events found dispatching network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:53:02 user nova-compute[74669]: WARNING nova.compute.manager [req-ed2b54d9-d5c1-4427-83f6-4f83c8148b99 req-bcdda479-68dc-4e2b-b97e-264c7da1e0f0 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received unexpected event network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 for instance with vm_state building and task_state spawning.
Nov 08 16:53:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:03 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Successfully created port: 4514f25c-5ce0-4ba0-95cd-55298ce3e832 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:53:03 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Successfully created port: 8a5cb6f9-4637-4473-a64d-651ebf09be49 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:53:04 user nova-compute[74669]: DEBUG nova.compute.manager [req-e850e7cf-5b6f-4107-9c2c-10aa31459258 req-89ea5bd0-3c23-48f5-b599-d8bb272b1ae0 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received event network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:53:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e850e7cf-5b6f-4107-9c2c-10aa31459258 req-89ea5bd0-3c23-48f5-b599-d8bb272b1ae0 service nova] Acquiring lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e850e7cf-5b6f-4107-9c2c-10aa31459258 req-89ea5bd0-3c23-48f5-b599-d8bb272b1ae0 service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e850e7cf-5b6f-4107-9c2c-10aa31459258 req-89ea5bd0-3c23-48f5-b599-d8bb272b1ae0 service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:04 user nova-compute[74669]: DEBUG nova.compute.manager [req-e850e7cf-5b6f-4107-9c2c-10aa31459258 req-89ea5bd0-3c23-48f5-b599-d8bb272b1ae0 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] No waiting events found dispatching network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:53:04 user nova-compute[74669]: WARNING nova.compute.manager [req-e850e7cf-5b6f-4107-9c2c-10aa31459258 req-89ea5bd0-3c23-48f5-b599-d8bb272b1ae0 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received unexpected event network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 for instance with vm_state building and task_state spawning.
Nov 08 16:53:04 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Successfully created port: e7639563-89fb-44bf-89e2-ca44e79ad44a {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:53:04 user nova-compute[74669]: DEBUG nova.compute.manager [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 16:53:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 16:53:04 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Instance spawned successfully.
Nov 08 16:53:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 16:53:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:53:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:53:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:53:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:53:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:53:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:53:04 user nova-compute[74669]: INFO nova.compute.manager [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Took 7.60 seconds to spawn the instance on the hypervisor.
Nov 08 16:53:04 user nova-compute[74669]: DEBUG nova.compute.manager [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:53:05 user nova-compute[74669]: INFO nova.compute.manager [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Took 8.61 seconds to build instance.
Nov 08 16:53:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54a6d7b0-c2b2-4473-8c6c-606e60e255ae tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "0829b734-daec-4dc6-b24b-cbe89000160c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.740s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:05 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Successfully created port: bcee60b9-29f1-49cd-b769-d3dbf7b0f11d {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:53:06 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Successfully created port: 6f6856bd-1e1d-406b-8d39-7f3f288d135b {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:53:07 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Successfully updated port: 4514f25c-5ce0-4ba0-95cd-55298ce3e832 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:53:07 user nova-compute[74669]: DEBUG nova.compute.manager [req-01b52e8f-3de8-4b13-ba48-f4d58aaeb1b2 req-e8e0474e-9340-4c26-aefb-3a1b9d243c41 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-changed-4514f25c-5ce0-4ba0-95cd-55298ce3e832 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:53:07 user nova-compute[74669]: DEBUG nova.compute.manager [req-01b52e8f-3de8-4b13-ba48-f4d58aaeb1b2 req-e8e0474e-9340-4c26-aefb-3a1b9d243c41 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Refreshing instance network info cache due to event network-changed-4514f25c-5ce0-4ba0-95cd-55298ce3e832. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:53:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-01b52e8f-3de8-4b13-ba48-f4d58aaeb1b2 req-e8e0474e-9340-4c26-aefb-3a1b9d243c41 service nova] Acquiring lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:53:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-01b52e8f-3de8-4b13-ba48-f4d58aaeb1b2 req-e8e0474e-9340-4c26-aefb-3a1b9d243c41 service nova] Acquired lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:53:07 user nova-compute[74669]: DEBUG nova.network.neutron [req-01b52e8f-3de8-4b13-ba48-f4d58aaeb1b2 req-e8e0474e-9340-4c26-aefb-3a1b9d243c41 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Refreshing network info cache for port 4514f25c-5ce0-4ba0-95cd-55298ce3e832 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:53:07 user nova-compute[74669]: DEBUG nova.network.neutron [req-01b52e8f-3de8-4b13-ba48-f4d58aaeb1b2 req-e8e0474e-9340-4c26-aefb-3a1b9d243c41 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:53:07 user nova-compute[74669]: DEBUG nova.network.neutron [req-01b52e8f-3de8-4b13-ba48-f4d58aaeb1b2 req-e8e0474e-9340-4c26-aefb-3a1b9d243c41 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:53:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-01b52e8f-3de8-4b13-ba48-f4d58aaeb1b2 req-e8e0474e-9340-4c26-aefb-3a1b9d243c41 service nova] Releasing lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:53:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:07 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Successfully updated port: 48f5d804-7e38-4c85-af5e-ab6e55c736ac {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:53:08 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Successfully updated port: 263210b8-c77f-49af-a1c0-146dcb0a5dc5 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:53:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-07155db8-a36f-4d54-b510-2eb7f7df97c5 req-8e47b982-4956-4116-8bd1-cde3bb1b47b6 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-changed-48f5d804-7e38-4c85-af5e-ab6e55c736ac {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:53:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-07155db8-a36f-4d54-b510-2eb7f7df97c5 req-8e47b982-4956-4116-8bd1-cde3bb1b47b6 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Refreshing instance network info cache due to event network-changed-48f5d804-7e38-4c85-af5e-ab6e55c736ac. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:53:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-07155db8-a36f-4d54-b510-2eb7f7df97c5 req-8e47b982-4956-4116-8bd1-cde3bb1b47b6 service nova] Acquiring lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:53:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-07155db8-a36f-4d54-b510-2eb7f7df97c5 req-8e47b982-4956-4116-8bd1-cde3bb1b47b6 service nova] Acquired lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:53:09 user nova-compute[74669]: DEBUG nova.network.neutron [req-07155db8-a36f-4d54-b510-2eb7f7df97c5 req-8e47b982-4956-4116-8bd1-cde3bb1b47b6 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Refreshing network info cache for port 48f5d804-7e38-4c85-af5e-ab6e55c736ac {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:53:09 user nova-compute[74669]: DEBUG nova.network.neutron [req-07155db8-a36f-4d54-b510-2eb7f7df97c5 req-8e47b982-4956-4116-8bd1-cde3bb1b47b6 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:53:09 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Successfully updated port: 8a5cb6f9-4637-4473-a64d-651ebf09be49 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:53:09 user nova-compute[74669]: DEBUG nova.network.neutron [req-07155db8-a36f-4d54-b510-2eb7f7df97c5 req-8e47b982-4956-4116-8bd1-cde3bb1b47b6 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:53:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-07155db8-a36f-4d54-b510-2eb7f7df97c5 req-8e47b982-4956-4116-8bd1-cde3bb1b47b6 service nova] Releasing lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:53:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-07155db8-a36f-4d54-b510-2eb7f7df97c5 req-8e47b982-4956-4116-8bd1-cde3bb1b47b6 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-changed-263210b8-c77f-49af-a1c0-146dcb0a5dc5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:53:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-07155db8-a36f-4d54-b510-2eb7f7df97c5 req-8e47b982-4956-4116-8bd1-cde3bb1b47b6 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Refreshing instance network info cache due to event network-changed-263210b8-c77f-49af-a1c0-146dcb0a5dc5. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:53:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-07155db8-a36f-4d54-b510-2eb7f7df97c5 req-8e47b982-4956-4116-8bd1-cde3bb1b47b6 service nova] Acquiring lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:53:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-07155db8-a36f-4d54-b510-2eb7f7df97c5 req-8e47b982-4956-4116-8bd1-cde3bb1b47b6 service nova] Acquired lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:53:09 user nova-compute[74669]: DEBUG nova.network.neutron [req-07155db8-a36f-4d54-b510-2eb7f7df97c5 req-8e47b982-4956-4116-8bd1-cde3bb1b47b6 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Refreshing network info cache for port 263210b8-c77f-49af-a1c0-146dcb0a5dc5 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:53:09 user nova-compute[74669]: DEBUG nova.network.neutron [req-07155db8-a36f-4d54-b510-2eb7f7df97c5 req-8e47b982-4956-4116-8bd1-cde3bb1b47b6 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:53:09 user nova-compute[74669]: DEBUG nova.network.neutron [req-07155db8-a36f-4d54-b510-2eb7f7df97c5 req-8e47b982-4956-4116-8bd1-cde3bb1b47b6 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:53:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-07155db8-a36f-4d54-b510-2eb7f7df97c5 req-8e47b982-4956-4116-8bd1-cde3bb1b47b6 service nova] Releasing lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:53:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:11 user nova-compute[74669]: DEBUG nova.compute.manager [req-9cfccb49-dfb4-47eb-bae4-49c9325320f3 req-f1d01d8e-811c-4c6b-acbc-32a3fb68adfd service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-changed-8a5cb6f9-4637-4473-a64d-651ebf09be49 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:53:11 user nova-compute[74669]: DEBUG nova.compute.manager [req-9cfccb49-dfb4-47eb-bae4-49c9325320f3 req-f1d01d8e-811c-4c6b-acbc-32a3fb68adfd service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Refreshing instance network info cache due to event network-changed-8a5cb6f9-4637-4473-a64d-651ebf09be49. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:53:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9cfccb49-dfb4-47eb-bae4-49c9325320f3 req-f1d01d8e-811c-4c6b-acbc-32a3fb68adfd service nova] Acquiring lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:53:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9cfccb49-dfb4-47eb-bae4-49c9325320f3 req-f1d01d8e-811c-4c6b-acbc-32a3fb68adfd service nova] Acquired lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:53:11 user nova-compute[74669]: DEBUG nova.network.neutron [req-9cfccb49-dfb4-47eb-bae4-49c9325320f3 req-f1d01d8e-811c-4c6b-acbc-32a3fb68adfd service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Refreshing network info cache for port 8a5cb6f9-4637-4473-a64d-651ebf09be49 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:53:11 user nova-compute[74669]: DEBUG nova.network.neutron [req-9cfccb49-dfb4-47eb-bae4-49c9325320f3 req-f1d01d8e-811c-4c6b-acbc-32a3fb68adfd service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:53:11 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Successfully updated port: e7639563-89fb-44bf-89e2-ca44e79ad44a {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:53:11 user nova-compute[74669]: DEBUG nova.network.neutron [req-9cfccb49-dfb4-47eb-bae4-49c9325320f3 req-f1d01d8e-811c-4c6b-acbc-32a3fb68adfd service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:53:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9cfccb49-dfb4-47eb-bae4-49c9325320f3 req-f1d01d8e-811c-4c6b-acbc-32a3fb68adfd service nova] Releasing lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:53:12 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Successfully updated port: bcee60b9-29f1-49cd-b769-d3dbf7b0f11d {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:53:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:13 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Successfully updated port: 6f6856bd-1e1d-406b-8d39-7f3f288d135b {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:53:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Acquiring lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:53:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Acquired lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:53:13 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:53:13 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:53:13 user nova-compute[74669]: DEBUG nova.compute.manager [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Received event network-changed-23885293-c9aa-41f9-a4b3-1d2fe6a5819e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:53:13 user nova-compute[74669]: DEBUG nova.compute.manager [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Refreshing instance network info cache due to event network-changed-23885293-c9aa-41f9-a4b3-1d2fe6a5819e. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:53:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] Acquiring lock "refresh_cache-2d42d5ce-db73-40e6-9b35-f662a3cf0091" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:53:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] Acquired lock "refresh_cache-2d42d5ce-db73-40e6-9b35-f662a3cf0091" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:53:13 user nova-compute[74669]: DEBUG nova.network.neutron [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Refreshing network info cache for port 23885293-c9aa-41f9-a4b3-1d2fe6a5819e {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:53:13 user nova-compute[74669]: DEBUG nova.network.neutron [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Updated VIF entry in instance network info cache for port 23885293-c9aa-41f9-a4b3-1d2fe6a5819e. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:53:13 user nova-compute[74669]: DEBUG nova.network.neutron [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Updating instance_info_cache with network_info: [{"id": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "address": "fa:16:3e:53:bc:e0", "network": {"id": "387522d7-947f-4a57-b80b-cefb0257df3e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-177095636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6f55d1187334b6b9099a9fd647aa721", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23885293-c9", "ovs_interfaceid": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:53:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] Releasing lock "refresh_cache-2d42d5ce-db73-40e6-9b35-f662a3cf0091" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:53:14 user nova-compute[74669]: DEBUG nova.compute.manager [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-changed-e7639563-89fb-44bf-89e2-ca44e79ad44a {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:53:14 user nova-compute[74669]: DEBUG nova.compute.manager [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Refreshing instance network info cache due to event network-changed-e7639563-89fb-44bf-89e2-ca44e79ad44a. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:53:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] Acquiring lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:53:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:15 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Updating instance_info_cache with network_info: [{"id": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "address": "fa:16:3e:43:30:8e", "network": {"id": "8718876b-101b-476e-bede-b881ac6c346f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-189935542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4514f25c-5c", "ovs_interfaceid": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "address": "fa:16:3e:aa:ef:0f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f5d804-7e", "ovs_interfaceid": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "address": "fa:16:3e:0b:c0:66", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap263210b8-c7", "ovs_interfaceid": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "address": "fa:16:3e:87:0f:90", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5cb6f9-46", "ovs_interfaceid": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "address": "fa:16:3e:76:80:9f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7639563-89", "ovs_interfaceid": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "address": "fa:16:3e:20:ca:e1", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcee60b9-29", "ovs_interfaceid": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "address": "fa:16:3e:c4:68:51", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6856bd-1e", "ovs_interfaceid": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:53:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Releasing lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:53:15 user nova-compute[74669]: DEBUG nova.compute.manager [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Instance network_info: |[{"id": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "address": "fa:16:3e:43:30:8e", "network": {"id": "8718876b-101b-476e-bede-b881ac6c346f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-189935542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4514f25c-5c", "ovs_interfaceid": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "address": "fa:16:3e:aa:ef:0f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f5d804-7e", "ovs_interfaceid": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "address": "fa:16:3e:0b:c0:66", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap263210b8-c7", "ovs_interfaceid": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "address": "fa:16:3e:87:0f:90", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5cb6f9-46", "ovs_interfaceid": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "address": "fa:16:3e:76:80:9f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7639563-89", "ovs_interfaceid": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "address": "fa:16:3e:20:ca:e1", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcee60b9-29", "ovs_interfaceid": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "address": "fa:16:3e:c4:68:51", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6856bd-1e", "ovs_interfaceid": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 16:53:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] Acquired lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:53:15 user nova-compute[74669]: DEBUG nova.network.neutron [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Refreshing network info cache for port e7639563-89fb-44bf-89e2-ca44e79ad44a {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:53:15 user nova-compute[74669]: DEBUG nova.network.neutron [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Updated VIF entry in instance network info cache for port e7639563-89fb-44bf-89e2-ca44e79ad44a. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:53:15 user nova-compute[74669]: DEBUG nova.network.neutron [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Updating instance_info_cache with network_info: [{"id": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "address": "fa:16:3e:43:30:8e", "network": {"id": "8718876b-101b-476e-bede-b881ac6c346f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-189935542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4514f25c-5c", "ovs_interfaceid": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "address": "fa:16:3e:aa:ef:0f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f5d804-7e", "ovs_interfaceid": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "address": "fa:16:3e:0b:c0:66", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap263210b8-c7", "ovs_interfaceid": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "address": "fa:16:3e:87:0f:90", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5cb6f9-46", "ovs_interfaceid": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "address": "fa:16:3e:76:80:9f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7639563-89", "ovs_interfaceid": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "address": "fa:16:3e:20:ca:e1", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcee60b9-29", "ovs_interfaceid": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "address": "fa:16:3e:c4:68:51", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6856bd-1e", "ovs_interfaceid": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:53:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] Releasing lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:53:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-changed-bcee60b9-29f1-49cd-b769-d3dbf7b0f11d {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:53:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Refreshing instance network info cache due to event network-changed-bcee60b9-29f1-49cd-b769-d3dbf7b0f11d. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:53:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] Acquiring lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:53:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] Acquired lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:53:15 user nova-compute[74669]: DEBUG nova.network.neutron [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Refreshing network info cache for port bcee60b9-29f1-49cd-b769-d3dbf7b0f11d {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:53:16 user nova-compute[74669]: DEBUG nova.network.neutron [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Updated VIF entry in instance network info cache for port bcee60b9-29f1-49cd-b769-d3dbf7b0f11d. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:53:16 user nova-compute[74669]: DEBUG nova.network.neutron [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Updating instance_info_cache with network_info: [{"id": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "address": "fa:16:3e:43:30:8e", "network": {"id": "8718876b-101b-476e-bede-b881ac6c346f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-189935542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4514f25c-5c", "ovs_interfaceid": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "address": "fa:16:3e:aa:ef:0f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f5d804-7e", "ovs_interfaceid": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "address": "fa:16:3e:0b:c0:66", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap263210b8-c7", "ovs_interfaceid": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "address": "fa:16:3e:87:0f:90", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5cb6f9-46", "ovs_interfaceid": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "address": "fa:16:3e:76:80:9f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7639563-89", "ovs_interfaceid": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "address": "fa:16:3e:20:ca:e1", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcee60b9-29", "ovs_interfaceid": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "address": "fa:16:3e:c4:68:51", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6856bd-1e", "ovs_interfaceid": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:53:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] Releasing lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:53:16 user nova-compute[74669]: DEBUG nova.compute.manager [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-changed-6f6856bd-1e1d-406b-8d39-7f3f288d135b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:53:16 user nova-compute[74669]: DEBUG nova.compute.manager [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Refreshing instance network info cache due to event network-changed-6f6856bd-1e1d-406b-8d39-7f3f288d135b. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:53:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] Acquiring lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:53:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] Acquired lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:53:16 user nova-compute[74669]: DEBUG nova.network.neutron [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Refreshing network info cache for port 6f6856bd-1e1d-406b-8d39-7f3f288d135b {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:53:17 user nova-compute[74669]: DEBUG nova.network.neutron [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Updated VIF entry in instance network info cache for port 6f6856bd-1e1d-406b-8d39-7f3f288d135b. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:53:17 user nova-compute[74669]: DEBUG nova.network.neutron [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Updating instance_info_cache with network_info: [{"id": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "address": "fa:16:3e:43:30:8e", "network": {"id": "8718876b-101b-476e-bede-b881ac6c346f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-189935542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4514f25c-5c", "ovs_interfaceid": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "address": "fa:16:3e:aa:ef:0f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f5d804-7e", "ovs_interfaceid": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "address": "fa:16:3e:0b:c0:66", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap263210b8-c7", "ovs_interfaceid": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "address": "fa:16:3e:87:0f:90", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5cb6f9-46", "ovs_interfaceid": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "address": "fa:16:3e:76:80:9f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7639563-89", "ovs_interfaceid": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "address": "fa:16:3e:20:ca:e1", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcee60b9-29", "ovs_interfaceid": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "address": "fa:16:3e:c4:68:51", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6856bd-1e", "ovs_interfaceid": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:53:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b440ff8b-2c4a-42a3-bc42-a5c1e61cde6b req-4c9668b5-4303-4b6c-b77d-b90544b19dee service nova] Releasing lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:53:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:18 user nova-compute[74669]: DEBUG nova.objects.instance [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lazy-loading 'flavor' on Instance uuid 2d42d5ce-db73-40e6-9b35-f662a3cf0091 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:53:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:19 user nova-compute[74669]: INFO nova.compute.manager [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Attaching volume c26382ef-45b7-4063-974b-908194781549 to /dev/vdb
Nov 08 16:53:19 user nova-compute[74669]: DEBUG os_brick.utils [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c98e3ff-8583-463f-a0f1-addfee1bbd38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf0ba63-756f-473b-85f9-032c619dbc83]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86b9da4-5aec-4b4c-9d0d-34d5183d80f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[95354e6a-1e7c-459c-88ad-3804a347a77f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:53:19 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 16:53:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[935b3ff7-5c86-4c95-976d-541a16c3f691]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG os_brick.utils [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Updating existing volume attachment record: 9f8670fb-0383-4771-b058-39a1d99652eb {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG os_brick.initiator.connector [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Factory for ISCSI on None {{(pid=74669) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.152s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kiXxWsny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:53:19 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:53:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:53:19 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:53:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:53:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:53:19 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 16:53:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd9c8a8-966f-41f6-8e51-fb25cf767060]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 16:53:20 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec610e6b-5f51-4c82-851f-053939393502]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed] added
Nov 08 16:53:20 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e15dda3-be56-4b18-89d5-4e677aca6a1f]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ffd9c9-9721-4476-a8f2-5fbb6fde58ee]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kiXxWsny {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kiXxWsny" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e94e19-8ab7-4281-99be-b8926e6b383a]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kiXxWsny'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1345a45-b874-43f6-a170-b87915b0be66]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5700e6e3-2fb0-4cea-869a-f11c533050dd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 16:53:20 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 16:53:20 user nova-compute[74669]:  {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:53:20 user nova-compute[74669]: WARNING os_brick.initiator.connectors.iscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 16:53:20 user nova-compute[74669]: 
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a89dad-9a06-485d-ba24-bdd9feb2e07b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed, portal: 172.16.0.220,3260]
Nov 08 16:53:20 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed, portal: 172.16.0.220,3260] successful.
Nov 08 16:53:20 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30afb55-21c9-4814-a23f-3b6ce45717d3]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf25a079-e727-4a39-80e7-c31ac0febd68]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed (non-flash)
Nov 08 16:53:20 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed (non-flash)
Nov 08 16:53:20 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4158d407-e087-40be-b626-342163300184]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kiXxWsny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG nova.compute.manager [req-3f72bab2-db80-4bc0-b1f4-80e5357146d1 req-618bf21d-be31-409a-b83b-74ca2d7bb996 service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Received event network-changed-1b0ec571-edb1-4c11-bbeb-24123bd96f09 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG nova.compute.manager [req-3f72bab2-db80-4bc0-b1f4-80e5357146d1 req-618bf21d-be31-409a-b83b-74ca2d7bb996 service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Refreshing instance network info cache due to event network-changed-1b0ec571-edb1-4c11-bbeb-24123bd96f09. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3f72bab2-db80-4bc0-b1f4-80e5357146d1 req-618bf21d-be31-409a-b83b-74ca2d7bb996 service nova] Acquiring lock "refresh_cache-af94bfaa-45bc-4bac-9594-f363fce8727e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3f72bab2-db80-4bc0-b1f4-80e5357146d1 req-618bf21d-be31-409a-b83b-74ca2d7bb996 service nova] Acquired lock "refresh_cache-af94bfaa-45bc-4bac-9594-f363fce8727e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:53:20 user nova-compute[74669]: DEBUG nova.network.neutron [req-3f72bab2-db80-4bc0-b1f4-80e5357146d1 req-618bf21d-be31-409a-b83b-74ca2d7bb996 service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Refreshing network info cache for port 1b0ec571-edb1-4c11-bbeb-24123bd96f09 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Acquiring lock "af94bfaa-45bc-4bac-9594-f363fce8727e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Lock "af94bfaa-45bc-4bac-9594-f363fce8727e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG nova.objects.instance [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Lazy-loading 'flavor' on Instance uuid af94bfaa-45bc-4bac-9594-f363fce8727e {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Lock "af94bfaa-45bc-4bac-9594-f363fce8727e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG nova.network.neutron [req-3f72bab2-db80-4bc0-b1f4-80e5357146d1 req-618bf21d-be31-409a-b83b-74ca2d7bb996 service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Updated VIF entry in instance network info cache for port 1b0ec571-edb1-4c11-bbeb-24123bd96f09. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG nova.network.neutron [req-3f72bab2-db80-4bc0-b1f4-80e5357146d1 req-618bf21d-be31-409a-b83b-74ca2d7bb996 service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Updating instance_info_cache with network_info: [{"id": "1b0ec571-edb1-4c11-bbeb-24123bd96f09", "address": "fa:16:3e:2c:9a:3e", "network": {"id": "d4ab50d4-89ec-4706-b8bc-2fd83ae1d0df", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2136930753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48aa79104ae4b668b0b73c6b3e2b18c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0ec571-ed", "ovs_interfaceid": "1b0ec571-edb1-4c11-bbeb-24123bd96f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3f72bab2-db80-4bc0-b1f4-80e5357146d1 req-618bf21d-be31-409a-b83b-74ca2d7bb996 service nova] Releasing lock "refresh_cache-af94bfaa-45bc-4bac-9594-f363fce8727e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26333623233396564', 'path': '/dev/sdb'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333623233396564', 'path': '/dev/sdb'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG nova.objects.instance [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lazy-loading 'flavor' on Instance uuid fc2b779e-b58d-4e45-8789-91c4b452ee0b {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Acquiring lock "af94bfaa-45bc-4bac-9594-f363fce8727e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Lock "af94bfaa-45bc-4bac-9594-f363fce8727e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:21 user nova-compute[74669]: INFO nova.compute.manager [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Attaching volume 133613f9-81c9-4bdb-afc9-8279252a2724 to /dev/vdb
Nov 08 16:53:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 16:53:21 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:53:21 user nova-compute[74669]:   <source dev="/dev/sdb"/>
Nov 08 16:53:21 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:53:21 user nova-compute[74669]:   <serial>edecd289-026b-4f6a-9984-dd105f8e72ed</serial>
Nov 08 16:53:21 user nova-compute[74669]: </disk>
Nov 08 16:53:21 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG os_brick.utils [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c71ce6b-ae5c-4a4e-9399-f1b85dab0470]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6f1325-bea2-4afe-88c0-d304cb6c44b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[89675896-b0f1-412c-b8c4-87086e71ce89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfce2586-24c3-42cd-a7eb-18c8485ee0d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:53:21 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 16:53:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a01a593-0ff5-4215-bbef-ed06136e8188]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG os_brick.utils [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Updating existing volume attachment record: 8f83141b-8bd4-4602-810a-6d343636a17d {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:53:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] No VIF found with MAC fa:16:3e:74:7e:b6, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:53:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-18a69b7b-7782-4bca-b531-5df044ac950a tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 39.156s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Acquiring lock "725977e4-d011-4c79-b8bc-39bed9649515" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Lock "725977e4-d011-4c79-b8bc-39bed9649515" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Acquiring lock "725977e4-d011-4c79-b8bc-39bed9649515-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Lock "725977e4-d011-4c79-b8bc-39bed9649515-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Lock "725977e4-d011-4c79-b8bc-39bed9649515-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:28 user nova-compute[74669]: INFO nova.compute.manager [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Terminating instance
Nov 08 16:53:28 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 16:53:28 user nova-compute[74669]: INFO nova.virt.block_device [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Booting with volume 391df8b1-b8a5-4886-9a8c-87fb65dfc5eb at /dev/vdb
Nov 08 16:53:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-d27b01cc-c3e9-4616-8279-3a973655fe5b req-ca5f045d-3f99-4473-a3ee-411da31ff4f9 service nova] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Received event network-vif-unplugged-85a996ca-5cd2-468a-a1b1-55f5c882a624 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d27b01cc-c3e9-4616-8279-3a973655fe5b req-ca5f045d-3f99-4473-a3ee-411da31ff4f9 service nova] Acquiring lock "725977e4-d011-4c79-b8bc-39bed9649515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d27b01cc-c3e9-4616-8279-3a973655fe5b req-ca5f045d-3f99-4473-a3ee-411da31ff4f9 service nova] Lock "725977e4-d011-4c79-b8bc-39bed9649515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d27b01cc-c3e9-4616-8279-3a973655fe5b req-ca5f045d-3f99-4473-a3ee-411da31ff4f9 service nova] Lock "725977e4-d011-4c79-b8bc-39bed9649515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-d27b01cc-c3e9-4616-8279-3a973655fe5b req-ca5f045d-3f99-4473-a3ee-411da31ff4f9 service nova] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] No waiting events found dispatching network-vif-unplugged-85a996ca-5cd2-468a-a1b1-55f5c882a624 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-d27b01cc-c3e9-4616-8279-3a973655fe5b req-ca5f045d-3f99-4473-a3ee-411da31ff4f9 service nova] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Received event network-vif-unplugged-85a996ca-5cd2-468a-a1b1-55f5c882a624 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG os_brick.utils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbe49a3-0098-4e45-98a9-a7464ed50bca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed730308-cbdf-41fe-94fc-aa9607902581]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[59385ddf-7e34-4150-a8e1-f442a54a729e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d14855-b9fa-449a-ada0-b4ef52f0c20b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:53:29 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f76fd38-8286-4e03-92b8-9b047bcd756e]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG os_brick.utils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Updating existing volume attachment record: 19b54406-ec2e-4581-8c50-447a878ebc4a {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Acquiring lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Acquiring lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:29 user nova-compute[74669]: INFO nova.compute.manager [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Terminating instance
Nov 08 16:53:29 user nova-compute[74669]: DEBUG nova.compute.manager [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:29 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Instance destroyed successfully.
Nov 08 16:53:29 user nova-compute[74669]: DEBUG nova.objects.instance [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Lazy-loading 'resources' on Instance uuid 725977e4-d011-4c79-b8bc-39bed9649515 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:51:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1781888160',display_name='tempest-VolumesActionsTest-instance-1781888160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1781888160',id=6,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:51:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3efb4b77179e4bb293fb6c2c78f9c4b3',ramdisk_id='',reservation_id='r-tcviqwz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-137413693',owner_user_name='tempest-VolumesActionsTest-137413693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:51:17Z,user_data=None,user_id='fb8d9223b6c148158b55f12592e2a800',uuid=725977e4-d011-4c79-b8bc-39bed9649515,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85a996ca-5cd2-468a-a1b1-55f5c882a624", "address": "fa:16:3e:69:c3:30", "network": {"id": "47a98eee-3da5-4b15-891c-f11bee25b2ce", "bridge": "br-int", "label": "tempest-VolumesActionsTest-829228011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efb4b77179e4bb293fb6c2c78f9c4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a996ca-5c", "ovs_interfaceid": "85a996ca-5cd2-468a-a1b1-55f5c882a624", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Converting VIF {"id": "85a996ca-5cd2-468a-a1b1-55f5c882a624", "address": "fa:16:3e:69:c3:30", "network": {"id": "47a98eee-3da5-4b15-891c-f11bee25b2ce", "bridge": "br-int", "label": "tempest-VolumesActionsTest-829228011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3efb4b77179e4bb293fb6c2c78f9c4b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85a996ca-5c", "ovs_interfaceid": "85a996ca-5cd2-468a-a1b1-55f5c882a624", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:c3:30,bridge_name='br-int',has_traffic_filtering=True,id=85a996ca-5cd2-468a-a1b1-55f5c882a624,network=Network(47a98eee-3da5-4b15-891c-f11bee25b2ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a996ca-5c') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG os_vif [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c3:30,bridge_name='br-int',has_traffic_filtering=True,id=85a996ca-5cd2-468a-a1b1-55f5c882a624,network=Network(47a98eee-3da5-4b15-891c-f11bee25b2ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a996ca-5c') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85a996ca-5c, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e98dcd6c-4dd3-440c-93fc-72fee0cec66c) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:29 user nova-compute[74669]: INFO os_vif [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c3:30,bridge_name='br-int',has_traffic_filtering=True,id=85a996ca-5cd2-468a-a1b1-55f5c882a624,network=Network(47a98eee-3da5-4b15-891c-f11bee25b2ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85a996ca-5c')
Nov 08 16:53:29 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Deleting instance files /opt/stack/data/nova/instances/725977e4-d011-4c79-b8bc-39bed9649515_del
Nov 08 16:53:29 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Deletion of /opt/stack/data/nova/instances/725977e4-d011-4c79-b8bc-39bed9649515_del complete
Nov 08 16:53:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-ad0f3045-beed-4a0e-a349-889fa2fe478d req-e5f26d21-5827-44b9-8089-53c3bfe8e83f service nova] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Received event network-vif-unplugged-542b5f60-bd62-4bb3-a644-b7d92762bca0 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ad0f3045-beed-4a0e-a349-889fa2fe478d req-e5f26d21-5827-44b9-8089-53c3bfe8e83f service nova] Acquiring lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ad0f3045-beed-4a0e-a349-889fa2fe478d req-e5f26d21-5827-44b9-8089-53c3bfe8e83f service nova] Lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ad0f3045-beed-4a0e-a349-889fa2fe478d req-e5f26d21-5827-44b9-8089-53c3bfe8e83f service nova] Lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-ad0f3045-beed-4a0e-a349-889fa2fe478d req-e5f26d21-5827-44b9-8089-53c3bfe8e83f service nova] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] No waiting events found dispatching network-vif-unplugged-542b5f60-bd62-4bb3-a644-b7d92762bca0 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-ad0f3045-beed-4a0e-a349-889fa2fe478d req-e5f26d21-5827-44b9-8089-53c3bfe8e83f service nova] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Received event network-vif-unplugged-542b5f60-bd62-4bb3-a644-b7d92762bca0 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 16:53:29 user nova-compute[74669]: INFO nova.compute.manager [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 08 16:53:29 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 16:53:29 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:30 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Instance destroyed successfully.
Nov 08 16:53:30 user nova-compute[74669]: DEBUG nova.objects.instance [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lazy-loading 'resources' on Instance uuid fc2b779e-b58d-4e45-8789-91c4b452ee0b {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1277285756',display_name='tempest-DeleteServersTestJSON-server-1277285756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1277285756',id=2,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:51:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e30fcd3be58646a0b81fbc97acec8b13',ramdisk_id='',reservation_id='r-q0ycnv0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-542902835',owner_user_name='tempest-DeleteServersTestJSON-542902835-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:51:07Z,user_data=None,user_id='5659ee7ffe7c4630871d1e0bcbf13bd0',uuid=fc2b779e-b58d-4e45-8789-91c4b452ee0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "542b5f60-bd62-4bb3-a644-b7d92762bca0", "address": "fa:16:3e:74:7e:b6", "network": {"id": "7e5f6d1e-96bc-4b2c-a3a9-0b83a29d636f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-76294675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e30fcd3be58646a0b81fbc97acec8b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542b5f60-bd", "ovs_interfaceid": "542b5f60-bd62-4bb3-a644-b7d92762bca0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Converting VIF {"id": "542b5f60-bd62-4bb3-a644-b7d92762bca0", "address": "fa:16:3e:74:7e:b6", "network": {"id": "7e5f6d1e-96bc-4b2c-a3a9-0b83a29d636f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-76294675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e30fcd3be58646a0b81fbc97acec8b13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542b5f60-bd", "ovs_interfaceid": "542b5f60-bd62-4bb3-a644-b7d92762bca0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:7e:b6,bridge_name='br-int',has_traffic_filtering=True,id=542b5f60-bd62-4bb3-a644-b7d92762bca0,network=Network(7e5f6d1e-96bc-4b2c-a3a9-0b83a29d636f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap542b5f60-bd') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG os_vif [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:7e:b6,bridge_name='br-int',has_traffic_filtering=True,id=542b5f60-bd62-4bb3-a644-b7d92762bca0,network=Network(7e5f6d1e-96bc-4b2c-a3a9-0b83a29d636f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap542b5f60-bd') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap542b5f60-bd, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4be2f4ee-77c9-4dec-ad43-c79dfcf9fa3d) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:30 user nova-compute[74669]: INFO os_vif [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:7e:b6,bridge_name='br-int',has_traffic_filtering=True,id=542b5f60-bd62-4bb3-a644-b7d92762bca0,network=Network(7e5f6d1e-96bc-4b2c-a3a9-0b83a29d636f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap542b5f60-bd')
Nov 08 16:53:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kiXxWsny', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:53:30 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:53:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[717768e4-8df2-42bf-85ba-1c6e5282ceb9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 16:53:30 user nova-compute[74669]: No targets found.
Nov 08 16:53:30 user nova-compute[74669]: iSNS:
Nov 08 16:53:30 user nova-compute[74669]: No targets found.
Nov 08 16:53:30 user nova-compute[74669]: STATIC:
Nov 08 16:53:30 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed
Nov 08 16:53:30 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:53:30 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:53:30 user nova-compute[74669]: FIRMWARE:
Nov 08 16:53:30 user nova-compute[74669]: No targets found.
Nov 08 16:53:30 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 16:53:30 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 16:53:30 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb51956-479d-4e38-bc52-de439282659e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[931eddfc-c32e-4f9f-8908-d4bc34c83a8d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed (non-flash)
Nov 08 16:53:30 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed (non-flash)
Nov 08 16:53:30 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9a85a8d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed'): ({'sdb'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Removing single pathed devices sdb {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5477d4f-124a-4001-a0bb-3940e468add7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a87895-f9bf-48ca-8532-825e7222fd8f]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Flushing IO for device /dev/sdb {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5f8bbf-8305-4a90-97db-d6cffb026783]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc5fbb9-e6a5-421a-93d3-4eb88b88ddeb]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbdce48-525b-4947-bb6e-6880d58c3515]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda3c4cd-f544-4ffd-8d61-5af24e586ae1]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed, portal: 172.16.0.220,3260]
Nov 08 16:53:30 user nova-compute[74669]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed, portal: 172.16.0.220,3260] successful.
Nov 08 16:53:30 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edecd289-026b-4f6a-9984-dd105f8e72ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fe14a3-c346-4af4-a525-b6cfc8a53b84]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] <== disconnect_volume: return (324ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 16:53:30 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Deleting instance files /opt/stack/data/nova/instances/fc2b779e-b58d-4e45-8789-91c4b452ee0b_del
Nov 08 16:53:30 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Deletion of /opt/stack/data/nova/instances/fc2b779e-b58d-4e45-8789-91c4b452ee0b_del complete
Nov 08 16:53:30 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:53:30 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Took 0.72 seconds to deallocate network for instance.
Nov 08 16:53:30 user nova-compute[74669]: INFO nova.compute.manager [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:31 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:53:31 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:53:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:31 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Deleted allocations for instance 725977e4-d011-4c79-b8bc-39bed9649515
Nov 08 16:53:31 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:53:31 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Took 0.55 seconds to deallocate network for instance.
Nov 08 16:53:31 user nova-compute[74669]: DEBUG nova.compute.manager [req-1ae398cf-aa99-4502-b007-5582f6a14c8e req-165b5364-426d-4ec8-a610-72285bd38220 service nova] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Received event network-vif-plugged-85a996ca-5cd2-468a-a1b1-55f5c882a624 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:53:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1ae398cf-aa99-4502-b007-5582f6a14c8e req-165b5364-426d-4ec8-a610-72285bd38220 service nova] Acquiring lock "725977e4-d011-4c79-b8bc-39bed9649515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1ae398cf-aa99-4502-b007-5582f6a14c8e req-165b5364-426d-4ec8-a610-72285bd38220 service nova] Lock "725977e4-d011-4c79-b8bc-39bed9649515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1ae398cf-aa99-4502-b007-5582f6a14c8e req-165b5364-426d-4ec8-a610-72285bd38220 service nova] Lock "725977e4-d011-4c79-b8bc-39bed9649515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:31 user nova-compute[74669]: DEBUG nova.compute.manager [req-1ae398cf-aa99-4502-b007-5582f6a14c8e req-165b5364-426d-4ec8-a610-72285bd38220 service nova] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] No waiting events found dispatching network-vif-plugged-85a996ca-5cd2-468a-a1b1-55f5c882a624 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:53:31 user nova-compute[74669]: WARNING nova.compute.manager [req-1ae398cf-aa99-4502-b007-5582f6a14c8e req-165b5364-426d-4ec8-a610-72285bd38220 service nova] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Received unexpected event network-vif-plugged-85a996ca-5cd2-468a-a1b1-55f5c882a624 for instance with vm_state deleted and task_state None.
Nov 08 16:53:31 user nova-compute[74669]: DEBUG nova.compute.manager [req-1ae398cf-aa99-4502-b007-5582f6a14c8e req-165b5364-426d-4ec8-a610-72285bd38220 service nova] [instance: 725977e4-d011-4c79-b8bc-39bed9649515] Received event network-vif-deleted-85a996ca-5cd2-468a-a1b1-55f5c882a624 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:53:31 user nova-compute[74669]: DEBUG nova.compute.manager [req-1ae398cf-aa99-4502-b007-5582f6a14c8e req-165b5364-426d-4ec8-a610-72285bd38220 service nova] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Received event network-vif-deleted-542b5f60-bd62-4bb3-a644-b7d92762bca0 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:53:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5d38464f-2dea-43e0-a65a-41aabb805af2 tempest-VolumesActionsTest-137413693 tempest-VolumesActionsTest-137413693-project-member] Lock "725977e4-d011-4c79-b8bc-39bed9649515" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.413s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:31 user nova-compute[74669]: DEBUG nova.compute.manager [req-e7236129-af5e-41e0-a6b8-d0bc571fdfe4 req-4e445378-e1ac-4102-bc58-406a008e90ec service nova] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Received event network-vif-plugged-542b5f60-bd62-4bb3-a644-b7d92762bca0 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:53:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e7236129-af5e-41e0-a6b8-d0bc571fdfe4 req-4e445378-e1ac-4102-bc58-406a008e90ec service nova] Acquiring lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e7236129-af5e-41e0-a6b8-d0bc571fdfe4 req-4e445378-e1ac-4102-bc58-406a008e90ec service nova] Lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e7236129-af5e-41e0-a6b8-d0bc571fdfe4 req-4e445378-e1ac-4102-bc58-406a008e90ec service nova] Lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:31 user nova-compute[74669]: DEBUG nova.compute.manager [req-e7236129-af5e-41e0-a6b8-d0bc571fdfe4 req-4e445378-e1ac-4102-bc58-406a008e90ec service nova] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] No waiting events found dispatching network-vif-plugged-542b5f60-bd62-4bb3-a644-b7d92762bca0 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:53:31 user nova-compute[74669]: WARNING nova.compute.manager [req-e7236129-af5e-41e0-a6b8-d0bc571fdfe4 req-4e445378-e1ac-4102-bc58-406a008e90ec service nova] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Received unexpected event network-vif-plugged-542b5f60-bd62-4bb3-a644-b7d92762bca0 for instance with vm_state active and task_state deleting.
Nov 08 16:53:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:35 user nova-compute[74669]: DEBUG nova.compute.manager [req-53dad27e-a8d9-4c75-8662-63745f62c9fc req-735f42dd-50b8-409f-86a5-0118a7c3ad00 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Received event network-changed-bdd3c052-b244-491c-ae59-dcea51d10b48 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:53:35 user nova-compute[74669]: DEBUG nova.compute.manager [req-53dad27e-a8d9-4c75-8662-63745f62c9fc req-735f42dd-50b8-409f-86a5-0118a7c3ad00 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Refreshing instance network info cache due to event network-changed-bdd3c052-b244-491c-ae59-dcea51d10b48. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:53:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-53dad27e-a8d9-4c75-8662-63745f62c9fc req-735f42dd-50b8-409f-86a5-0118a7c3ad00 service nova] Acquiring lock "refresh_cache-3ef7e79a-203b-4608-a430-1dc99f46e326" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:53:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-53dad27e-a8d9-4c75-8662-63745f62c9fc req-735f42dd-50b8-409f-86a5-0118a7c3ad00 service nova] Acquired lock "refresh_cache-3ef7e79a-203b-4608-a430-1dc99f46e326" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:53:35 user nova-compute[74669]: DEBUG nova.network.neutron [req-53dad27e-a8d9-4c75-8662-63745f62c9fc req-735f42dd-50b8-409f-86a5-0118a7c3ad00 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Refreshing network info cache for port bdd3c052-b244-491c-ae59-dcea51d10b48 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:53:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:35 user nova-compute[74669]: DEBUG nova.network.neutron [req-53dad27e-a8d9-4c75-8662-63745f62c9fc req-735f42dd-50b8-409f-86a5-0118a7c3ad00 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Updated VIF entry in instance network info cache for port bdd3c052-b244-491c-ae59-dcea51d10b48. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:53:35 user nova-compute[74669]: DEBUG nova.network.neutron [req-53dad27e-a8d9-4c75-8662-63745f62c9fc req-735f42dd-50b8-409f-86a5-0118a7c3ad00 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Updating instance_info_cache with network_info: [{"id": "bdd3c052-b244-491c-ae59-dcea51d10b48", "address": "fa:16:3e:c7:e2:a1", "network": {"id": "bdc4b376-712f-45e1-aaf4-64336de2ba9b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-338712334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd3c052-b2", "ovs_interfaceid": "bdd3c052-b244-491c-ae59-dcea51d10b48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:53:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-53dad27e-a8d9-4c75-8662-63745f62c9fc req-735f42dd-50b8-409f-86a5-0118a7c3ad00 service nova] Releasing lock "refresh_cache-3ef7e79a-203b-4608-a430-1dc99f46e326" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:53:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Acquiring lock "interface-3ef7e79a-203b-4608-a430-1dc99f46e326-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "interface-3ef7e79a-203b-4608-a430-1dc99f46e326-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:35 user nova-compute[74669]: DEBUG nova.objects.instance [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lazy-loading 'flavor' on Instance uuid 3ef7e79a-203b-4608-a430-1dc99f46e326 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:53:35 user nova-compute[74669]: DEBUG nova.objects.instance [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lazy-loading 'pci_requests' on Instance uuid 3ef7e79a-203b-4608-a430-1dc99f46e326 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:53:35 user nova-compute[74669]: DEBUG nova.objects.base [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Object Instance<3ef7e79a-203b-4608-a430-1dc99f46e326> lazy-loaded attributes: flavor,pci_requests {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:53:35 user nova-compute[74669]: DEBUG nova.network.neutron [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 16:53:35 user nova-compute[74669]: DEBUG nova.policy [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f25ebab8f83408d8cee32efb4cd93ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363debcc70b64500b0822f6dd6f27ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 16:53:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:36 user nova-compute[74669]: DEBUG nova.network.neutron [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Successfully created port: b769ad45-f1a8-47b6-9629-1e1a8137957f {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG nova.network.neutron [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Successfully updated port: b769ad45-f1a8-47b6-9629-1e1a8137957f {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Acquiring lock "refresh_cache-3ef7e79a-203b-4608-a430-1dc99f46e326" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Acquired lock "refresh_cache-3ef7e79a-203b-4608-a430-1dc99f46e326" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG nova.network.neutron [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG nova.compute.manager [req-9042fd78-fe94-4d5f-ba6c-183c93bd1d22 req-664b487e-5338-4906-bb6b-6d3545bddd59 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Received event network-changed-b769ad45-f1a8-47b6-9629-1e1a8137957f {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG nova.compute.manager [req-9042fd78-fe94-4d5f-ba6c-183c93bd1d22 req-664b487e-5338-4906-bb6b-6d3545bddd59 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Refreshing instance network info cache due to event network-changed-b769ad45-f1a8-47b6-9629-1e1a8137957f. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9042fd78-fe94-4d5f-ba6c-183c93bd1d22 req-664b487e-5338-4906-bb6b-6d3545bddd59 service nova] Acquiring lock "refresh_cache-3ef7e79a-203b-4608-a430-1dc99f46e326" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG nova.network.neutron [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Updating instance_info_cache with network_info: [{"id": "bdd3c052-b244-491c-ae59-dcea51d10b48", "address": "fa:16:3e:c7:e2:a1", "network": {"id": "bdc4b376-712f-45e1-aaf4-64336de2ba9b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-338712334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd3c052-b2", "ovs_interfaceid": "bdd3c052-b244-491c-ae59-dcea51d10b48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "address": "fa:16:3e:7e:98:57", "network": {"id": "30f3ce95-cb0a-44df-ac36-3d590ecd5e19", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-434432325", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb769ad45-f1", "ovs_interfaceid": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Releasing lock "refresh_cache-3ef7e79a-203b-4608-a430-1dc99f46e326" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9042fd78-fe94-4d5f-ba6c-183c93bd1d22 req-664b487e-5338-4906-bb6b-6d3545bddd59 service nova] Acquired lock "refresh_cache-3ef7e79a-203b-4608-a430-1dc99f46e326" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG nova.network.neutron [req-9042fd78-fe94-4d5f-ba6c-183c93bd1d22 req-664b487e-5338-4906-bb6b-6d3545bddd59 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Refreshing network info cache for port b769ad45-f1a8-47b6-9629-1e1a8137957f {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:51:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1645332005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1645332005',id=9,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB3a26wXBmbxS9Ie0rPCqATNjmL9SLaLhAobRJrF3o3vA4h0CU2n8HUE7/qd69ompZDoYTJsZEmW00PGjMGmRpCjD/lO91lrU6txPCpNQUdBwQTXu0cZgfMZw/6mElCMQ==',key_name='tempest-keypair-961371252',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:51:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='363debcc70b64500b0822f6dd6f27ae2',ramdisk_id='',reservation_id='r-gineojlh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1985002595',owner_user_name='tempest-TaggedAttachmentsTest-1985002595-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:51:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f25ebab8f83408d8cee32efb4cd93ad',uuid=3ef7e79a-203b-4608-a430-1dc99f46e326,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "address": "fa:16:3e:7e:98:57", "network": {"id": "30f3ce95-cb0a-44df-ac36-3d590ecd5e19", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-434432325", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb769ad45-f1", "ovs_interfaceid": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Converting VIF {"id": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "address": "fa:16:3e:7e:98:57", "network": {"id": "30f3ce95-cb0a-44df-ac36-3d590ecd5e19", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-434432325", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb769ad45-f1", "ovs_interfaceid": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:98:57,bridge_name='br-int',has_traffic_filtering=True,id=b769ad45-f1a8-47b6-9629-1e1a8137957f,network=Network(30f3ce95-cb0a-44df-ac36-3d590ecd5e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb769ad45-f1') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG os_vif [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:98:57,bridge_name='br-int',has_traffic_filtering=True,id=b769ad45-f1a8-47b6-9629-1e1a8137957f,network=Network(30f3ce95-cb0a-44df-ac36-3d590ecd5e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb769ad45-f1') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e373291-9843-5b67-af8f-a492ef3e827d', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb769ad45-f1, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb769ad45-f1, col_values=(('qos', UUID('fc5ee847-5521-41a3-86de-4b95bd360f6e')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb769ad45-f1, col_values=(('external_ids', {'iface-id': 'b769ad45-f1a8-47b6-9629-1e1a8137957f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:98:57', 'vm-uuid': '3ef7e79a-203b-4608-a430-1dc99f46e326'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:37 user nova-compute[74669]: INFO os_vif [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:98:57,bridge_name='br-int',has_traffic_filtering=True,id=b769ad45-f1a8-47b6-9629-1e1a8137957f,network=Network(30f3ce95-cb0a-44df-ac36-3d590ecd5e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb769ad45-f1')
Nov 08 16:53:37 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:51:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1645332005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1645332005',id=9,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB3a26wXBmbxS9Ie0rPCqATNjmL9SLaLhAobRJrF3o3vA4h0CU2n8HUE7/qd69ompZDoYTJsZEmW00PGjMGmRpCjD/lO91lrU6txPCpNQUdBwQTXu0cZgfMZw/6mElCMQ==',key_name='tempest-keypair-961371252',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:51:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='363debcc70b64500b0822f6dd6f27ae2',ramdisk_id='',reservation_id='r-gineojlh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1985002595',owner_user_name='tempest-TaggedAttachmentsTest-1985002595-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:51:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f25ebab8f83408d8cee32efb4cd93ad',uuid=3ef7e79a-203b-4608-a430-1dc99f46e326,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "address": "fa:16:3e:7e:98:57", "network": {"id": "30f3ce95-cb0a-44df-ac36-3d590ecd5e19", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-434432325", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb769ad45-f1", "ovs_interfaceid": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Converting VIF {"id": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "address": "fa:16:3e:7e:98:57", "network": {"id": "30f3ce95-cb0a-44df-ac36-3d590ecd5e19", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-434432325", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb769ad45-f1", "ovs_interfaceid": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:98:57,bridge_name='br-int',has_traffic_filtering=True,id=b769ad45-f1a8-47b6-9629-1e1a8137957f,network=Network(30f3ce95-cb0a-44df-ac36-3d590ecd5e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb769ad45-f1') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] attach device xml: <interface type="ethernet">
Nov 08 16:53:37 user nova-compute[74669]:   <mac address="fa:16:3e:7e:98:57"/>
Nov 08 16:53:37 user nova-compute[74669]:   <model type="virtio"/>
Nov 08 16:53:37 user nova-compute[74669]:   <mtu size="1442"/>
Nov 08 16:53:37 user nova-compute[74669]:   <target dev="tapb769ad45-f1"/>
Nov 08 16:53:37 user nova-compute[74669]: </interface>
Nov 08 16:53:37 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 16:53:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:38 user nova-compute[74669]: DEBUG nova.compute.manager [req-be2cd05f-b955-4df2-9396-0429a0ce845d req-f4123273-6171-4b92-80de-5b3d94cf5ee4 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Received event network-vif-plugged-b769ad45-f1a8-47b6-9629-1e1a8137957f {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:53:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-be2cd05f-b955-4df2-9396-0429a0ce845d req-f4123273-6171-4b92-80de-5b3d94cf5ee4 service nova] Acquiring lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-be2cd05f-b955-4df2-9396-0429a0ce845d req-f4123273-6171-4b92-80de-5b3d94cf5ee4 service nova] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-be2cd05f-b955-4df2-9396-0429a0ce845d req-f4123273-6171-4b92-80de-5b3d94cf5ee4 service nova] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:38 user nova-compute[74669]: DEBUG nova.compute.manager [req-be2cd05f-b955-4df2-9396-0429a0ce845d req-f4123273-6171-4b92-80de-5b3d94cf5ee4 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] No waiting events found dispatching network-vif-plugged-b769ad45-f1a8-47b6-9629-1e1a8137957f {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:53:38 user nova-compute[74669]: WARNING nova.compute.manager [req-be2cd05f-b955-4df2-9396-0429a0ce845d req-f4123273-6171-4b92-80de-5b3d94cf5ee4 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Received unexpected event network-vif-plugged-b769ad45-f1a8-47b6-9629-1e1a8137957f for instance with vm_state active and task_state None.
Nov 08 16:53:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:53:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] No BDM found with device name hda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:53:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] No VIF found with MAC fa:16:3e:c7:e2:a1, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:53:38 user nova-compute[74669]: DEBUG nova.network.neutron [req-9042fd78-fe94-4d5f-ba6c-183c93bd1d22 req-664b487e-5338-4906-bb6b-6d3545bddd59 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Updated VIF entry in instance network info cache for port b769ad45-f1a8-47b6-9629-1e1a8137957f. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:53:38 user nova-compute[74669]: DEBUG nova.network.neutron [req-9042fd78-fe94-4d5f-ba6c-183c93bd1d22 req-664b487e-5338-4906-bb6b-6d3545bddd59 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Updating instance_info_cache with network_info: [{"id": "bdd3c052-b244-491c-ae59-dcea51d10b48", "address": "fa:16:3e:c7:e2:a1", "network": {"id": "bdc4b376-712f-45e1-aaf4-64336de2ba9b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-338712334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd3c052-b2", "ovs_interfaceid": "bdd3c052-b244-491c-ae59-dcea51d10b48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "address": "fa:16:3e:7e:98:57", "network": {"id": "30f3ce95-cb0a-44df-ac36-3d590ecd5e19", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-434432325", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb769ad45-f1", "ovs_interfaceid": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:53:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9042fd78-fe94-4d5f-ba6c-183c93bd1d22 req-664b487e-5338-4906-bb6b-6d3545bddd59 service nova] Releasing lock "refresh_cache-3ef7e79a-203b-4608-a430-1dc99f46e326" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:53:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:53:38 user nova-compute[74669]:   <nova:package version="0.0.0"/>
Nov 08 16:53:38 user nova-compute[74669]:   <nova:name>tempest-device-tagging-server-1645332005</nova:name>
Nov 08 16:53:38 user nova-compute[74669]:   <nova:creationTime>2023-11-08 16:53:38</nova:creationTime>
Nov 08 16:53:38 user nova-compute[74669]:   <nova:flavor name="m1.tiny">
Nov 08 16:53:38 user nova-compute[74669]:     <nova:memory>512</nova:memory>
Nov 08 16:53:38 user nova-compute[74669]:     <nova:disk>1</nova:disk>
Nov 08 16:53:38 user nova-compute[74669]:     <nova:swap>0</nova:swap>
Nov 08 16:53:38 user nova-compute[74669]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:53:38 user nova-compute[74669]:     <nova:vcpus>1</nova:vcpus>
Nov 08 16:53:38 user nova-compute[74669]:   </nova:flavor>
Nov 08 16:53:38 user nova-compute[74669]:   <nova:owner>
Nov 08 16:53:38 user nova-compute[74669]:     <nova:user uuid="1f25ebab8f83408d8cee32efb4cd93ad">tempest-TaggedAttachmentsTest-1985002595-project-member</nova:user>
Nov 08 16:53:38 user nova-compute[74669]:     <nova:project uuid="363debcc70b64500b0822f6dd6f27ae2">tempest-TaggedAttachmentsTest-1985002595</nova:project>
Nov 08 16:53:38 user nova-compute[74669]:   </nova:owner>
Nov 08 16:53:38 user nova-compute[74669]:   <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:53:38 user nova-compute[74669]:   <nova:ports>
Nov 08 16:53:38 user nova-compute[74669]:     <nova:port uuid="bdd3c052-b244-491c-ae59-dcea51d10b48">
Nov 08 16:53:38 user nova-compute[74669]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 16:53:38 user nova-compute[74669]:     </nova:port>
Nov 08 16:53:38 user nova-compute[74669]:     <nova:port uuid="b769ad45-f1a8-47b6-9629-1e1a8137957f">
Nov 08 16:53:38 user nova-compute[74669]:       <nova:ip type="fixed" address="10.10.10.49" ipVersion="4"/>
Nov 08 16:53:38 user nova-compute[74669]:     </nova:port>
Nov 08 16:53:38 user nova-compute[74669]:   </nova:ports>
Nov 08 16:53:38 user nova-compute[74669]: </nova:instance>
Nov 08 16:53:38 user nova-compute[74669]:  {{(pid=74669) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 16:53:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8c397f71-7937-4679-9589-305fe522a32a tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "interface-3ef7e79a-203b-4608-a430-1dc99f46e326-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.875s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:39 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:53:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:53:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:40 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:40 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:40 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:40 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-4c852ff5-4bc5-4c20-aa63-aaae941ea820 req-2cfa6445-8ed0-48d6-b584-86771afb6729 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Received event network-vif-plugged-b769ad45-f1a8-47b6-9629-1e1a8137957f {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:53:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4c852ff5-4bc5-4c20-aa63-aaae941ea820 req-2cfa6445-8ed0-48d6-b584-86771afb6729 service nova] Acquiring lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4c852ff5-4bc5-4c20-aa63-aaae941ea820 req-2cfa6445-8ed0-48d6-b584-86771afb6729 service nova] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4c852ff5-4bc5-4c20-aa63-aaae941ea820 req-2cfa6445-8ed0-48d6-b584-86771afb6729 service nova] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-4c852ff5-4bc5-4c20-aa63-aaae941ea820 req-2cfa6445-8ed0-48d6-b584-86771afb6729 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] No waiting events found dispatching network-vif-plugged-b769ad45-f1a8-47b6-9629-1e1a8137957f {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:53:40 user nova-compute[74669]: WARNING nova.compute.manager [req-4c852ff5-4bc5-4c20-aa63-aaae941ea820 req-2cfa6445-8ed0-48d6-b584-86771afb6729 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Received unexpected event network-vif-plugged-b769ad45-f1a8-47b6-9629-1e1a8137957f for instance with vm_state active and task_state None.
Nov 08 16:53:40 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:40 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:40 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:40 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:40 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:40 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:43 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:53:43 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:53:43 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=7580MB free_disk=25.644123077392578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:53:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance fc2b779e-b58d-4e45-8789-91c4b452ee0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b26dbeeb-b629-414d-bcca-cdde6c207789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2d42d5ce-db73-40e6-9b35-f662a3cf0091 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance af94bfaa-45bc-4bac-9594-f363fce8727e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 3ef7e79a-203b-4608-a430-1dc99f46e326 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0829b734-daec-4dc6-b24b-cbe89000160c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 220b317c-a111-4600-b1e2-2a63e22de78a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.590s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OyWPztDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:53:44 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:53:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:53:44 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:53:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:53:44 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[92abe5d7-f035-4a22-9acf-e8c321376bed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 16:53:44 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a1611b-6c19-456b-8f66-925a536224d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549] added
Nov 08 16:53:44 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[40954b1b-19a9-4f43-81a0-84be1c38f823]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[69864e80-4104-4613-a383-ff56fd11268c]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OyWPztDA {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OyWPztDA" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bab8f7c-6b05-4856-bfb0-ff403e44722e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OyWPztDA'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec493a3c-3613-4be4-aa22-6e8cee1e2a5e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae6ce3b-b7ca-44f8-b05d-cc07c7932abc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 16:53:44 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 16:53:44 user nova-compute[74669]:  {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:53:44 user nova-compute[74669]: WARNING os_brick.initiator.connectors.iscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 16:53:44 user nova-compute[74669]: 
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca957a8-9cb9-48f9-a063-325e65080063]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549, portal: 172.16.0.220,3260]
Nov 08 16:53:44 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549, portal: 172.16.0.220,3260] successful.
Nov 08 16:53:44 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c394dc-7986-4dce-aa1c-a52f3a350ad0]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7b0fdb-b651-43a6-a53a-24e407770463]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:53:44 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:53:44 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.234s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e7b694-23ce-4587-9dac-9a0c5af9361f]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:44 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: None {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:53:45 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:53:45 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:53:45 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:53:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:53:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:53:45 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 16:53:45 user nova-compute[74669]: INFO nova.compute.manager [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] [instance: fc2b779e-b58d-4e45-8789-91c4b452ee0b] Took 14.41 seconds to detach 1 volumes for instance.
Nov 08 16:53:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Acquiring lock "3ef7e79a-203b-4608-a430-1dc99f46e326" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:45 user nova-compute[74669]: DEBUG nova.objects.instance [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lazy-loading 'flavor' on Instance uuid 3ef7e79a-203b-4608-a430-1dc99f46e326 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:53:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:45 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:53:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OyWPztDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 16:53:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:53:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] <== connect_volume: return (1269ms) {'type': 'block', 'scsi_wwn': '23866363236653036', 'path': '/dev/sdb'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:53:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866363236653036', 'path': '/dev/sdb'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 16:53:45 user nova-compute[74669]: DEBUG nova.objects.instance [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lazy-loading 'flavor' on Instance uuid 2d42d5ce-db73-40e6-9b35-f662a3cf0091 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 16:53:46 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:53:46 user nova-compute[74669]:   <source dev="/dev/sdb"/>
Nov 08 16:53:46 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:53:46 user nova-compute[74669]:   <serial>c26382ef-45b7-4063-974b-908194781549</serial>
Nov 08 16:53:46 user nova-compute[74669]: </disk>
Nov 08 16:53:46 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Updating instance_info_cache with network_info: [{"id": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "address": "fa:16:3e:8f:9e:16", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b48f6d-e0", "ovs_interfaceid": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Acquiring lock "3ef7e79a-203b-4608-a430-1dc99f46e326" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:53:46 user nova-compute[74669]: INFO nova.compute.manager [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Attaching volume 784ddfad-a40f-4ed9-bf24-3def870cd338 to /dev/vdb
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.813s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:46 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Deleted allocations for instance fc2b779e-b58d-4e45-8789-91c4b452ee0b
Nov 08 16:53:46 user nova-compute[74669]: DEBUG os_brick.utils [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba53350-5be0-4a96-807d-6fad76c93869]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5131e6-2437-409e-ac88-dc9ccdd72206]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[14848710-c543-43a8-8c4f-9a33f82819bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fc7185-dbb6-4517-a61b-d61c6c704aff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61e9d031-400b-4c16-abf1-68e0bec4e1f5 tempest-DeleteServersTestJSON-542902835 tempest-DeleteServersTestJSON-542902835-project-member] Lock "fc2b779e-b58d-4e45-8789-91c4b452ee0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.337s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:53:46 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 16:53:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[db84c409-9f47-497e-89b6-11217b62f86d]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG os_brick.utils [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Updating existing volume attachment record: b37dc694-11c2-418a-a980-04dd870ed322 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:53:46 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] No VIF found with MAC fa:16:3e:53:bc:e0, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:53:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-72357fd3-a4f2-4e38-8fbf-577e5c3a05b2 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.858s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:53:54 user nova-compute[74669]: INFO nova.virt.block_device [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Booting with volume 9297ac72-cbae-419f-a8bf-4627f4075e5e at /dev/vdc
Nov 08 16:53:54 user nova-compute[74669]: DEBUG os_brick.utils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:53:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:54 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc152008-82d6-4c98-9e21-17cfc7ddbe33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:54 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e983cb9f-f88a-49c0-959a-cd77fdd2420c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:53:54 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[92095edf-e125-413f-bb7a-10e9c4c53a48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:54 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96bd640-9c76-4b3c-afae-e989277e847c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:53:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 16:53:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:53:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:53:54 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 16:53:54 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b96c8b-0c47-4d89-ba10-5d4d1fb684b2]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:53:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 16:53:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 16:53:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 16:53:54 user nova-compute[74669]: DEBUG os_brick.utils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:53:54 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Updating existing volume attachment record: fb22de8c-89af-48c4-8753-a1fe8a473b95 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 16:53:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:53:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:54:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IOPcnjZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:54:08 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:54:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:54:08 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:54:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:54:08 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 16:54:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c002b03d-71ba-4cef-bffe-700fbfb6aa00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 16:54:08 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ed329b-4bcc-4e90-b1d1-291f84dff703]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724] added
Nov 08 16:54:08 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dffcca-bbdf-49ab-b226-d96c79f72c06]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a544b3e1-4ced-4271-a4ee-a47bdd5bb3ea]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IOPcnjZa {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IOPcnjZa" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc9bca0-f7f6-4aea-b69c-ab92cc6fde0d]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IOPcnjZa'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.077s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed17a35-3812-4fb3-818a-71a5a2d5341b]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[305bdaf5-a912-48d1-acb3-f60530d2ec35]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:54:09 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:54:09 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8551482-349c-4a1f-808f-0c80e84a949a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724, portal: 172.16.0.220,3260]
Nov 08 16:54:09 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724, portal: 172.16.0.220,3260] successful.
Nov 08 16:54:09 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[55eaea93-d36e-44b2-996a-77e36ecbda8d]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca632326-a84e-4363-bf16-79e3ea6cd453]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:54:09 user nova-compute[74669]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)
Nov 08 16:54:09 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:54:09 user nova-compute[74669]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)
Nov 08 16:54:09 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1abe4e1-9e42-4a62-a8c5-261164b7b2e7]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: None {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:09 user nova-compute[74669]: INFO nova.compute.manager [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Detaching volume c26382ef-45b7-4063-974b-908194781549
Nov 08 16:54:09 user nova-compute[74669]: INFO nova.virt.block_device [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Attempting to driver detach volume c26382ef-45b7-4063-974b-908194781549 from mountpoint /dev/vdb
Nov 08 16:54:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Attempting to detach device vdb from instance 2d42d5ce-db73-40e6-9b35-f662a3cf0091 from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 16:54:09 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:54:09 user nova-compute[74669]:   <source dev="/dev/sdb"/>
Nov 08 16:54:09 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:54:09 user nova-compute[74669]:   <serial>c26382ef-45b7-4063-974b-908194781549</serial>
Nov 08 16:54:09 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 16:54:09 user nova-compute[74669]: </disk>
Nov 08 16:54:09 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 16:54:09 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Successfully detached device vdb from instance 2d42d5ce-db73-40e6-9b35-f662a3cf0091 from the persistent domain config.
Nov 08 16:54:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2d42d5ce-db73-40e6-9b35-f662a3cf0091 from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 16:54:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 16:54:09 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:54:09 user nova-compute[74669]:   <source dev="/dev/sdb"/>
Nov 08 16:54:09 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:54:09 user nova-compute[74669]:   <serial>c26382ef-45b7-4063-974b-908194781549</serial>
Nov 08 16:54:09 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 16:54:09 user nova-compute[74669]: </disk>
Nov 08 16:54:09 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 16:54:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2d42d5ce-db73-40e6-9b35-f662a3cf0091 {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 16:54:10 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:54:10 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IOPcnjZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 16:54:10 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:54:10 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23035393338613139', 'path': '/dev/sdc'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:54:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035393338613139', 'path': '/dev/sdc'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 16:54:10 user nova-compute[74669]: DEBUG nova.objects.instance [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Lazy-loading 'flavor' on Instance uuid af94bfaa-45bc-4bac-9594-f363fce8727e {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:54:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] attach device xml: <disk type="block" device="disk">
Nov 08 16:54:10 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:54:10 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 16:54:10 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:54:10 user nova-compute[74669]:   <serial>133613f9-81c9-4bdb-afc9-8279252a2724</serial>
Nov 08 16:54:10 user nova-compute[74669]: </disk>
Nov 08 16:54:10 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 16:54:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:54:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:54:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] No VIF found with MAC fa:16:3e:2c:9a:3e, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:54:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1b5fbb47-4449-4d9e-aca8-76904bd98d1b tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Lock "af94bfaa-45bc-4bac-9594-f363fce8727e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 49.419s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b1670b14-4137-4c7d-aa0e-6cbf86671863 tempest-VolumesAssistedSnapshotsTest-463407143 tempest-VolumesAssistedSnapshotsTest-463407143-project] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] volume_snapshot_create: create_info: {'snapshot_id': '6dfbe7e2-3214-4c76-a660-dba6e913dce5', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74669) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b1670b14-4137-4c7d-aa0e-6cbf86671863 tempest-VolumesAssistedSnapshotsTest-463407143 tempest-VolumesAssistedSnapshotsTest-463407143-project] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] snap xml: <domainsnapshot>
Nov 08 16:54:11 user nova-compute[74669]:   <disks>
Nov 08 16:54:11 user nova-compute[74669]:     <disk name="/dev/sdc" snapshot="external" type="file">
Nov 08 16:54:11 user nova-compute[74669]:       <source file="/dev/new_file"/>
Nov 08 16:54:11 user nova-compute[74669]:     </disk>
Nov 08 16:54:11 user nova-compute[74669]:     <disk name="vda" snapshot="no"/>
Nov 08 16:54:11 user nova-compute[74669]:   </disks>
Nov 08 16:54:11 user nova-compute[74669]: </domainsnapshot>
Nov 08 16:54:11 user nova-compute[74669]:  {{(pid=74669) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG nova.objects.instance [None req-b1670b14-4137-4c7d-aa0e-6cbf86671863 tempest-VolumesAssistedSnapshotsTest-463407143 tempest-VolumesAssistedSnapshotsTest-463407143-project] Lazy-loading 'system_metadata' on Instance uuid af94bfaa-45bc-4bac-9594-f363fce8727e {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:54:11 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-b1670b14-4137-4c7d-aa0e-6cbf86671863 tempest-VolumesAssistedSnapshotsTest-463407143 tempest-VolumesAssistedSnapshotsTest-463407143-project] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [None req-b1670b14-4137-4c7d-aa0e-6cbf86671863 tempest-VolumesAssistedSnapshotsTest-463407143 tempest-VolumesAssistedSnapshotsTest-463407143-project] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Traceback (most recent call last):
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]     rv = execute(f, *args, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]     six.reraise(c, e, tb)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]     raise value
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]     rv = meth(*args, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] 
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [None req-b1670b14-4137-4c7d-aa0e-6cbf86671863 tempest-VolumesAssistedSnapshotsTest-463407143 tempest-VolumesAssistedSnapshotsTest-463407143-project] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Traceback (most recent call last):
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]     self._volume_snapshot_create(context, instance, guest,
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]     rv = execute(f, *args, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]     six.reraise(c, e, tb)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]     raise value
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]     rv = meth(*args, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] 
Nov 08 16:54:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-90627bd1-ba5d-4445-a12d-ba784454c3fe tempest-VolumesAssistedSnapshotsTest-463407143 tempest-VolumesAssistedSnapshotsTest-463407143-project] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] volume_snapshot_delete: delete_info: {'volume_id': '133613f9-81c9-4bdb-afc9-8279252a2724'} {{(pid=74669) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [None req-90627bd1-ba5d-4445-a12d-ba784454c3fe tempest-VolumesAssistedSnapshotsTest-463407143 tempest-VolumesAssistedSnapshotsTest-463407143-project] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Traceback (most recent call last):
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e]     if delete_info['type'] != 'qcow2':
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] KeyError: 'type'
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] 
Nov 08 16:54:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OINiegPE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:54:11 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:54:11 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:54:11 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7ea018-867b-4fd0-a4b3-43be7819e283]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 16:54:11 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [None req-90627bd1-ba5d-4445-a12d-ba784454c3fe tempest-VolumesAssistedSnapshotsTest-463407143 tempest-VolumesAssistedSnapshotsTest-463407143-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver 
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver 
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-aa8dbbdf-1a5c-4551-828d-b222990caf69)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver 
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver 
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver 
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver [None req-b1670b14-4137-4c7d-aa0e-6cbf86671863 tempest-VolumesAssistedSnapshotsTest-463407143 tempest-VolumesAssistedSnapshotsTest-463407143-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 6dfbe7e2-3214-4c76-a660-dba6e913dce5 could not be found.
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     raise value
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver 
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver 
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 6dfbe7e2-3214-4c76-a660-dba6e913dce5 could not be found. (HTTP 404) (Request-ID: req-3c46f47c-8196-409d-b8fc-ccdfaebdcfbd)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver 
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver 
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 6dfbe7e2-3214-4c76-a660-dba6e913dce5 could not be found.
Nov 08 16:54:11 user nova-compute[74669]: ERROR nova.virt.libvirt.driver 
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fdd7f4-90f5-4842-9a30-84747ed22e63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338] added
Nov 08 16:54:11 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server [None req-90627bd1-ba5d-4445-a12d-ba784454c3fe tempest-VolumesAssistedSnapshotsTest-463407143 tempest-VolumesAssistedSnapshotsTest-463407143-project] Exception during message handling: KeyError: 'type'
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server 
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b40adb-106a-4d44-b43a-01a0d34b17b5]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server [None req-b1670b14-4137-4c7d-aa0e-6cbf86671863 tempest-VolumesAssistedSnapshotsTest-463407143 tempest-VolumesAssistedSnapshotsTest-463407143-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise value
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 16:54:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server 
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1c14a8-e623-4070-bb8c-581a65c1ab35]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OINiegPE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OINiegPE" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1ea5c6-e37f-440b-a6e4-30c998ce4349]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OINiegPE'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffd6539-300f-446a-b6e2-e0f3f0bae0de]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[72aa0cbf-c274-48ab-ac9d-798bd60c489b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:54:11 user nova-compute[74669]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)
Nov 08 16:54:11 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:54:11 user nova-compute[74669]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)
Nov 08 16:54:11 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e106d0-35b6-4a48-880a-305a1f0af85e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338, portal: 172.16.0.220,3260]
Nov 08 16:54:11 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338, portal: 172.16.0.220,3260] successful.
Nov 08 16:54:11 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[645fd521-d77e-47a4-9ef0-1d8ae0e31abe]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4a208d-19c0-4872-822f-5f49305e5a86]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:54:11 user nova-compute[74669]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)
Nov 08 16:54:11 user nova-compute[74669]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)
Nov 08 16:54:11 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:54:11 user nova-compute[74669]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)
Nov 08 16:54:11 user nova-compute[74669]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)
Nov 08 16:54:11 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[84608eff-c3f5-4954-b729-a838b09a27dd]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OINiegPE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Acquiring lock "af94bfaa-45bc-4bac-9594-f363fce8727e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Lock "af94bfaa-45bc-4bac-9594-f363fce8727e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:11 user nova-compute[74669]: INFO nova.compute.manager [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Detaching volume 133613f9-81c9-4bdb-afc9-8279252a2724
Nov 08 16:54:11 user nova-compute[74669]: INFO nova.virt.block_device [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Attempting to driver detach volume 133613f9-81c9-4bdb-afc9-8279252a2724 from mountpoint /dev/vdb
Nov 08 16:54:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Attempting to detach device vdb from instance af94bfaa-45bc-4bac-9594-f363fce8727e from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] detach device xml: <disk type="block" device="disk">
Nov 08 16:54:11 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:54:11 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 16:54:11 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:54:11 user nova-compute[74669]:   <serial>133613f9-81c9-4bdb-afc9-8279252a2724</serial>
Nov 08 16:54:11 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 16:54:11 user nova-compute[74669]: </disk>
Nov 08 16:54:11 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 16:54:11 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Successfully detached device vdb from instance af94bfaa-45bc-4bac-9594-f363fce8727e from the persistent domain config.
Nov 08 16:54:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance af94bfaa-45bc-4bac-9594-f363fce8727e from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 16:54:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] detach device xml: <disk type="block" device="disk">
Nov 08 16:54:11 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:54:11 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 16:54:11 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:54:11 user nova-compute[74669]:   <serial>133613f9-81c9-4bdb-afc9-8279252a2724</serial>
Nov 08 16:54:11 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 16:54:11 user nova-compute[74669]: </disk>
Nov 08 16:54:11 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 16:54:12 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance af94bfaa-45bc-4bac-9594-f363fce8727e {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 16:54:12 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:54:12 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23366313166653932', 'path': '/dev/sdd'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:54:12 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366313166653932', 'path': '/dev/sdd'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 16:54:12 user nova-compute[74669]: DEBUG nova.objects.instance [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lazy-loading 'flavor' on Instance uuid 3ef7e79a-203b-4608-a430-1dc99f46e326 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:54:12 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 16:54:12 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:54:12 user nova-compute[74669]:   <source dev="/dev/sdd"/>
Nov 08 16:54:12 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:54:12 user nova-compute[74669]:   <serial>784ddfad-a40f-4ed9-bf24-3def870cd338</serial>
Nov 08 16:54:12 user nova-compute[74669]: </disk>
Nov 08 16:54:12 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 16:54:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:13 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:54:13 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] No BDM found with device name hda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:54:13 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] No VIF found with MAC fa:16:3e:c7:e2:a1, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:54:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-4407ddc6-e457-4427-91f9-dfa1e172a018 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.897s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Acquiring lock "3ef7e79a-203b-4608-a430-1dc99f46e326" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:15 user nova-compute[74669]: INFO nova.compute.manager [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Detaching volume 784ddfad-a40f-4ed9-bf24-3def870cd338
Nov 08 16:54:15 user nova-compute[74669]: INFO nova.virt.block_device [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Attempting to driver detach volume 784ddfad-a40f-4ed9-bf24-3def870cd338 from mountpoint /dev/vdb
Nov 08 16:54:15 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Attempting to detach device vdb from instance 3ef7e79a-203b-4608-a430-1dc99f46e326 from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 16:54:15 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 16:54:15 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:54:15 user nova-compute[74669]:   <source dev="/dev/sdd"/>
Nov 08 16:54:15 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:54:15 user nova-compute[74669]:   <serial>784ddfad-a40f-4ed9-bf24-3def870cd338</serial>
Nov 08 16:54:15 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 16:54:15 user nova-compute[74669]: </disk>
Nov 08 16:54:15 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 16:54:15 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Successfully detached device vdb from instance 3ef7e79a-203b-4608-a430-1dc99f46e326 from the persistent domain config.
Nov 08 16:54:15 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3ef7e79a-203b-4608-a430-1dc99f46e326 from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 16:54:15 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 16:54:15 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:54:15 user nova-compute[74669]:   <source dev="/dev/sdd"/>
Nov 08 16:54:15 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:54:15 user nova-compute[74669]:   <serial>784ddfad-a40f-4ed9-bf24-3def870cd338</serial>
Nov 08 16:54:15 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 16:54:15 user nova-compute[74669]: </disk>
Nov 08 16:54:15 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 16:54:15 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3ef7e79a-203b-4608-a430-1dc99f46e326 {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 16:54:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG nova.compute.manager [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 16:54:19 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Creating image(s)
Nov 08 16:54:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Did not create local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Ensure instance console log exists: /opt/stack/data/nova/instances/220b317c-a111-4600-b1e2-2a63e22de78a/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Start _get_guest_xml network_info=[{"id": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "address": "fa:16:3e:43:30:8e", "network": {"id": "8718876b-101b-476e-bede-b881ac6c346f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-189935542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4514f25c-5c", "ovs_interfaceid": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "address": "fa:16:3e:aa:ef:0f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f5d804-7e", "ovs_interfaceid": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "address": "fa:16:3e:0b:c0:66", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap263210b8-c7", "ovs_interfaceid": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "address": "fa:16:3e:87:0f:90", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5cb6f9-46", "ovs_interfaceid": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "address": "fa:16:3e:76:80:9f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7639563-89", "ovs_interfaceid": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "address": "fa:16:3e:20:ca:e1", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcee60b9-29", "ovs_interfaceid": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "address": "fa:16:3e:c4:68:51", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6856bd-1e", "ovs_interfaceid": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '6d9b072a-8ceb-442e-a815-f6976316e228', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVyhUpZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '220b317c-a111-4600-b1e2-2a63e22de78a', 'attached_at': '', 'detached_at': '', 'volume_id': '734606a5-2915-4dc6-97dd-7ab519822f6e', 'serial': '734606a5-2915-4dc6-97dd-7ab519822f6e'}, 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '19b54406-ec2e-4581-8c50-447a878ebc4a', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pCNzaGbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '220b317c-a111-4600-b1e2-2a63e22de78a', 'attached_at': '', 'detached_at': '', 'volume_id': '391df8b1-b8a5-4886-9a8c-87fb65dfc5eb', 'serial': '391df8b1-b8a5-4886-9a8c-87fb65dfc5eb'}, 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'fb22de8c-89af-48c4-8753-a1fe8a473b95', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEDQWmcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '220b317c-a111-4600-b1e2-2a63e22de78a', 'attached_at': '', 'detached_at': '', 'volume_id': '9297ac72-cbae-419f-a8bf-4627f4075e5e', 'serial': '9297ac72-cbae-419f-a8bf-4627f4075e5e'}, 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:54:19 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:54:19 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:54:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVyhUpZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:54:19 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:54:19 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:54:19 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55760c4-2c14-4bb4-90c4-23ad9e7b0958]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 16:54:19 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc0447a-a162-412a-b090-1b63e1296b8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e] added
Nov 08 16:54:19 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6361a2a4-8ea3-4880-9c22-e8f4ad276789]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[82290720-cb2e-4a6b-9fcf-a578f5dd13c3]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jVyhUpZO {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jVyhUpZO" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[609c9edf-b274-4dfe-9c05-f4c482d7e95d]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jVyhUpZO'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2debff7a-5778-450e-a97f-0e804f820e9b]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[13514106-acfc-4ea7-913d-7e05a6e80883]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:54:19 user nova-compute[74669]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)
Nov 08 16:54:19 user nova-compute[74669]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)
Nov 08 16:54:19 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:54:19 user nova-compute[74669]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)
Nov 08 16:54:19 user nova-compute[74669]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)
Nov 08 16:54:19 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c185f43f-ea3b-4f3e-8220-45f4b6b9f1b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e, portal: 172.16.0.220,3260]
Nov 08 16:54:19 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e, portal: 172.16.0.220,3260] successful.
Nov 08 16:54:19 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b070bf40-8312-42f0-9483-8d77e4e918f8]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab74ef8-028d-4832-92b3-f457eda358b2]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:54:19 user nova-compute[74669]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)
Nov 08 16:54:19 user nova-compute[74669]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)
Nov 08 16:54:19 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:54:19 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:54:19 user nova-compute[74669]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)
Nov 08 16:54:19 user nova-compute[74669]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)
Nov 08 16:54:19 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:54:19 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dca4a41-4808-4f61-b422-9d0931cc4314]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:54:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVyhUpZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23362363238313033', 'path': '/dev/sde'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362363238313033', 'path': '/dev/sde'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pCNzaGbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:54:20 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:54:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:54:20 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:54:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:54:20 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 16:54:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8332d2d3-58fd-49fd-8dff-0820521cb411]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 16:54:20 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e3a50b-2a2c-4cbb-b94c-11d726b8d1a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb] added
Nov 08 16:54:20 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[579152b2-e2cb-4d76-abc4-56e529aca8af]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bb8f21-045b-4d01-8fda-a41cb1d951b5]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pCNzaGbU {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pCNzaGbU" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d0045b-d576-44a9-a753-dccd1edb4d16]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pCNzaGbU'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[65164b62-a777-4f63-8631-88c4616f5320]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[36357576-df30-438b-a4e9-829128f15be0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:54:21 user nova-compute[74669]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)
Nov 08 16:54:21 user nova-compute[74669]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)
Nov 08 16:54:21 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:54:21 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:54:21 user nova-compute[74669]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)
Nov 08 16:54:21 user nova-compute[74669]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)
Nov 08 16:54:21 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:54:21 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8cfd4b-f916-4415-9480-44b12b89ced4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb, portal: 172.16.0.220,3260]
Nov 08 16:54:21 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb, portal: 172.16.0.220,3260] successful.
Nov 08 16:54:21 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d39886-73be-4694-af8d-77291077817a]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[424bfe2e-afdf-448b-8fc7-db13f4d10d8c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:54:21 user nova-compute[74669]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)
Nov 08 16:54:21 user nova-compute[74669]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)
Nov 08 16:54:21 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:54:21 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:54:21 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:54:21 user nova-compute[74669]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)
Nov 08 16:54:21 user nova-compute[74669]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)
Nov 08 16:54:21 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:54:21 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:54:21 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d159c7c-5bb9-4199-8966-c9cae68db9cd]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:21 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: None {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pCNzaGbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26161613431363036', 'path': '/dev/sdf'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161613431363036', 'path': '/dev/sdf'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEDQWmcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:54:22 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:54:22 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:54:22 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d1f09e-a9ed-4af1-b8c4-917216efee97]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 16:54:22 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35e29fb-5850-4896-9f77-3aeb564044b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e] added
Nov 08 16:54:22 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb96c50-ea1b-43f2-8203-b108a60d01de]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cbd5d3-6478-486e-9400-eb5638566358]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pEDQWmcK {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pEDQWmcK" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf42257-8216-422d-b747-a90afbd470bf]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pEDQWmcK'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16150a2-a9cf-4197-88ad-61ec86a79bc2]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abeb122-4b95-4481-9f8c-4ab719627378]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:54:22 user nova-compute[74669]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)
Nov 08 16:54:22 user nova-compute[74669]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)
Nov 08 16:54:22 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:54:22 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:54:22 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:54:22 user nova-compute[74669]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)
Nov 08 16:54:22 user nova-compute[74669]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)
Nov 08 16:54:22 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:54:22 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:54:22 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3352b642-23fe-4c5b-8af4-c5934493ae7c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e, portal: 172.16.0.220,3260]
Nov 08 16:54:22 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e, portal: 172.16.0.220,3260] successful.
Nov 08 16:54:22 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5b467b-f124-492a-9f4a-8a65362db350]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1ac6b4-d3e6-44b7-94f4-2a8f1f53bbf8]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:54:22 user nova-compute[74669]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)
Nov 08 16:54:22 user nova-compute[74669]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)
Nov 08 16:54:22 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:54:22 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:54:22 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:54:22 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:54:22 user nova-compute[74669]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)
Nov 08 16:54:22 user nova-compute[74669]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)
Nov 08 16:54:22 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:54:22 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:54:22 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:54:22 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b8bf36-d510-4032-bf9e-70c4a73ad4f8]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEDQWmcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 16:54:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23334396338333661', 'path': '/dev/sdg'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334396338333661', 'path': '/dev/sdg'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-881607780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-881607780',id=11,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm9lQ3SAiMNJZrxiyPCWI4ahlhBAnR9vvGizl11pHKwSyyBqoISKJhwufG6prBVxtppmree8vWIMKH/ZTi6sDbJkA+8UEh7PlmPeUfhVDPq9UvYWyRV2e1YAP/hna/EKg==',key_name='tempest-keypair-1554170018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef553fbdfa6a49f5bb2bdde29020e6ee',ramdisk_id='',reservation_id='r-vhxz9s0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-70363984',owner_user_name='tempest-TaggedBootDevicesTest_v242-70363984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d5080c9af64051ab23b87414b5ec48',uuid=220b317c-a111-4600-b1e2-2a63e22de78a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "address": "fa:16:3e:43:30:8e", "network": {"id": "8718876b-101b-476e-bede-b881ac6c346f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-189935542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4514f25c-5c", "ovs_interfaceid": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converting VIF {"id": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "address": "fa:16:3e:43:30:8e", "network": {"id": "8718876b-101b-476e-bede-b881ac6c346f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-189935542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4514f25c-5c", "ovs_interfaceid": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:30:8e,bridge_name='br-int',has_traffic_filtering=True,id=4514f25c-5ce0-4ba0-95cd-55298ce3e832,network=Network(8718876b-101b-476e-bede-b881ac6c346f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4514f25c-5c') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-881607780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-881607780',id=11,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm9lQ3SAiMNJZrxiyPCWI4ahlhBAnR9vvGizl11pHKwSyyBqoISKJhwufG6prBVxtppmree8vWIMKH/ZTi6sDbJkA+8UEh7PlmPeUfhVDPq9UvYWyRV2e1YAP/hna/EKg==',key_name='tempest-keypair-1554170018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef553fbdfa6a49f5bb2bdde29020e6ee',ramdisk_id='',reservation_id='r-vhxz9s0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-70363984',owner_user_name='tempest-TaggedBootDevicesTest_v242-70363984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d5080c9af64051ab23b87414b5ec48',uuid=220b317c-a111-4600-b1e2-2a63e22de78a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "address": "fa:16:3e:aa:ef:0f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f5d804-7e", "ovs_interfaceid": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converting VIF {"id": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "address": "fa:16:3e:aa:ef:0f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f5d804-7e", "ovs_interfaceid": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:ef:0f,bridge_name='br-int',has_traffic_filtering=True,id=48f5d804-7e38-4c85-af5e-ab6e55c736ac,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap48f5d804-7e') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-881607780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-881607780',id=11,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm9lQ3SAiMNJZrxiyPCWI4ahlhBAnR9vvGizl11pHKwSyyBqoISKJhwufG6prBVxtppmree8vWIMKH/ZTi6sDbJkA+8UEh7PlmPeUfhVDPq9UvYWyRV2e1YAP/hna/EKg==',key_name='tempest-keypair-1554170018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef553fbdfa6a49f5bb2bdde29020e6ee',ramdisk_id='',reservation_id='r-vhxz9s0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-70363984',owner_user_name='tempest-TaggedBootDevicesTest_v242-70363984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d5080c9af64051ab23b87414b5ec48',uuid=220b317c-a111-4600-b1e2-2a63e22de78a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "address": "fa:16:3e:0b:c0:66", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap263210b8-c7", "ovs_interfaceid": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converting VIF {"id": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "address": "fa:16:3e:0b:c0:66", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap263210b8-c7", "ovs_interfaceid": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c0:66,bridge_name='br-int',has_traffic_filtering=True,id=263210b8-c77f-49af-a1c0-146dcb0a5dc5,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap263210b8-c7') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-881607780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-881607780',id=11,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm9lQ3SAiMNJZrxiyPCWI4ahlhBAnR9vvGizl11pHKwSyyBqoISKJhwufG6prBVxtppmree8vWIMKH/ZTi6sDbJkA+8UEh7PlmPeUfhVDPq9UvYWyRV2e1YAP/hna/EKg==',key_name='tempest-keypair-1554170018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef553fbdfa6a49f5bb2bdde29020e6ee',ramdisk_id='',reservation_id='r-vhxz9s0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-70363984',owner_user_name='tempest-TaggedBootDevicesTest_v242-70363984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d5080c9af64051ab23b87414b5ec48',uuid=220b317c-a111-4600-b1e2-2a63e22de78a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "address": "fa:16:3e:87:0f:90", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5cb6f9-46", "ovs_interfaceid": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converting VIF {"id": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "address": "fa:16:3e:87:0f:90", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5cb6f9-46", "ovs_interfaceid": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:0f:90,bridge_name='br-int',has_traffic_filtering=True,id=8a5cb6f9-4637-4473-a64d-651ebf09be49,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a5cb6f9-46') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-881607780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-881607780',id=11,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm9lQ3SAiMNJZrxiyPCWI4ahlhBAnR9vvGizl11pHKwSyyBqoISKJhwufG6prBVxtppmree8vWIMKH/ZTi6sDbJkA+8UEh7PlmPeUfhVDPq9UvYWyRV2e1YAP/hna/EKg==',key_name='tempest-keypair-1554170018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef553fbdfa6a49f5bb2bdde29020e6ee',ramdisk_id='',reservation_id='r-vhxz9s0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-70363984',owner_user_name='tempest-TaggedBootDevicesTest_v242-70363984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d5080c9af64051ab23b87414b5ec48',uuid=220b317c-a111-4600-b1e2-2a63e22de78a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "address": "fa:16:3e:76:80:9f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7639563-89", "ovs_interfaceid": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converting VIF {"id": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "address": "fa:16:3e:76:80:9f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7639563-89", "ovs_interfaceid": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:80:9f,bridge_name='br-int',has_traffic_filtering=True,id=e7639563-89fb-44bf-89e2-ca44e79ad44a,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7639563-89') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-881607780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-881607780',id=11,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm9lQ3SAiMNJZrxiyPCWI4ahlhBAnR9vvGizl11pHKwSyyBqoISKJhwufG6prBVxtppmree8vWIMKH/ZTi6sDbJkA+8UEh7PlmPeUfhVDPq9UvYWyRV2e1YAP/hna/EKg==',key_name='tempest-keypair-1554170018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef553fbdfa6a49f5bb2bdde29020e6ee',ramdisk_id='',reservation_id='r-vhxz9s0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-70363984',owner_user_name='tempest-TaggedBootDevicesTest_v242-70363984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d5080c9af64051ab23b87414b5ec48',uuid=220b317c-a111-4600-b1e2-2a63e22de78a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "address": "fa:16:3e:20:ca:e1", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcee60b9-29", "ovs_interfaceid": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converting VIF {"id": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "address": "fa:16:3e:20:ca:e1", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcee60b9-29", "ovs_interfaceid": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:ca:e1,bridge_name='br-int',has_traffic_filtering=True,id=bcee60b9-29f1-49cd-b769-d3dbf7b0f11d,network=Network(d87f85ee-10af-4cbb-9514-02cc98f3edfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcee60b9-29') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-881607780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-881607780',id=11,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm9lQ3SAiMNJZrxiyPCWI4ahlhBAnR9vvGizl11pHKwSyyBqoISKJhwufG6prBVxtppmree8vWIMKH/ZTi6sDbJkA+8UEh7PlmPeUfhVDPq9UvYWyRV2e1YAP/hna/EKg==',key_name='tempest-keypair-1554170018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef553fbdfa6a49f5bb2bdde29020e6ee',ramdisk_id='',reservation_id='r-vhxz9s0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-70363984',owner_user_name='tempest-TaggedBootDevicesTest_v242-70363984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d5080c9af64051ab23b87414b5ec48',uuid=220b317c-a111-4600-b1e2-2a63e22de78a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "address": "fa:16:3e:c4:68:51", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6856bd-1e", "ovs_interfaceid": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converting VIF {"id": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "address": "fa:16:3e:c4:68:51", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6856bd-1e", "ovs_interfaceid": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:68:51,bridge_name='br-int',has_traffic_filtering=True,id=6f6856bd-1e1d-406b-8d39-7f3f288d135b,network=Network(d87f85ee-10af-4cbb-9514-02cc98f3edfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f6856bd-1e') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.objects.instance [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lazy-loading 'pci_devices' on Instance uuid 220b317c-a111-4600-b1e2-2a63e22de78a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:54:23 user nova-compute[74669]:   <uuid>220b317c-a111-4600-b1e2-2a63e22de78a</uuid>
Nov 08 16:54:23 user nova-compute[74669]:   <name>instance-0000000b</name>
Nov 08 16:54:23 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:54:23 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:54:23 user nova-compute[74669]:   <metadata>
Nov 08 16:54:23 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:54:23 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:54:23 user nova-compute[74669]:       <nova:name>tempest-device-tagging-server-881607780</nova:name>
Nov 08 16:54:23 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:54:19</nova:creationTime>
Nov 08 16:54:23 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:54:23 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:54:23 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:54:23 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:54:23 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:54:23 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:54:23 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:54:23 user nova-compute[74669]:       <nova:owner>
Nov 08 16:54:23 user nova-compute[74669]:         <nova:user uuid="04d5080c9af64051ab23b87414b5ec48">tempest-TaggedBootDevicesTest_v242-70363984-project-member</nova:user>
Nov 08 16:54:23 user nova-compute[74669]:         <nova:project uuid="ef553fbdfa6a49f5bb2bdde29020e6ee">tempest-TaggedBootDevicesTest_v242-70363984</nova:project>
Nov 08 16:54:23 user nova-compute[74669]:       </nova:owner>
Nov 08 16:54:23 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:54:23 user nova-compute[74669]:       <nova:ports>
Nov 08 16:54:23 user nova-compute[74669]:         <nova:port uuid="4514f25c-5ce0-4ba0-95cd-55298ce3e832">
Nov 08 16:54:23 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 16:54:23 user nova-compute[74669]:         </nova:port>
Nov 08 16:54:23 user nova-compute[74669]:         <nova:port uuid="48f5d804-7e38-4c85-af5e-ab6e55c736ac">
Nov 08 16:54:23 user nova-compute[74669]:           <nova:ip type="fixed" address="10.1.1.10" ipVersion="4"/>
Nov 08 16:54:23 user nova-compute[74669]:         </nova:port>
Nov 08 16:54:23 user nova-compute[74669]:         <nova:port uuid="263210b8-c77f-49af-a1c0-146dcb0a5dc5">
Nov 08 16:54:23 user nova-compute[74669]:           <nova:ip type="fixed" address="10.1.1.85" ipVersion="4"/>
Nov 08 16:54:23 user nova-compute[74669]:         </nova:port>
Nov 08 16:54:23 user nova-compute[74669]:         <nova:port uuid="8a5cb6f9-4637-4473-a64d-651ebf09be49">
Nov 08 16:54:23 user nova-compute[74669]:           <nova:ip type="fixed" address="10.1.1.204" ipVersion="4"/>
Nov 08 16:54:23 user nova-compute[74669]:         </nova:port>
Nov 08 16:54:23 user nova-compute[74669]:         <nova:port uuid="e7639563-89fb-44bf-89e2-ca44e79ad44a">
Nov 08 16:54:23 user nova-compute[74669]:           <nova:ip type="fixed" address="10.1.1.186" ipVersion="4"/>
Nov 08 16:54:23 user nova-compute[74669]:         </nova:port>
Nov 08 16:54:23 user nova-compute[74669]:         <nova:port uuid="bcee60b9-29f1-49cd-b769-d3dbf7b0f11d">
Nov 08 16:54:23 user nova-compute[74669]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 08 16:54:23 user nova-compute[74669]:         </nova:port>
Nov 08 16:54:23 user nova-compute[74669]:         <nova:port uuid="6f6856bd-1e1d-406b-8d39-7f3f288d135b">
Nov 08 16:54:23 user nova-compute[74669]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 08 16:54:23 user nova-compute[74669]:         </nova:port>
Nov 08 16:54:23 user nova-compute[74669]:       </nova:ports>
Nov 08 16:54:23 user nova-compute[74669]:     </nova:instance>
Nov 08 16:54:23 user nova-compute[74669]:   </metadata>
Nov 08 16:54:23 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:54:23 user nova-compute[74669]:     <system>
Nov 08 16:54:23 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:54:23 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:54:23 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:54:23 user nova-compute[74669]:       <entry name="serial">220b317c-a111-4600-b1e2-2a63e22de78a</entry>
Nov 08 16:54:23 user nova-compute[74669]:       <entry name="uuid">220b317c-a111-4600-b1e2-2a63e22de78a</entry>
Nov 08 16:54:23 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:54:23 user nova-compute[74669]:     </system>
Nov 08 16:54:23 user nova-compute[74669]:   </sysinfo>
Nov 08 16:54:23 user nova-compute[74669]:   <os>
Nov 08 16:54:23 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:54:23 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 16:54:23 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:54:23 user nova-compute[74669]:   </os>
Nov 08 16:54:23 user nova-compute[74669]:   <features>
Nov 08 16:54:23 user nova-compute[74669]:     <acpi/>
Nov 08 16:54:23 user nova-compute[74669]:     <apic/>
Nov 08 16:54:23 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:54:23 user nova-compute[74669]:   </features>
Nov 08 16:54:23 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:54:23 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:54:23 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:54:23 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:54:23 user nova-compute[74669]:   </clock>
Nov 08 16:54:23 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:54:23 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:54:23 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:54:23 user nova-compute[74669]:   </cpu>
Nov 08 16:54:23 user nova-compute[74669]:   <devices>
Nov 08 16:54:23 user nova-compute[74669]:     <disk type="file" device="cdrom">
Nov 08 16:54:23 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 16:54:23 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/220b317c-a111-4600-b1e2-2a63e22de78a/disk.config"/>
Nov 08 16:54:23 user nova-compute[74669]:       <target dev="hda" bus="ide"/>
Nov 08 16:54:23 user nova-compute[74669]:     </disk>
Nov 08 16:54:23 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 16:54:23 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:54:23 user nova-compute[74669]:       <source dev="/dev/sde"/>
Nov 08 16:54:23 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:54:23 user nova-compute[74669]:       <serial>734606a5-2915-4dc6-97dd-7ab519822f6e</serial>
Nov 08 16:54:23 user nova-compute[74669]:     </disk>
Nov 08 16:54:23 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 16:54:23 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:54:23 user nova-compute[74669]:       <source dev="/dev/sdf"/>
Nov 08 16:54:23 user nova-compute[74669]:       <target dev="vdb" bus="virtio"/>
Nov 08 16:54:23 user nova-compute[74669]:       <serial>391df8b1-b8a5-4886-9a8c-87fb65dfc5eb</serial>
Nov 08 16:54:23 user nova-compute[74669]:     </disk>
Nov 08 16:54:23 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 16:54:23 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:54:23 user nova-compute[74669]:       <source dev="/dev/sdg"/>
Nov 08 16:54:23 user nova-compute[74669]:       <target dev="vdc" bus="virtio"/>
Nov 08 16:54:23 user nova-compute[74669]:       <serial>9297ac72-cbae-419f-a8bf-4627f4075e5e</serial>
Nov 08 16:54:23 user nova-compute[74669]:     </disk>
Nov 08 16:54:23 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:54:23 user nova-compute[74669]:       <mac address="fa:16:3e:43:30:8e"/>
Nov 08 16:54:23 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:54:23 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:54:23 user nova-compute[74669]:       <target dev="tap4514f25c-5c"/>
Nov 08 16:54:23 user nova-compute[74669]:     </interface>
Nov 08 16:54:23 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:54:23 user nova-compute[74669]:       <mac address="fa:16:3e:aa:ef:0f"/>
Nov 08 16:54:23 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:54:23 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:54:23 user nova-compute[74669]:       <target dev="tap48f5d804-7e"/>
Nov 08 16:54:23 user nova-compute[74669]:     </interface>
Nov 08 16:54:23 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:54:23 user nova-compute[74669]:       <mac address="fa:16:3e:0b:c0:66"/>
Nov 08 16:54:23 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:54:23 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:54:23 user nova-compute[74669]:       <target dev="tap263210b8-c7"/>
Nov 08 16:54:23 user nova-compute[74669]:     </interface>
Nov 08 16:54:23 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:54:23 user nova-compute[74669]:       <mac address="fa:16:3e:87:0f:90"/>
Nov 08 16:54:23 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:54:23 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:54:23 user nova-compute[74669]:       <target dev="tap8a5cb6f9-46"/>
Nov 08 16:54:23 user nova-compute[74669]:     </interface>
Nov 08 16:54:23 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:54:23 user nova-compute[74669]:       <mac address="fa:16:3e:76:80:9f"/>
Nov 08 16:54:23 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:54:23 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:54:23 user nova-compute[74669]:       <target dev="tape7639563-89"/>
Nov 08 16:54:23 user nova-compute[74669]:     </interface>
Nov 08 16:54:23 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:54:23 user nova-compute[74669]:       <mac address="fa:16:3e:20:ca:e1"/>
Nov 08 16:54:23 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:54:23 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:54:23 user nova-compute[74669]:       <target dev="tapbcee60b9-29"/>
Nov 08 16:54:23 user nova-compute[74669]:     </interface>
Nov 08 16:54:23 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:54:23 user nova-compute[74669]:       <mac address="fa:16:3e:c4:68:51"/>
Nov 08 16:54:23 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:54:23 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:54:23 user nova-compute[74669]:       <target dev="tap6f6856bd-1e"/>
Nov 08 16:54:23 user nova-compute[74669]:     </interface>
Nov 08 16:54:23 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:54:23 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/220b317c-a111-4600-b1e2-2a63e22de78a/console.log" append="off"/>
Nov 08 16:54:23 user nova-compute[74669]:     </serial>
Nov 08 16:54:23 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:54:23 user nova-compute[74669]:     <video>
Nov 08 16:54:23 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:54:23 user nova-compute[74669]:     </video>
Nov 08 16:54:23 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:54:23 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:54:23 user nova-compute[74669]:     </rng>
Nov 08 16:54:23 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:54:23 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:54:23 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:54:23 user nova-compute[74669]:     </memballoon>
Nov 08 16:54:23 user nova-compute[74669]:   </devices>
Nov 08 16:54:23 user nova-compute[74669]: </domain>
Nov 08 16:54:23 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-881607780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-881607780',id=11,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm9lQ3SAiMNJZrxiyPCWI4ahlhBAnR9vvGizl11pHKwSyyBqoISKJhwufG6prBVxtppmree8vWIMKH/ZTi6sDbJkA+8UEh7PlmPeUfhVDPq9UvYWyRV2e1YAP/hna/EKg==',key_name='tempest-keypair-1554170018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef553fbdfa6a49f5bb2bdde29020e6ee',ramdisk_id='',reservation_id='r-vhxz9s0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-70363984',owner_user_name='tempest-TaggedBootDevicesTest_v242-70363984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d5080c9af64051ab23b87414b5ec48',uuid=220b317c-a111-4600-b1e2-2a63e22de78a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "address": "fa:16:3e:43:30:8e", "network": {"id": "8718876b-101b-476e-bede-b881ac6c346f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-189935542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4514f25c-5c", "ovs_interfaceid": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converting VIF {"id": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "address": "fa:16:3e:43:30:8e", "network": {"id": "8718876b-101b-476e-bede-b881ac6c346f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-189935542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4514f25c-5c", "ovs_interfaceid": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:30:8e,bridge_name='br-int',has_traffic_filtering=True,id=4514f25c-5ce0-4ba0-95cd-55298ce3e832,network=Network(8718876b-101b-476e-bede-b881ac6c346f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4514f25c-5c') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG os_vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:30:8e,bridge_name='br-int',has_traffic_filtering=True,id=4514f25c-5ce0-4ba0-95cd-55298ce3e832,network=Network(8718876b-101b-476e-bede-b881ac6c346f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4514f25c-5c') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea28b253-a302-522d-afd2-d30145bfc81c', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4514f25c-5c, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4514f25c-5c, col_values=(('qos', UUID('1b81179b-c461-420e-a2b4-0396753fbf53')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4514f25c-5c, col_values=(('external_ids', {'iface-id': '4514f25c-5ce0-4ba0-95cd-55298ce3e832', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:30:8e', 'vm-uuid': '220b317c-a111-4600-b1e2-2a63e22de78a'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: INFO os_vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:30:8e,bridge_name='br-int',has_traffic_filtering=True,id=4514f25c-5ce0-4ba0-95cd-55298ce3e832,network=Network(8718876b-101b-476e-bede-b881ac6c346f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4514f25c-5c')
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-881607780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-881607780',id=11,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm9lQ3SAiMNJZrxiyPCWI4ahlhBAnR9vvGizl11pHKwSyyBqoISKJhwufG6prBVxtppmree8vWIMKH/ZTi6sDbJkA+8UEh7PlmPeUfhVDPq9UvYWyRV2e1YAP/hna/EKg==',key_name='tempest-keypair-1554170018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef553fbdfa6a49f5bb2bdde29020e6ee',ramdisk_id='',reservation_id='r-vhxz9s0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-70363984',owner_user_name='tempest-TaggedBootDevicesTest_v242-70363984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d5080c9af64051ab23b87414b5ec48',uuid=220b317c-a111-4600-b1e2-2a63e22de78a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "address": "fa:16:3e:aa:ef:0f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f5d804-7e", "ovs_interfaceid": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converting VIF {"id": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "address": "fa:16:3e:aa:ef:0f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f5d804-7e", "ovs_interfaceid": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:ef:0f,bridge_name='br-int',has_traffic_filtering=True,id=48f5d804-7e38-4c85-af5e-ab6e55c736ac,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap48f5d804-7e') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG os_vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:ef:0f,bridge_name='br-int',has_traffic_filtering=True,id=48f5d804-7e38-4c85-af5e-ab6e55c736ac,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap48f5d804-7e') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e41fb21f-ab58-5429-8c73-bc5404b9b4f4', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48f5d804-7e, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48f5d804-7e, col_values=(('qos', UUID('dce6ca36-5a4e-485d-a5e2-221fda0515de')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48f5d804-7e, col_values=(('external_ids', {'iface-id': '48f5d804-7e38-4c85-af5e-ab6e55c736ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:ef:0f', 'vm-uuid': '220b317c-a111-4600-b1e2-2a63e22de78a'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: INFO os_vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:ef:0f,bridge_name='br-int',has_traffic_filtering=True,id=48f5d804-7e38-4c85-af5e-ab6e55c736ac,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap48f5d804-7e')
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-881607780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-881607780',id=11,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm9lQ3SAiMNJZrxiyPCWI4ahlhBAnR9vvGizl11pHKwSyyBqoISKJhwufG6prBVxtppmree8vWIMKH/ZTi6sDbJkA+8UEh7PlmPeUfhVDPq9UvYWyRV2e1YAP/hna/EKg==',key_name='tempest-keypair-1554170018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef553fbdfa6a49f5bb2bdde29020e6ee',ramdisk_id='',reservation_id='r-vhxz9s0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-70363984',owner_user_name='tempest-TaggedBootDevicesTest_v242-70363984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d5080c9af64051ab23b87414b5ec48',uuid=220b317c-a111-4600-b1e2-2a63e22de78a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "address": "fa:16:3e:0b:c0:66", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap263210b8-c7", "ovs_interfaceid": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converting VIF {"id": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "address": "fa:16:3e:0b:c0:66", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap263210b8-c7", "ovs_interfaceid": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c0:66,bridge_name='br-int',has_traffic_filtering=True,id=263210b8-c77f-49af-a1c0-146dcb0a5dc5,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap263210b8-c7') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG os_vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c0:66,bridge_name='br-int',has_traffic_filtering=True,id=263210b8-c77f-49af-a1c0-146dcb0a5dc5,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap263210b8-c7') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58891caf-f8c3-5836-9484-157448b82e21', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap263210b8-c7, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap263210b8-c7, col_values=(('qos', UUID('ca1bdda0-e43b-479b-9553-ab6d3dcb893b')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap263210b8-c7, col_values=(('external_ids', {'iface-id': '263210b8-c77f-49af-a1c0-146dcb0a5dc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:c0:66', 'vm-uuid': '220b317c-a111-4600-b1e2-2a63e22de78a'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: INFO os_vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c0:66,bridge_name='br-int',has_traffic_filtering=True,id=263210b8-c77f-49af-a1c0-146dcb0a5dc5,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap263210b8-c7')
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-881607780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-881607780',id=11,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm9lQ3SAiMNJZrxiyPCWI4ahlhBAnR9vvGizl11pHKwSyyBqoISKJhwufG6prBVxtppmree8vWIMKH/ZTi6sDbJkA+8UEh7PlmPeUfhVDPq9UvYWyRV2e1YAP/hna/EKg==',key_name='tempest-keypair-1554170018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef553fbdfa6a49f5bb2bdde29020e6ee',ramdisk_id='',reservation_id='r-vhxz9s0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-70363984',owner_user_name='tempest-TaggedBootDevicesTest_v242-70363984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d5080c9af64051ab23b87414b5ec48',uuid=220b317c-a111-4600-b1e2-2a63e22de78a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "address": "fa:16:3e:87:0f:90", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5cb6f9-46", "ovs_interfaceid": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converting VIF {"id": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "address": "fa:16:3e:87:0f:90", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5cb6f9-46", "ovs_interfaceid": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:0f:90,bridge_name='br-int',has_traffic_filtering=True,id=8a5cb6f9-4637-4473-a64d-651ebf09be49,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a5cb6f9-46') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG os_vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:0f:90,bridge_name='br-int',has_traffic_filtering=True,id=8a5cb6f9-4637-4473-a64d-651ebf09be49,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a5cb6f9-46') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f366e7bb-69a8-5cef-8b2a-5dd4d2ac38eb', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a5cb6f9-46, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a5cb6f9-46, col_values=(('qos', UUID('e7588b04-a459-41f4-a382-db00935adc62')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a5cb6f9-46, col_values=(('external_ids', {'iface-id': '8a5cb6f9-4637-4473-a64d-651ebf09be49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:0f:90', 'vm-uuid': '220b317c-a111-4600-b1e2-2a63e22de78a'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:24 user nova-compute[74669]: INFO os_vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:0f:90,bridge_name='br-int',has_traffic_filtering=True,id=8a5cb6f9-4637-4473-a64d-651ebf09be49,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a5cb6f9-46')
Nov 08 16:54:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-881607780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-881607780',id=11,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm9lQ3SAiMNJZrxiyPCWI4ahlhBAnR9vvGizl11pHKwSyyBqoISKJhwufG6prBVxtppmree8vWIMKH/ZTi6sDbJkA+8UEh7PlmPeUfhVDPq9UvYWyRV2e1YAP/hna/EKg==',key_name='tempest-keypair-1554170018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef553fbdfa6a49f5bb2bdde29020e6ee',ramdisk_id='',reservation_id='r-vhxz9s0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-70363984',owner_user_name='tempest-TaggedBootDevicesTest_v242-70363984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d5080c9af64051ab23b87414b5ec48',uuid=220b317c-a111-4600-b1e2-2a63e22de78a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "address": "fa:16:3e:76:80:9f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7639563-89", "ovs_interfaceid": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converting VIF {"id": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "address": "fa:16:3e:76:80:9f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7639563-89", "ovs_interfaceid": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:80:9f,bridge_name='br-int',has_traffic_filtering=True,id=e7639563-89fb-44bf-89e2-ca44e79ad44a,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7639563-89') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG os_vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:80:9f,bridge_name='br-int',has_traffic_filtering=True,id=e7639563-89fb-44bf-89e2-ca44e79ad44a,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7639563-89') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60b6a434-969f-53cd-8fd1-f53143404f0f', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7639563-89, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7639563-89, col_values=(('qos', UUID('233a8431-c338-420e-b600-d7b1b882186e')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7639563-89, col_values=(('external_ids', {'iface-id': 'e7639563-89fb-44bf-89e2-ca44e79ad44a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:80:9f', 'vm-uuid': '220b317c-a111-4600-b1e2-2a63e22de78a'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:24 user nova-compute[74669]: INFO os_vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:80:9f,bridge_name='br-int',has_traffic_filtering=True,id=e7639563-89fb-44bf-89e2-ca44e79ad44a,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7639563-89')
Nov 08 16:54:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-881607780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-881607780',id=11,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm9lQ3SAiMNJZrxiyPCWI4ahlhBAnR9vvGizl11pHKwSyyBqoISKJhwufG6prBVxtppmree8vWIMKH/ZTi6sDbJkA+8UEh7PlmPeUfhVDPq9UvYWyRV2e1YAP/hna/EKg==',key_name='tempest-keypair-1554170018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef553fbdfa6a49f5bb2bdde29020e6ee',ramdisk_id='',reservation_id='r-vhxz9s0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-70363984',owner_user_name='tempest-TaggedBootDevicesTest_v242-70363984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d5080c9af64051ab23b87414b5ec48',uuid=220b317c-a111-4600-b1e2-2a63e22de78a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "address": "fa:16:3e:20:ca:e1", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcee60b9-29", "ovs_interfaceid": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converting VIF {"id": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "address": "fa:16:3e:20:ca:e1", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcee60b9-29", "ovs_interfaceid": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:ca:e1,bridge_name='br-int',has_traffic_filtering=True,id=bcee60b9-29f1-49cd-b769-d3dbf7b0f11d,network=Network(d87f85ee-10af-4cbb-9514-02cc98f3edfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcee60b9-29') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG os_vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:ca:e1,bridge_name='br-int',has_traffic_filtering=True,id=bcee60b9-29f1-49cd-b769-d3dbf7b0f11d,network=Network(d87f85ee-10af-4cbb-9514-02cc98f3edfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcee60b9-29') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e382fad7-89ea-5a1d-a1bf-864b2fe01c97', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcee60b9-29, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbcee60b9-29, col_values=(('qos', UUID('ee160d93-1f80-4a72-9f8f-e58fc62446fe')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbcee60b9-29, col_values=(('external_ids', {'iface-id': 'bcee60b9-29f1-49cd-b769-d3dbf7b0f11d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:ca:e1', 'vm-uuid': '220b317c-a111-4600-b1e2-2a63e22de78a'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:24 user nova-compute[74669]: INFO os_vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:ca:e1,bridge_name='br-int',has_traffic_filtering=True,id=bcee60b9-29f1-49cd-b769-d3dbf7b0f11d,network=Network(d87f85ee-10af-4cbb-9514-02cc98f3edfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcee60b9-29')
Nov 08 16:54:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-881607780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-881607780',id=11,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm9lQ3SAiMNJZrxiyPCWI4ahlhBAnR9vvGizl11pHKwSyyBqoISKJhwufG6prBVxtppmree8vWIMKH/ZTi6sDbJkA+8UEh7PlmPeUfhVDPq9UvYWyRV2e1YAP/hna/EKg==',key_name='tempest-keypair-1554170018',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef553fbdfa6a49f5bb2bdde29020e6ee',ramdisk_id='',reservation_id='r-vhxz9s0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-70363984',owner_user_name='tempest-TaggedBootDevicesTest_v242-70363984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d5080c9af64051ab23b87414b5ec48',uuid=220b317c-a111-4600-b1e2-2a63e22de78a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "address": "fa:16:3e:c4:68:51", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6856bd-1e", "ovs_interfaceid": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converting VIF {"id": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "address": "fa:16:3e:c4:68:51", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6856bd-1e", "ovs_interfaceid": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:68:51,bridge_name='br-int',has_traffic_filtering=True,id=6f6856bd-1e1d-406b-8d39-7f3f288d135b,network=Network(d87f85ee-10af-4cbb-9514-02cc98f3edfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f6856bd-1e') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG os_vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:68:51,bridge_name='br-int',has_traffic_filtering=True,id=6f6856bd-1e1d-406b-8d39-7f3f288d135b,network=Network(d87f85ee-10af-4cbb-9514-02cc98f3edfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f6856bd-1e') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6eb372c0-60ed-50cd-90d5-e51c27c5592a', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f6856bd-1e, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f6856bd-1e, col_values=(('qos', UUID('2374b466-663e-4cff-8acb-5a03b3bbbfc7')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f6856bd-1e, col_values=(('external_ids', {'iface-id': '6f6856bd-1e1d-406b-8d39-7f3f288d135b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:68:51', 'vm-uuid': '220b317c-a111-4600-b1e2-2a63e22de78a'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:24 user nova-compute[74669]: INFO os_vif [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:68:51,bridge_name='br-int',has_traffic_filtering=True,id=6f6856bd-1e1d-406b-8d39-7f3f288d135b,network=Network(d87f85ee-10af-4cbb-9514-02cc98f3edfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f6856bd-1e')
Nov 08 16:54:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] No BDM found with device name hda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] No VIF found with MAC fa:16:3e:43:30:8e, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] No VIF found with MAC fa:16:3e:76:80:9f, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:54:24 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Using config drive
Nov 08 16:54:24 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Creating config drive at /opt/stack/data/nova/instances/220b317c-a111-4600-b1e2-2a63e22de78a/disk.config
Nov 08 16:54:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/220b317c-a111-4600-b1e2-2a63e22de78a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpq490236m {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/220b317c-a111-4600-b1e2-2a63e22de78a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpq490236m" returned: 0 in 0.057s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-5c3bb6e6-af77-4c78-a65c-d8acf3a49905 req-04661d07-1a3b-4a24-bdbb-4afe89e13dbf service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-plugged-4514f25c-5ce0-4ba0-95cd-55298ce3e832 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:54:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5c3bb6e6-af77-4c78-a65c-d8acf3a49905 req-04661d07-1a3b-4a24-bdbb-4afe89e13dbf service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5c3bb6e6-af77-4c78-a65c-d8acf3a49905 req-04661d07-1a3b-4a24-bdbb-4afe89e13dbf service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5c3bb6e6-af77-4c78-a65c-d8acf3a49905 req-04661d07-1a3b-4a24-bdbb-4afe89e13dbf service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-5c3bb6e6-af77-4c78-a65c-d8acf3a49905 req-04661d07-1a3b-4a24-bdbb-4afe89e13dbf service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-plugged-4514f25c-5ce0-4ba0-95cd-55298ce3e832 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:54:26 user nova-compute[74669]: WARNING nova.compute.manager [req-5c3bb6e6-af77-4c78-a65c-d8acf3a49905 req-04661d07-1a3b-4a24-bdbb-4afe89e13dbf service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received unexpected event network-vif-plugged-4514f25c-5ce0-4ba0-95cd-55298ce3e832 for instance with vm_state building and task_state spawning.
Nov 08 16:54:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-1c33bb9c-8771-4a67-a7b5-d2eeb2d837d6 req-7da28d4d-53ab-4116-b218-287d95fc18d2 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-plugged-263210b8-c77f-49af-a1c0-146dcb0a5dc5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1c33bb9c-8771-4a67-a7b5-d2eeb2d837d6 req-7da28d4d-53ab-4116-b218-287d95fc18d2 service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1c33bb9c-8771-4a67-a7b5-d2eeb2d837d6 req-7da28d4d-53ab-4116-b218-287d95fc18d2 service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1c33bb9c-8771-4a67-a7b5-d2eeb2d837d6 req-7da28d4d-53ab-4116-b218-287d95fc18d2 service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-1c33bb9c-8771-4a67-a7b5-d2eeb2d837d6 req-7da28d4d-53ab-4116-b218-287d95fc18d2 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-plugged-263210b8-c77f-49af-a1c0-146dcb0a5dc5 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:54:27 user nova-compute[74669]: WARNING nova.compute.manager [req-1c33bb9c-8771-4a67-a7b5-d2eeb2d837d6 req-7da28d4d-53ab-4116-b218-287d95fc18d2 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received unexpected event network-vif-plugged-263210b8-c77f-49af-a1c0-146dcb0a5dc5 for instance with vm_state building and task_state spawning.
Nov 08 16:54:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-964a2ceb-9d4b-417f-aab1-d97d9cf899ee req-64cbcc92-15f3-47d1-9fff-34cf8a413346 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-plugged-48f5d804-7e38-4c85-af5e-ab6e55c736ac {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-964a2ceb-9d4b-417f-aab1-d97d9cf899ee req-64cbcc92-15f3-47d1-9fff-34cf8a413346 service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-964a2ceb-9d4b-417f-aab1-d97d9cf899ee req-64cbcc92-15f3-47d1-9fff-34cf8a413346 service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-964a2ceb-9d4b-417f-aab1-d97d9cf899ee req-64cbcc92-15f3-47d1-9fff-34cf8a413346 service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-964a2ceb-9d4b-417f-aab1-d97d9cf899ee req-64cbcc92-15f3-47d1-9fff-34cf8a413346 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-plugged-48f5d804-7e38-4c85-af5e-ab6e55c736ac {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:54:27 user nova-compute[74669]: WARNING nova.compute.manager [req-964a2ceb-9d4b-417f-aab1-d97d9cf899ee req-64cbcc92-15f3-47d1-9fff-34cf8a413346 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received unexpected event network-vif-plugged-48f5d804-7e38-4c85-af5e-ab6e55c736ac for instance with vm_state building and task_state spawning.
Nov 08 16:54:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-plugged-4514f25c-5ce0-4ba0-95cd-55298ce3e832 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-plugged-4514f25c-5ce0-4ba0-95cd-55298ce3e832 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:54:28 user nova-compute[74669]: WARNING nova.compute.manager [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received unexpected event network-vif-plugged-4514f25c-5ce0-4ba0-95cd-55298ce3e832 for instance with vm_state building and task_state spawning.
Nov 08 16:54:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-plugged-8a5cb6f9-4637-4473-a64d-651ebf09be49 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-plugged-8a5cb6f9-4637-4473-a64d-651ebf09be49 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:54:28 user nova-compute[74669]: WARNING nova.compute.manager [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received unexpected event network-vif-plugged-8a5cb6f9-4637-4473-a64d-651ebf09be49 for instance with vm_state building and task_state spawning.
Nov 08 16:54:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-plugged-8a5cb6f9-4637-4473-a64d-651ebf09be49 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-plugged-8a5cb6f9-4637-4473-a64d-651ebf09be49 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:54:28 user nova-compute[74669]: WARNING nova.compute.manager [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received unexpected event network-vif-plugged-8a5cb6f9-4637-4473-a64d-651ebf09be49 for instance with vm_state building and task_state spawning.
Nov 08 16:54:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-plugged-e7639563-89fb-44bf-89e2-ca44e79ad44a {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-plugged-e7639563-89fb-44bf-89e2-ca44e79ad44a {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:54:28 user nova-compute[74669]: WARNING nova.compute.manager [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received unexpected event network-vif-plugged-e7639563-89fb-44bf-89e2-ca44e79ad44a for instance with vm_state building and task_state spawning.
Nov 08 16:54:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-plugged-e7639563-89fb-44bf-89e2-ca44e79ad44a {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-plugged-e7639563-89fb-44bf-89e2-ca44e79ad44a {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:54:28 user nova-compute[74669]: WARNING nova.compute.manager [req-b53f094f-c606-4ae1-b85a-a594719ee2cb req-03a41e9e-7226-4439-84d5-7e36bdf4778d service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received unexpected event network-vif-plugged-e7639563-89fb-44bf-89e2-ca44e79ad44a for instance with vm_state building and task_state spawning.
Nov 08 16:54:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG nova.objects.instance [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lazy-loading 'flavor' on Instance uuid 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.109s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-d818c764-f8b6-4241-8943-84428385ab50 req-29caeb30-eccf-4caa-8916-b9da2c7d12b1 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-plugged-263210b8-c77f-49af-a1c0-146dcb0a5dc5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d818c764-f8b6-4241-8943-84428385ab50 req-29caeb30-eccf-4caa-8916-b9da2c7d12b1 service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d818c764-f8b6-4241-8943-84428385ab50 req-29caeb30-eccf-4caa-8916-b9da2c7d12b1 service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d818c764-f8b6-4241-8943-84428385ab50 req-29caeb30-eccf-4caa-8916-b9da2c7d12b1 service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-d818c764-f8b6-4241-8943-84428385ab50 req-29caeb30-eccf-4caa-8916-b9da2c7d12b1 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-plugged-263210b8-c77f-49af-a1c0-146dcb0a5dc5 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:54:29 user nova-compute[74669]: WARNING nova.compute.manager [req-d818c764-f8b6-4241-8943-84428385ab50 req-29caeb30-eccf-4caa-8916-b9da2c7d12b1 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received unexpected event network-vif-plugged-263210b8-c77f-49af-a1c0-146dcb0a5dc5 for instance with vm_state building and task_state spawning.
Nov 08 16:54:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-plugged-48f5d804-7e38-4c85-af5e-ab6e55c736ac {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-plugged-48f5d804-7e38-4c85-af5e-ab6e55c736ac {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:54:29 user nova-compute[74669]: WARNING nova.compute.manager [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received unexpected event network-vif-plugged-48f5d804-7e38-4c85-af5e-ab6e55c736ac for instance with vm_state building and task_state spawning.
Nov 08 16:54:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-plugged-bcee60b9-29f1-49cd-b769-d3dbf7b0f11d {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-plugged-bcee60b9-29f1-49cd-b769-d3dbf7b0f11d {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:54:29 user nova-compute[74669]: WARNING nova.compute.manager [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received unexpected event network-vif-plugged-bcee60b9-29f1-49cd-b769-d3dbf7b0f11d for instance with vm_state building and task_state spawning.
Nov 08 16:54:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-plugged-bcee60b9-29f1-49cd-b769-d3dbf7b0f11d {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-plugged-bcee60b9-29f1-49cd-b769-d3dbf7b0f11d {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:54:29 user nova-compute[74669]: WARNING nova.compute.manager [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received unexpected event network-vif-plugged-bcee60b9-29f1-49cd-b769-d3dbf7b0f11d for instance with vm_state building and task_state spawning.
Nov 08 16:54:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-plugged-6f6856bd-1e1d-406b-8d39-7f3f288d135b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-plugged-6f6856bd-1e1d-406b-8d39-7f3f288d135b {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:54:29 user nova-compute[74669]: WARNING nova.compute.manager [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received unexpected event network-vif-plugged-6f6856bd-1e1d-406b-8d39-7f3f288d135b for instance with vm_state building and task_state spawning.
Nov 08 16:54:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-plugged-6f6856bd-1e1d-406b-8d39-7f3f288d135b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-plugged-6f6856bd-1e1d-406b-8d39-7f3f288d135b {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:54:29 user nova-compute[74669]: WARNING nova.compute.manager [req-369e7332-8654-4697-a7c7-631c382d6f36 req-7fca6c32-43e0-424f-a5da-6bcaf4411442 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received unexpected event network-vif-plugged-6f6856bd-1e1d-406b-8d39-7f3f288d135b for instance with vm_state building and task_state spawning.
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:29 user nova-compute[74669]: INFO nova.compute.manager [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Attaching volume 3991b324-673d-4a72-97b0-e1e7c10a2cb6 to /dev/vdb
Nov 08 16:54:29 user nova-compute[74669]: DEBUG os_brick.utils [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[933fd0c0-7872-4c5e-8679-494d6c9752f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec18376a-92bc-4a5c-ad19-4aead790a07c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6715b2d-2f53-4795-be9b-4ef4cbc92b59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[776588b9-cc33-44e1-b02f-df586fd23c64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:54:29 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 16:54:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6696f8db-5469-4d01-8f0c-e734db5e69d8]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG os_brick.utils [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:54:29 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Updating existing volume attachment record: d417b7b3-b1ff-43bb-9953-f60770768b25 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 16:54:30 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2d42d5ce-db73-40e6-9b35-f662a3cf0091 is timed out.
Nov 08 16:54:30 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Successfully detached device vdb from instance 2d42d5ce-db73-40e6-9b35-f662a3cf0091 from the live domain config.
Nov 08 16:54:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OyWPztDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:54:30 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:54:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3d0734-30c0-49d5-9eb4-0cf26afc98c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 16:54:30 user nova-compute[74669]: No targets found.
Nov 08 16:54:30 user nova-compute[74669]: iSNS:
Nov 08 16:54:30 user nova-compute[74669]: No targets found.
Nov 08 16:54:30 user nova-compute[74669]: STATIC:
Nov 08 16:54:30 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e
Nov 08 16:54:30 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:54:30 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:54:30 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724
Nov 08 16:54:30 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:54:30 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:54:30 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e
Nov 08 16:54:30 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:54:30 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:54:30 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549
Nov 08 16:54:30 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:54:30 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:54:30 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338
Nov 08 16:54:30 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:54:30 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:54:30 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb
Nov 08 16:54:30 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:54:30 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:54:30 user nova-compute[74669]: FIRMWARE:
Nov 08 16:54:30 user nova-compute[74669]: No targets found.
Nov 08 16:54:30 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 16:54:30 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 16:54:30 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd771678-4dc6-484d-a19c-cc2c36547d7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8487b4-d6f3-475b-b078-90f384f51511]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:54:30 user nova-compute[74669]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)
Nov 08 16:54:30 user nova-compute[74669]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)
Nov 08 16:54:30 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:54:30 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:54:30 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:54:30 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 (non-flash)
Nov 08 16:54:30 user nova-compute[74669]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)
Nov 08 16:54:30 user nova-compute[74669]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)
Nov 08 16:54:30 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:54:30 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:54:30 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:54:30 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9a86c56c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549'): ({'sdb'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Removing single pathed devices sdb {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cc0bb1-c6b7-4815-95ff-66929e031c20]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5ad849-34c1-4f57-b1ea-b24d2bdb0e70]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Flushing IO for device /dev/sdb {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ea9147-3383-418d-97d9-516a0ba4bce2]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[014f0b1c-c0bd-4af9-8974-8594701115fc]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6377f32-a5e0-45b0-8d87-bdc68ec2a417]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c39fb2-b09e-46cb-bf3b-4683a1dfb581]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549, portal: 172.16.0.220,3260]
Nov 08 16:54:30 user nova-compute[74669]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549, portal: 172.16.0.220,3260] successful.
Nov 08 16:54:30 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26382ef-45b7-4063-974b-908194781549 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f7de91-0df3-4c47-bce4-dd3dbc98f8fb]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] <== disconnect_volume: return (342ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG nova.compute.manager [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 16:54:30 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Instance spawned successfully.
Nov 08 16:54:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:54:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:54:31 user nova-compute[74669]: INFO nova.compute.manager [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Took 11.60 seconds to spawn the instance on the hypervisor.
Nov 08 16:54:31 user nova-compute[74669]: DEBUG nova.compute.manager [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:54:31 user nova-compute[74669]: INFO nova.compute.manager [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Took 90.39 seconds to build instance.
Nov 08 16:54:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f7c68912-9995-433d-8f16-45ba8e7b55d0 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "220b317c-a111-4600-b1e2-2a63e22de78a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 90.504s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:32 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance af94bfaa-45bc-4bac-9594-f363fce8727e is timed out.
Nov 08 16:54:32 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Successfully detached device vdb from instance af94bfaa-45bc-4bac-9594-f363fce8727e from the live domain config.
Nov 08 16:54:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IOPcnjZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:54:32 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:54:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[70565038-3057-4af5-8f92-bfa59d255b94]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 16:54:32 user nova-compute[74669]: No targets found.
Nov 08 16:54:32 user nova-compute[74669]: iSNS:
Nov 08 16:54:32 user nova-compute[74669]: No targets found.
Nov 08 16:54:32 user nova-compute[74669]: STATIC:
Nov 08 16:54:32 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e
Nov 08 16:54:32 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:54:32 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:54:32 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724
Nov 08 16:54:32 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:54:32 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:54:32 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e
Nov 08 16:54:32 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:54:32 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:54:32 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338
Nov 08 16:54:32 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:54:32 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:54:32 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb
Nov 08 16:54:32 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:54:32 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:54:32 user nova-compute[74669]: FIRMWARE:
Nov 08 16:54:32 user nova-compute[74669]: No targets found.
Nov 08 16:54:32 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 16:54:32 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 16:54:32 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9458048b-1a0c-48ac-aac9-2df5f647ea22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e86a836-89f0-4ad1-9ac3-a89a6fce1e57]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)
Nov 08 16:54:32 user nova-compute[74669]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)
Nov 08 16:54:32 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:54:32 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:54:32 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:54:32 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 (non-flash)
Nov 08 16:54:32 user nova-compute[74669]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)
Nov 08 16:54:32 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:54:32 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:54:32 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:54:32 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9a869b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724'): ({'sdc'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Removing single pathed devices sdc {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bbed4c-b94a-4eab-9e2e-9023f2bd5074]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[11645ad3-7b53-484f-b889-a21a534471c3]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Flushing IO for device /dev/sdc {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6656edb-4b9f-42b2-a91b-5e525fd20b40]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[691b208f-0a7d-41ba-85b3-d488acf07350]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95c74df-eeb5-45a0-b749-58b815121cc8]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f62784-393e-47a4-8726-fcdd776e7354]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724, portal: 172.16.0.220,3260]
Nov 08 16:54:32 user nova-compute[74669]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724, portal: 172.16.0.220,3260] successful.
Nov 08 16:54:32 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:133613f9-81c9-4bdb-afc9-8279252a2724 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[81527d34-dd87-4532-8624-19d340ee8e44]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] <== disconnect_volume: return (365ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 16:54:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:33 user nova-compute[74669]: DEBUG nova.objects.instance [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Lazy-loading 'flavor' on Instance uuid af94bfaa-45bc-4bac-9594-f363fce8727e {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:54:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-19815d3a-2fb8-4d01-a45a-3c3b30c2f324 tempest-VolumesAssistedSnapshotsTest-1609567892 tempest-VolumesAssistedSnapshotsTest-1609567892-project-admin] Lock "af94bfaa-45bc-4bac-9594-f363fce8727e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.080s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:35 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3ef7e79a-203b-4608-a430-1dc99f46e326 is timed out.
Nov 08 16:54:35 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Successfully detached device vdb from instance 3ef7e79a-203b-4608-a430-1dc99f46e326 from the live domain config.
Nov 08 16:54:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OINiegPE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:54:35 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:54:35 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[46860e78-db35-473d-9c6d-0c89606df670]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 16:54:35 user nova-compute[74669]: No targets found.
Nov 08 16:54:35 user nova-compute[74669]: iSNS:
Nov 08 16:54:35 user nova-compute[74669]: No targets found.
Nov 08 16:54:35 user nova-compute[74669]: STATIC:
Nov 08 16:54:35 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e
Nov 08 16:54:35 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:54:35 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:54:35 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e
Nov 08 16:54:35 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:54:35 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:54:35 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338
Nov 08 16:54:35 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:54:35 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:54:35 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb
Nov 08 16:54:35 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:54:35 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:54:35 user nova-compute[74669]: FIRMWARE:
Nov 08 16:54:35 user nova-compute[74669]: No targets found.
Nov 08 16:54:35 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 16:54:35 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 16:54:35 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6235a84e-7102-4d3a-9b04-9b04f33f00ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[af54c3f0-068e-4135-bdb2-f4f186361769]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)
Nov 08 16:54:35 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:54:35 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:54:35 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:54:35 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 (non-flash)
Nov 08 16:54:35 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:54:35 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:54:35 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:54:35 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9846935b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338'): ({'sdd'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Removing single pathed devices sdd {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ffe02f-48ed-49a7-80bb-531054b98f33]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[27269839-acd4-4e52-a986-1ddb4ec84c91]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Flushing IO for device /dev/sdd {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a8f051-f187-487b-aadc-c8d1b8baddd1]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 16:54:35 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.281s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:36 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8205183-cd67-4172-9031-38a33b9e53f5]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:36 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 16:54:36 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] SCSI volumes sdd have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 16:54:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 16:54:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:36 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb51d1cc-d013-4ed6-88f7-b5a3db457472]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:36 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b475a97-1fc7-4019-9089-94b1f13c03cb]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338, portal: 172.16.0.220,3260]
Nov 08 16:54:36 user nova-compute[74669]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338, portal: 172.16.0.220,3260] successful.
Nov 08 16:54:36 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:784ddfad-a40f-4ed9-bf24-3def870cd338 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:36 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[149ac994-0428-4d72-b10d-6da1429a7072]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.594s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:54:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] <== disconnect_volume: return (596ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:54:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 16:54:37 user nova-compute[74669]: DEBUG nova.objects.instance [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lazy-loading 'flavor' on Instance uuid 3ef7e79a-203b-4608-a430-1dc99f46e326 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:54:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5e09cc3e-87d1-4b6c-838d-fe8d8aaeb59d tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.275s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Acquiring lock "interface-3ef7e79a-203b-4608-a430-1dc99f46e326-b769ad45-f1a8-47b6-9629-1e1a8137957f" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "interface-3ef7e79a-203b-4608-a430-1dc99f46e326-b769ad45-f1a8-47b6-9629-1e1a8137957f" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:37 user nova-compute[74669]: DEBUG nova.objects.instance [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lazy-loading 'flavor' on Instance uuid 3ef7e79a-203b-4608-a430-1dc99f46e326 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:54:37 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:51:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1645332005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1645332005',id=9,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB3a26wXBmbxS9Ie0rPCqATNjmL9SLaLhAobRJrF3o3vA4h0CU2n8HUE7/qd69ompZDoYTJsZEmW00PGjMGmRpCjD/lO91lrU6txPCpNQUdBwQTXu0cZgfMZw/6mElCMQ==',key_name='tempest-keypair-961371252',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:51:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='363debcc70b64500b0822f6dd6f27ae2',ramdisk_id='',reservation_id='r-gineojlh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1985002595',owner_user_name='tempest-TaggedAttachmentsTest-1985002595-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:51:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f25ebab8f83408d8cee32efb4cd93ad',uuid=3ef7e79a-203b-4608-a430-1dc99f46e326,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "address": "fa:16:3e:7e:98:57", "network": {"id": "30f3ce95-cb0a-44df-ac36-3d590ecd5e19", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-434432325", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb769ad45-f1", "ovs_interfaceid": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:54:37 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Converting VIF {"id": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "address": "fa:16:3e:7e:98:57", "network": {"id": "30f3ce95-cb0a-44df-ac36-3d590ecd5e19", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-434432325", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb769ad45-f1", "ovs_interfaceid": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:54:37 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:98:57,bridge_name='br-int',has_traffic_filtering=True,id=b769ad45-f1a8-47b6-9629-1e1a8137957f,network=Network(30f3ce95-cb0a-44df-ac36-3d590ecd5e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb769ad45-f1') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:54:37 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7e:98:57"/><model type="virtio"/><mtu size="1442"/><target dev="tapb769ad45-f1"/></interface> {{(pid=74669) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 16:54:37 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7e:98:57"/><model type="virtio"/><mtu size="1442"/><target dev="tapb769ad45-f1"/></interface> {{(pid=74669) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 16:54:37 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Attempting to detach device tapb769ad45-f1 from instance 3ef7e79a-203b-4608-a430-1dc99f46e326 from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 16:54:37 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] detach device xml: <interface type="ethernet">
Nov 08 16:54:37 user nova-compute[74669]:   <mac address="fa:16:3e:7e:98:57"/>
Nov 08 16:54:37 user nova-compute[74669]:   <model type="virtio"/>
Nov 08 16:54:37 user nova-compute[74669]:   <mtu size="1442"/>
Nov 08 16:54:37 user nova-compute[74669]:   <target dev="tapb769ad45-f1"/>
Nov 08 16:54:37 user nova-compute[74669]: </interface>
Nov 08 16:54:37 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 16:54:37 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7e:98:57"/><model type="virtio"/><mtu size="1442"/><target dev="tapb769ad45-f1"/></interface> {{(pid=74669) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 16:54:37 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7e:98:57"/><model type="virtio"/><mtu size="1442"/><target dev="tapb769ad45-f1"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 08 16:54:37 user nova-compute[74669]:   <name>instance-00000009</name>
Nov 08 16:54:37 user nova-compute[74669]:   <uuid>3ef7e79a-203b-4608-a430-1dc99f46e326</uuid>
Nov 08 16:54:37 user nova-compute[74669]:   <metadata>
Nov 08 16:54:37 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:54:37 user nova-compute[74669]:   <nova:package version="0.0.0"/>
Nov 08 16:54:37 user nova-compute[74669]:   <nova:name>tempest-device-tagging-server-1645332005</nova:name>
Nov 08 16:54:37 user nova-compute[74669]:   <nova:creationTime>2023-11-08 16:53:38</nova:creationTime>
Nov 08 16:54:37 user nova-compute[74669]:   <nova:flavor name="m1.tiny">
Nov 08 16:54:37 user nova-compute[74669]:     <nova:memory>512</nova:memory>
Nov 08 16:54:37 user nova-compute[74669]:     <nova:disk>1</nova:disk>
Nov 08 16:54:37 user nova-compute[74669]:     <nova:swap>0</nova:swap>
Nov 08 16:54:37 user nova-compute[74669]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:54:37 user nova-compute[74669]:     <nova:vcpus>1</nova:vcpus>
Nov 08 16:54:37 user nova-compute[74669]:   </nova:flavor>
Nov 08 16:54:37 user nova-compute[74669]:   <nova:owner>
Nov 08 16:54:37 user nova-compute[74669]:     <nova:user uuid="1f25ebab8f83408d8cee32efb4cd93ad">tempest-TaggedAttachmentsTest-1985002595-project-member</nova:user>
Nov 08 16:54:37 user nova-compute[74669]:     <nova:project uuid="363debcc70b64500b0822f6dd6f27ae2">tempest-TaggedAttachmentsTest-1985002595</nova:project>
Nov 08 16:54:37 user nova-compute[74669]:   </nova:owner>
Nov 08 16:54:37 user nova-compute[74669]:   <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:54:37 user nova-compute[74669]:   <nova:ports>
Nov 08 16:54:37 user nova-compute[74669]:     <nova:port uuid="bdd3c052-b244-491c-ae59-dcea51d10b48">
Nov 08 16:54:37 user nova-compute[74669]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 16:54:37 user nova-compute[74669]:     </nova:port>
Nov 08 16:54:37 user nova-compute[74669]:     <nova:port uuid="b769ad45-f1a8-47b6-9629-1e1a8137957f">
Nov 08 16:54:37 user nova-compute[74669]:       <nova:ip type="fixed" address="10.10.10.49" ipVersion="4"/>
Nov 08 16:54:37 user nova-compute[74669]:     </nova:port>
Nov 08 16:54:37 user nova-compute[74669]:   </nova:ports>
Nov 08 16:54:37 user nova-compute[74669]: </nova:instance>
Nov 08 16:54:37 user nova-compute[74669]:   </metadata>
Nov 08 16:54:37 user nova-compute[74669]:   <memory unit='KiB'>524288</memory>
Nov 08 16:54:37 user nova-compute[74669]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 16:54:37 user nova-compute[74669]:   <vcpu placement='static'>1</vcpu>
Nov 08 16:54:37 user nova-compute[74669]:   <resource>
Nov 08 16:54:37 user nova-compute[74669]:     <partition>/machine</partition>
Nov 08 16:54:37 user nova-compute[74669]:   </resource>
Nov 08 16:54:37 user nova-compute[74669]:   <sysinfo type='smbios'>
Nov 08 16:54:37 user nova-compute[74669]:     <system>
Nov 08 16:54:37 user nova-compute[74669]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 16:54:37 user nova-compute[74669]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 16:54:37 user nova-compute[74669]:       <entry name='version'>0.0.0</entry>
Nov 08 16:54:37 user nova-compute[74669]:       <entry name='serial'>3ef7e79a-203b-4608-a430-1dc99f46e326</entry>
Nov 08 16:54:37 user nova-compute[74669]:       <entry name='uuid'>3ef7e79a-203b-4608-a430-1dc99f46e326</entry>
Nov 08 16:54:37 user nova-compute[74669]:       <entry name='family'>Virtual Machine</entry>
Nov 08 16:54:37 user nova-compute[74669]:     </system>
Nov 08 16:54:37 user nova-compute[74669]:   </sysinfo>
Nov 08 16:54:37 user nova-compute[74669]:   <os>
Nov 08 16:54:37 user nova-compute[74669]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 16:54:37 user nova-compute[74669]:     <boot dev='hd'/>
Nov 08 16:54:37 user nova-compute[74669]:     <smbios mode='sysinfo'/>
Nov 08 16:54:37 user nova-compute[74669]:   </os>
Nov 08 16:54:37 user nova-compute[74669]:   <features>
Nov 08 16:54:37 user nova-compute[74669]:     <acpi/>
Nov 08 16:54:37 user nova-compute[74669]:     <apic/>
Nov 08 16:54:37 user nova-compute[74669]:     <vmcoreinfo state='on'/>
Nov 08 16:54:37 user nova-compute[74669]:   </features>
Nov 08 16:54:37 user nova-compute[74669]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 16:54:37 user nova-compute[74669]:     <model fallback='forbid'>Nehalem</model>
Nov 08 16:54:37 user nova-compute[74669]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 16:54:37 user nova-compute[74669]:     <feature policy='require' name='vme'/>
Nov 08 16:54:37 user nova-compute[74669]:     <feature policy='require' name='x2apic'/>
Nov 08 16:54:37 user nova-compute[74669]:     <feature policy='require' name='hypervisor'/>
Nov 08 16:54:37 user nova-compute[74669]:   </cpu>
Nov 08 16:54:37 user nova-compute[74669]:   <clock offset='utc'>
Nov 08 16:54:37 user nova-compute[74669]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 16:54:37 user nova-compute[74669]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 16:54:37 user nova-compute[74669]:     <timer name='hpet' present='no'/>
Nov 08 16:54:37 user nova-compute[74669]:   </clock>
Nov 08 16:54:37 user nova-compute[74669]:   <on_poweroff>destroy</on_poweroff>
Nov 08 16:54:37 user nova-compute[74669]:   <on_reboot>restart</on_reboot>
Nov 08 16:54:37 user nova-compute[74669]:   <on_crash>destroy</on_crash>
Nov 08 16:54:37 user nova-compute[74669]:   <devices>
Nov 08 16:54:37 user nova-compute[74669]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 16:54:37 user nova-compute[74669]:     <disk type='file' device='disk'>
Nov 08 16:54:37 user nova-compute[74669]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 16:54:37 user nova-compute[74669]:       <source file='/opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk' index='2'/>
Nov 08 16:54:37 user nova-compute[74669]:       <backingStore type='file' index='3'>
Nov 08 16:54:37 user nova-compute[74669]:         <format type='raw'/>
Nov 08 16:54:37 user nova-compute[74669]:         <source file='/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956'/>
Nov 08 16:54:37 user nova-compute[74669]:         <backingStore/>
Nov 08 16:54:37 user nova-compute[74669]:       </backingStore>
Nov 08 16:54:37 user nova-compute[74669]:       <target dev='vda' bus='virtio'/>
Nov 08 16:54:37 user nova-compute[74669]:       <alias name='virtio-disk0'/>
Nov 08 16:54:37 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 16:54:37 user nova-compute[74669]:     </disk>
Nov 08 16:54:37 user nova-compute[74669]:     <disk type='file' device='cdrom'>
Nov 08 16:54:37 user nova-compute[74669]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 16:54:37 user nova-compute[74669]:       <source file='/opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk.config' index='1'/>
Nov 08 16:54:37 user nova-compute[74669]:       <backingStore/>
Nov 08 16:54:37 user nova-compute[74669]:       <target dev='hda' bus='ide'/>
Nov 08 16:54:37 user nova-compute[74669]:       <readonly/>
Nov 08 16:54:37 user nova-compute[74669]:       <alias name='ide0-0-0'/>
Nov 08 16:54:37 user nova-compute[74669]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 16:54:37 user nova-compute[74669]:     </disk>
Nov 08 16:54:37 user nova-compute[74669]:     <controller type='usb' index='0' model='none'>
Nov 08 16:54:37 user nova-compute[74669]:       <alias name='usb'/>
Nov 08 16:54:37 user nova-compute[74669]:     </controller>
Nov 08 16:54:37 user nova-compute[74669]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 16:54:37 user nova-compute[74669]:       <alias name='pci.0'/>
Nov 08 16:54:37 user nova-compute[74669]:     </controller>
Nov 08 16:54:37 user nova-compute[74669]:     <controller type='ide' index='0'>
Nov 08 16:54:37 user nova-compute[74669]:       <alias name='ide'/>
Nov 08 16:54:37 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 16:54:37 user nova-compute[74669]:     </controller>
Nov 08 16:54:37 user nova-compute[74669]:     <interface type='ethernet'>
Nov 08 16:54:37 user nova-compute[74669]:       <mac address='fa:16:3e:c7:e2:a1'/>
Nov 08 16:54:37 user nova-compute[74669]:       <target dev='tapbdd3c052-b2'/>
Nov 08 16:54:37 user nova-compute[74669]:       <model type='virtio'/>
Nov 08 16:54:37 user nova-compute[74669]:       <mtu size='1442'/>
Nov 08 16:54:37 user nova-compute[74669]:       <alias name='net0'/>
Nov 08 16:54:37 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 16:54:37 user nova-compute[74669]:     </interface>
Nov 08 16:54:37 user nova-compute[74669]:     <interface type='ethernet'>
Nov 08 16:54:37 user nova-compute[74669]:       <mac address='fa:16:3e:7e:98:57'/>
Nov 08 16:54:37 user nova-compute[74669]:       <target dev='tapb769ad45-f1'/>
Nov 08 16:54:37 user nova-compute[74669]:       <model type='virtio'/>
Nov 08 16:54:37 user nova-compute[74669]:       <mtu size='1442'/>
Nov 08 16:54:37 user nova-compute[74669]:       <alias name='net1'/>
Nov 08 16:54:37 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 08 16:54:37 user nova-compute[74669]:     </interface>
Nov 08 16:54:37 user nova-compute[74669]:     <serial type='pty'>
Nov 08 16:54:37 user nova-compute[74669]:       <source path='/dev/pts/8'/>
Nov 08 16:54:37 user nova-compute[74669]:       <log file='/opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/console.log' append='off'/>
Nov 08 16:54:37 user nova-compute[74669]:       <target type='isa-serial' port='0'>
Nov 08 16:54:37 user nova-compute[74669]:         <model name='isa-serial'/>
Nov 08 16:54:37 user nova-compute[74669]:       </target>
Nov 08 16:54:37 user nova-compute[74669]:       <alias name='serial0'/>
Nov 08 16:54:37 user nova-compute[74669]:     </serial>
Nov 08 16:54:37 user nova-compute[74669]:     <console type='pty' tty='/dev/pts/8'>
Nov 08 16:54:37 user nova-compute[74669]:       <source path='/dev/pts/8'/>
Nov 08 16:54:37 user nova-compute[74669]:       <log file='/opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/console.log' append='off'/>
Nov 08 16:54:37 user nova-compute[74669]:       <target type='serial' port='0'/>
Nov 08 16:54:37 user nova-compute[74669]:       <alias name='serial0'/>
Nov 08 16:54:37 user nova-compute[74669]:     </console>
Nov 08 16:54:37 user nova-compute[74669]:     <input type='mouse' bus='ps2'>
Nov 08 16:54:37 user nova-compute[74669]:       <alias name='input0'/>
Nov 08 16:54:37 user nova-compute[74669]:     </input>
Nov 08 16:54:37 user nova-compute[74669]:     <input type='keyboard' bus='ps2'>
Nov 08 16:54:37 user nova-compute[74669]:       <alias name='input1'/>
Nov 08 16:54:37 user nova-compute[74669]:     </input>
Nov 08 16:54:37 user nova-compute[74669]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 08 16:54:37 user nova-compute[74669]:       <listen type='address' address='0.0.0.0'/>
Nov 08 16:54:37 user nova-compute[74669]:     </graphics>
Nov 08 16:54:37 user nova-compute[74669]:     <audio id='1' type='none'/>
Nov 08 16:54:37 user nova-compute[74669]:     <video>
Nov 08 16:54:37 user nova-compute[74669]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 16:54:37 user nova-compute[74669]:       <alias name='video0'/>
Nov 08 16:54:37 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 16:54:37 user nova-compute[74669]:     </video>
Nov 08 16:54:37 user nova-compute[74669]:     <memballoon model='virtio'>
Nov 08 16:54:37 user nova-compute[74669]:       <stats period='10'/>
Nov 08 16:54:37 user nova-compute[74669]:       <alias name='balloon0'/>
Nov 08 16:54:37 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 16:54:37 user nova-compute[74669]:     </memballoon>
Nov 08 16:54:37 user nova-compute[74669]:     <rng model='virtio'>
Nov 08 16:54:37 user nova-compute[74669]:       <backend model='random'>/dev/urandom</backend>
Nov 08 16:54:37 user nova-compute[74669]:       <alias name='rng0'/>
Nov 08 16:54:37 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 16:54:37 user nova-compute[74669]:     </rng>
Nov 08 16:54:37 user nova-compute[74669]:   </devices>
Nov 08 16:54:37 user nova-compute[74669]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 16:54:37 user nova-compute[74669]:     <label>libvirt-3ef7e79a-203b-4608-a430-1dc99f46e326</label>
Nov 08 16:54:37 user nova-compute[74669]:     <imagelabel>libvirt-3ef7e79a-203b-4608-a430-1dc99f46e326</imagelabel>
Nov 08 16:54:37 user nova-compute[74669]:   </seclabel>
Nov 08 16:54:37 user nova-compute[74669]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 16:54:37 user nova-compute[74669]:     <label>+64055:+108</label>
Nov 08 16:54:37 user nova-compute[74669]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 16:54:37 user nova-compute[74669]:   </seclabel>
Nov 08 16:54:37 user nova-compute[74669]: </domain>
Nov 08 16:54:37 user nova-compute[74669]:  {{(pid=74669) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 16:54:37 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Successfully detached device tapb769ad45-f1 from instance 3ef7e79a-203b-4608-a430-1dc99f46e326 from the persistent domain config.
Nov 08 16:54:37 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] (1/8): Attempting to detach device tapb769ad45-f1 with device alias net1 from instance 3ef7e79a-203b-4608-a430-1dc99f46e326 from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 16:54:37 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] detach device xml: <interface type="ethernet">
Nov 08 16:54:37 user nova-compute[74669]:   <mac address="fa:16:3e:7e:98:57"/>
Nov 08 16:54:37 user nova-compute[74669]:   <model type="virtio"/>
Nov 08 16:54:37 user nova-compute[74669]:   <mtu size="1442"/>
Nov 08 16:54:37 user nova-compute[74669]:   <target dev="tapb769ad45-f1"/>
Nov 08 16:54:37 user nova-compute[74669]: </interface>
Nov 08 16:54:37 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 16:54:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Start waiting for the detach event from libvirt for device tapb769ad45-f1 with device alias net1 for instance 3ef7e79a-203b-4608-a430-1dc99f46e326 {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 16:54:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:38 user nova-compute[74669]: DEBUG nova.compute.manager [req-5a6890a6-08c5-4e3d-a36b-ffdf90f56d90 req-bcb41a8f-2940-4640-a397-27ac17964164 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Received event network-vif-unplugged-b769ad45-f1a8-47b6-9629-1e1a8137957f {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:54:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5a6890a6-08c5-4e3d-a36b-ffdf90f56d90 req-bcb41a8f-2940-4640-a397-27ac17964164 service nova] Acquiring lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5a6890a6-08c5-4e3d-a36b-ffdf90f56d90 req-bcb41a8f-2940-4640-a397-27ac17964164 service nova] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5a6890a6-08c5-4e3d-a36b-ffdf90f56d90 req-bcb41a8f-2940-4640-a397-27ac17964164 service nova] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:38 user nova-compute[74669]: DEBUG nova.compute.manager [req-5a6890a6-08c5-4e3d-a36b-ffdf90f56d90 req-bcb41a8f-2940-4640-a397-27ac17964164 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] No waiting events found dispatching network-vif-unplugged-b769ad45-f1a8-47b6-9629-1e1a8137957f {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:54:38 user nova-compute[74669]: WARNING nova.compute.manager [req-5a6890a6-08c5-4e3d-a36b-ffdf90f56d90 req-bcb41a8f-2940-4640-a397-27ac17964164 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Received unexpected event network-vif-unplugged-b769ad45-f1a8-47b6-9629-1e1a8137957f for instance with vm_state active and task_state None.
Nov 08 16:54:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-27eff57e-9fea-46b6-a08e-a46f1cf68b2c req-467bb37d-b5f3-4d75-8dff-a578191c4e81 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Received event network-vif-plugged-b769ad45-f1a8-47b6-9629-1e1a8137957f {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:54:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-27eff57e-9fea-46b6-a08e-a46f1cf68b2c req-467bb37d-b5f3-4d75-8dff-a578191c4e81 service nova] Acquiring lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-27eff57e-9fea-46b6-a08e-a46f1cf68b2c req-467bb37d-b5f3-4d75-8dff-a578191c4e81 service nova] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-27eff57e-9fea-46b6-a08e-a46f1cf68b2c req-467bb37d-b5f3-4d75-8dff-a578191c4e81 service nova] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-27eff57e-9fea-46b6-a08e-a46f1cf68b2c req-467bb37d-b5f3-4d75-8dff-a578191c4e81 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] No waiting events found dispatching network-vif-plugged-b769ad45-f1a8-47b6-9629-1e1a8137957f {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:54:40 user nova-compute[74669]: WARNING nova.compute.manager [req-27eff57e-9fea-46b6-a08e-a46f1cf68b2c req-467bb37d-b5f3-4d75-8dff-a578191c4e81 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Received unexpected event network-vif-plugged-b769ad45-f1a8-47b6-9629-1e1a8137957f for instance with vm_state active and task_state None.
Nov 08 16:54:40 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:54:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:40 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:54:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 16:54:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 16:54:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 16:54:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:45 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:54:45 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:54:45 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=7764MB free_disk=25.615299224853516GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:54:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:45 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:54:45 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:54:45 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:54:45 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b26dbeeb-b629-414d-bcca-cdde6c207789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:54:45 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2d42d5ce-db73-40e6-9b35-f662a3cf0091 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:54:45 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance af94bfaa-45bc-4bac-9594-f363fce8727e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:54:45 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 3ef7e79a-203b-4608-a430-1dc99f46e326 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:54:45 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0829b734-daec-4dc6-b24b-cbe89000160c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:54:45 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 220b317c-a111-4600-b1e2-2a63e22de78a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:54:45 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:54:45 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG nova.objects.instance [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lazy-loading 'flavor' on Instance uuid 2d42d5ce-db73-40e6-9b35-f662a3cf0091 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "b26dbeeb-b629-414d-bcca-cdde6c207789" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2dc2a028-d0bf-4c99-b58a-264b865f53b3 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 36.611s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG nova.objects.instance [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lazy-loading 'flavor' on Instance uuid b26dbeeb-b629-414d-bcca-cdde6c207789 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.111s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "b26dbeeb-b629-414d-bcca-cdde6c207789" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:46 user nova-compute[74669]: INFO nova.compute.manager [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Attaching volume f1176f50-24fe-4e13-aa36-02955f521263 to /dev/vdb
Nov 08 16:54:46 user nova-compute[74669]: DEBUG os_brick.utils [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ccf596-926c-4cbc-9baa-dfe5e147934c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1beb667-64a6-4790-8f7e-af0a613d385b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f077111-b683-4517-ba51-0309053eaceb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9840fc2-86ce-492b-ad59-917bc873315d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:54:46 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 16:54:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fb51fb-9ea7-4a72-880d-54169a65bbf1]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG os_brick.utils [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:54:46 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Updating existing volume attachment record: 30249633-b2e3-4433-a828-bf882cf6c5ca {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 16:54:47 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:54:47 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:54:47 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:54:47 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:54:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:54:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:54:47 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 16:54:47 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Updating instance_info_cache with network_info: [{"id": "525ba5da-155c-4f87-9fae-8db52836f73e", "address": "fa:16:3e:7b:7c:e2", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525ba5da-15", "ovs_interfaceid": "525ba5da-155c-4f87-9fae-8db52836f73e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:54:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:54:47 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 16:54:47 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:54:47 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:54:47 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:54:47 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:54:47 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:54:47 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:54:47 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:54:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:54:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "0829b734-daec-4dc6-b24b-cbe89000160c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "0829b734-daec-4dc6-b24b-cbe89000160c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:54 user nova-compute[74669]: DEBUG nova.objects.instance [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lazy-loading 'flavor' on Instance uuid 0829b734-daec-4dc6-b24b-cbe89000160c {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:54:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "0829b734-daec-4dc6-b24b-cbe89000160c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "0829b734-daec-4dc6-b24b-cbe89000160c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:54:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "0829b734-daec-4dc6-b24b-cbe89000160c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:54:54 user nova-compute[74669]: INFO nova.compute.manager [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Attaching volume 081598cb-5af2-45bf-b15f-cfc2ff95f630 to /dev/vdb
Nov 08 16:54:55 user nova-compute[74669]: DEBUG os_brick.utils [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:54:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[36df72d7-acd6-481a-b14f-a567672d3afa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1e47df-24a4-4f93-8de5-230e0839779f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1de4831-3493-4839-a0fc-dfb853d977af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0b4a32-4b3b-461a-a790-6ae69a532904]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:54:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 16:54:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:54:55 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 16:54:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[85143b5e-a3d9-4930-af58-595614d00362]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 16:54:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 16:54:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 16:54:55 user nova-compute[74669]: DEBUG os_brick.utils [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:54:55 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Updating existing volume attachment record: ecd3222a-a22a-483f-81d1-cf4f86e824eb {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 16:54:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:58 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Waiting for libvirt event about the detach of device tapb769ad45-f1 with device alias net1 from instance 3ef7e79a-203b-4608-a430-1dc99f46e326 is timed out.
Nov 08 16:54:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7e:98:57"/><model type="virtio"/><mtu size="1442"/><target dev="tapb769ad45-f1"/></interface> {{(pid=74669) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 16:54:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7e:98:57"/><model type="virtio"/><mtu size="1442"/><target dev="tapb769ad45-f1"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 08 16:54:58 user nova-compute[74669]:   <name>instance-00000009</name>
Nov 08 16:54:58 user nova-compute[74669]:   <uuid>3ef7e79a-203b-4608-a430-1dc99f46e326</uuid>
Nov 08 16:54:58 user nova-compute[74669]:   <metadata>
Nov 08 16:54:58 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:54:58 user nova-compute[74669]:   <nova:package version="0.0.0"/>
Nov 08 16:54:58 user nova-compute[74669]:   <nova:name>tempest-device-tagging-server-1645332005</nova:name>
Nov 08 16:54:58 user nova-compute[74669]:   <nova:creationTime>2023-11-08 16:53:38</nova:creationTime>
Nov 08 16:54:58 user nova-compute[74669]:   <nova:flavor name="m1.tiny">
Nov 08 16:54:58 user nova-compute[74669]:     <nova:memory>512</nova:memory>
Nov 08 16:54:58 user nova-compute[74669]:     <nova:disk>1</nova:disk>
Nov 08 16:54:58 user nova-compute[74669]:     <nova:swap>0</nova:swap>
Nov 08 16:54:58 user nova-compute[74669]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:54:58 user nova-compute[74669]:     <nova:vcpus>1</nova:vcpus>
Nov 08 16:54:58 user nova-compute[74669]:   </nova:flavor>
Nov 08 16:54:58 user nova-compute[74669]:   <nova:owner>
Nov 08 16:54:58 user nova-compute[74669]:     <nova:user uuid="1f25ebab8f83408d8cee32efb4cd93ad">tempest-TaggedAttachmentsTest-1985002595-project-member</nova:user>
Nov 08 16:54:58 user nova-compute[74669]:     <nova:project uuid="363debcc70b64500b0822f6dd6f27ae2">tempest-TaggedAttachmentsTest-1985002595</nova:project>
Nov 08 16:54:58 user nova-compute[74669]:   </nova:owner>
Nov 08 16:54:58 user nova-compute[74669]:   <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:54:58 user nova-compute[74669]:   <nova:ports>
Nov 08 16:54:58 user nova-compute[74669]:     <nova:port uuid="bdd3c052-b244-491c-ae59-dcea51d10b48">
Nov 08 16:54:58 user nova-compute[74669]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 16:54:58 user nova-compute[74669]:     </nova:port>
Nov 08 16:54:58 user nova-compute[74669]:     <nova:port uuid="b769ad45-f1a8-47b6-9629-1e1a8137957f">
Nov 08 16:54:58 user nova-compute[74669]:       <nova:ip type="fixed" address="10.10.10.49" ipVersion="4"/>
Nov 08 16:54:58 user nova-compute[74669]:     </nova:port>
Nov 08 16:54:58 user nova-compute[74669]:   </nova:ports>
Nov 08 16:54:58 user nova-compute[74669]: </nova:instance>
Nov 08 16:54:58 user nova-compute[74669]:   </metadata>
Nov 08 16:54:58 user nova-compute[74669]:   <memory unit='KiB'>524288</memory>
Nov 08 16:54:58 user nova-compute[74669]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 16:54:58 user nova-compute[74669]:   <vcpu placement='static'>1</vcpu>
Nov 08 16:54:58 user nova-compute[74669]:   <resource>
Nov 08 16:54:58 user nova-compute[74669]:     <partition>/machine</partition>
Nov 08 16:54:58 user nova-compute[74669]:   </resource>
Nov 08 16:54:58 user nova-compute[74669]:   <sysinfo type='smbios'>
Nov 08 16:54:58 user nova-compute[74669]:     <system>
Nov 08 16:54:58 user nova-compute[74669]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 16:54:58 user nova-compute[74669]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 16:54:58 user nova-compute[74669]:       <entry name='version'>0.0.0</entry>
Nov 08 16:54:58 user nova-compute[74669]:       <entry name='serial'>3ef7e79a-203b-4608-a430-1dc99f46e326</entry>
Nov 08 16:54:58 user nova-compute[74669]:       <entry name='uuid'>3ef7e79a-203b-4608-a430-1dc99f46e326</entry>
Nov 08 16:54:58 user nova-compute[74669]:       <entry name='family'>Virtual Machine</entry>
Nov 08 16:54:58 user nova-compute[74669]:     </system>
Nov 08 16:54:58 user nova-compute[74669]:   </sysinfo>
Nov 08 16:54:58 user nova-compute[74669]:   <os>
Nov 08 16:54:58 user nova-compute[74669]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 16:54:58 user nova-compute[74669]:     <boot dev='hd'/>
Nov 08 16:54:58 user nova-compute[74669]:     <smbios mode='sysinfo'/>
Nov 08 16:54:58 user nova-compute[74669]:   </os>
Nov 08 16:54:58 user nova-compute[74669]:   <features>
Nov 08 16:54:58 user nova-compute[74669]:     <acpi/>
Nov 08 16:54:58 user nova-compute[74669]:     <apic/>
Nov 08 16:54:58 user nova-compute[74669]:     <vmcoreinfo state='on'/>
Nov 08 16:54:58 user nova-compute[74669]:   </features>
Nov 08 16:54:58 user nova-compute[74669]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 16:54:58 user nova-compute[74669]:     <model fallback='forbid'>Nehalem</model>
Nov 08 16:54:58 user nova-compute[74669]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 16:54:58 user nova-compute[74669]:     <feature policy='require' name='vme'/>
Nov 08 16:54:58 user nova-compute[74669]:     <feature policy='require' name='x2apic'/>
Nov 08 16:54:58 user nova-compute[74669]:     <feature policy='require' name='hypervisor'/>
Nov 08 16:54:58 user nova-compute[74669]:   </cpu>
Nov 08 16:54:58 user nova-compute[74669]:   <clock offset='utc'>
Nov 08 16:54:58 user nova-compute[74669]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 16:54:58 user nova-compute[74669]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 16:54:58 user nova-compute[74669]:     <timer name='hpet' present='no'/>
Nov 08 16:54:58 user nova-compute[74669]:   </clock>
Nov 08 16:54:58 user nova-compute[74669]:   <on_poweroff>destroy</on_poweroff>
Nov 08 16:54:58 user nova-compute[74669]:   <on_reboot>restart</on_reboot>
Nov 08 16:54:58 user nova-compute[74669]:   <on_crash>destroy</on_crash>
Nov 08 16:54:58 user nova-compute[74669]:   <devices>
Nov 08 16:54:58 user nova-compute[74669]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 16:54:58 user nova-compute[74669]:     <disk type='file' device='disk'>
Nov 08 16:54:58 user nova-compute[74669]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 16:54:58 user nova-compute[74669]:       <source file='/opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk' index='2'/>
Nov 08 16:54:58 user nova-compute[74669]:       <backingStore type='file' index='3'>
Nov 08 16:54:58 user nova-compute[74669]:         <format type='raw'/>
Nov 08 16:54:58 user nova-compute[74669]:         <source file='/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956'/>
Nov 08 16:54:58 user nova-compute[74669]:         <backingStore/>
Nov 08 16:54:58 user nova-compute[74669]:       </backingStore>
Nov 08 16:54:58 user nova-compute[74669]:       <target dev='vda' bus='virtio'/>
Nov 08 16:54:58 user nova-compute[74669]:       <alias name='virtio-disk0'/>
Nov 08 16:54:58 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 16:54:58 user nova-compute[74669]:     </disk>
Nov 08 16:54:58 user nova-compute[74669]:     <disk type='file' device='cdrom'>
Nov 08 16:54:58 user nova-compute[74669]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 16:54:58 user nova-compute[74669]:       <source file='/opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk.config' index='1'/>
Nov 08 16:54:58 user nova-compute[74669]:       <backingStore/>
Nov 08 16:54:58 user nova-compute[74669]:       <target dev='hda' bus='ide'/>
Nov 08 16:54:58 user nova-compute[74669]:       <readonly/>
Nov 08 16:54:58 user nova-compute[74669]:       <alias name='ide0-0-0'/>
Nov 08 16:54:58 user nova-compute[74669]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 16:54:58 user nova-compute[74669]:     </disk>
Nov 08 16:54:58 user nova-compute[74669]:     <controller type='usb' index='0' model='none'>
Nov 08 16:54:58 user nova-compute[74669]:       <alias name='usb'/>
Nov 08 16:54:58 user nova-compute[74669]:     </controller>
Nov 08 16:54:58 user nova-compute[74669]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 16:54:58 user nova-compute[74669]:       <alias name='pci.0'/>
Nov 08 16:54:58 user nova-compute[74669]:     </controller>
Nov 08 16:54:58 user nova-compute[74669]:     <controller type='ide' index='0'>
Nov 08 16:54:58 user nova-compute[74669]:       <alias name='ide'/>
Nov 08 16:54:58 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 16:54:58 user nova-compute[74669]:     </controller>
Nov 08 16:54:58 user nova-compute[74669]:     <interface type='ethernet'>
Nov 08 16:54:58 user nova-compute[74669]:       <mac address='fa:16:3e:c7:e2:a1'/>
Nov 08 16:54:58 user nova-compute[74669]:       <target dev='tapbdd3c052-b2'/>
Nov 08 16:54:58 user nova-compute[74669]:       <model type='virtio'/>
Nov 08 16:54:58 user nova-compute[74669]:       <mtu size='1442'/>
Nov 08 16:54:58 user nova-compute[74669]:       <alias name='net0'/>
Nov 08 16:54:58 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 16:54:58 user nova-compute[74669]:     </interface>
Nov 08 16:54:58 user nova-compute[74669]:     <serial type='pty'>
Nov 08 16:54:58 user nova-compute[74669]:       <source path='/dev/pts/8'/>
Nov 08 16:54:58 user nova-compute[74669]:       <log file='/opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/console.log' append='off'/>
Nov 08 16:54:58 user nova-compute[74669]:       <target type='isa-serial' port='0'>
Nov 08 16:54:58 user nova-compute[74669]:         <model name='isa-serial'/>
Nov 08 16:54:58 user nova-compute[74669]:       </target>
Nov 08 16:54:58 user nova-compute[74669]:       <alias name='serial0'/>
Nov 08 16:54:58 user nova-compute[74669]:     </serial>
Nov 08 16:54:58 user nova-compute[74669]:     <console type='pty' tty='/dev/pts/8'>
Nov 08 16:54:58 user nova-compute[74669]:       <source path='/dev/pts/8'/>
Nov 08 16:54:58 user nova-compute[74669]:       <log file='/opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/console.log' append='off'/>
Nov 08 16:54:58 user nova-compute[74669]:       <target type='serial' port='0'/>
Nov 08 16:54:58 user nova-compute[74669]:       <alias name='serial0'/>
Nov 08 16:54:58 user nova-compute[74669]:     </console>
Nov 08 16:54:58 user nova-compute[74669]:     <input type='mouse' bus='ps2'>
Nov 08 16:54:58 user nova-compute[74669]:       <alias name='input0'/>
Nov 08 16:54:58 user nova-compute[74669]:     </input>
Nov 08 16:54:58 user nova-compute[74669]:     <input type='keyboard' bus='ps2'>
Nov 08 16:54:58 user nova-compute[74669]:       <alias name='input1'/>
Nov 08 16:54:58 user nova-compute[74669]:     </input>
Nov 08 16:54:58 user nova-compute[74669]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 08 16:54:58 user nova-compute[74669]:       <listen type='address' address='0.0.0.0'/>
Nov 08 16:54:58 user nova-compute[74669]:     </graphics>
Nov 08 16:54:58 user nova-compute[74669]:     <audio id='1' type='none'/>
Nov 08 16:54:58 user nova-compute[74669]:     <video>
Nov 08 16:54:58 user nova-compute[74669]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 16:54:58 user nova-compute[74669]:       <alias name='video0'/>
Nov 08 16:54:58 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 16:54:58 user nova-compute[74669]:     </video>
Nov 08 16:54:58 user nova-compute[74669]:     <memballoon model='virtio'>
Nov 08 16:54:58 user nova-compute[74669]:       <stats period='10'/>
Nov 08 16:54:58 user nova-compute[74669]:       <alias name='balloon0'/>
Nov 08 16:54:58 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 16:54:58 user nova-compute[74669]:     </memballoon>
Nov 08 16:54:58 user nova-compute[74669]:     <rng model='virtio'>
Nov 08 16:54:58 user nova-compute[74669]:       <backend model='random'>/dev/urandom</backend>
Nov 08 16:54:58 user nova-compute[74669]:       <alias name='rng0'/>
Nov 08 16:54:58 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 16:54:58 user nova-compute[74669]:     </rng>
Nov 08 16:54:58 user nova-compute[74669]:   </devices>
Nov 08 16:54:58 user nova-compute[74669]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 16:54:58 user nova-compute[74669]:     <label>libvirt-3ef7e79a-203b-4608-a430-1dc99f46e326</label>
Nov 08 16:54:58 user nova-compute[74669]:     <imagelabel>libvirt-3ef7e79a-203b-4608-a430-1dc99f46e326</imagelabel>
Nov 08 16:54:58 user nova-compute[74669]:   </seclabel>
Nov 08 16:54:58 user nova-compute[74669]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 16:54:58 user nova-compute[74669]:     <label>+64055:+108</label>
Nov 08 16:54:58 user nova-compute[74669]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 16:54:58 user nova-compute[74669]:   </seclabel>
Nov 08 16:54:58 user nova-compute[74669]: </domain>
Nov 08 16:54:58 user nova-compute[74669]:  {{(pid=74669) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 16:54:58 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Successfully detached device tapb769ad45-f1 from instance 3ef7e79a-203b-4608-a430-1dc99f46e326 from the live domain config.
Nov 08 16:54:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:51:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1645332005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1645332005',id=9,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB3a26wXBmbxS9Ie0rPCqATNjmL9SLaLhAobRJrF3o3vA4h0CU2n8HUE7/qd69ompZDoYTJsZEmW00PGjMGmRpCjD/lO91lrU6txPCpNQUdBwQTXu0cZgfMZw/6mElCMQ==',key_name='tempest-keypair-961371252',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:51:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='363debcc70b64500b0822f6dd6f27ae2',ramdisk_id='',reservation_id='r-gineojlh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1985002595',owner_user_name='tempest-TaggedAttachmentsTest-1985002595-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:51:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f25ebab8f83408d8cee32efb4cd93ad',uuid=3ef7e79a-203b-4608-a430-1dc99f46e326,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "address": "fa:16:3e:7e:98:57", "network": {"id": "30f3ce95-cb0a-44df-ac36-3d590ecd5e19", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-434432325", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb769ad45-f1", "ovs_interfaceid": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:54:58 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Converting VIF {"id": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "address": "fa:16:3e:7e:98:57", "network": {"id": "30f3ce95-cb0a-44df-ac36-3d590ecd5e19", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-434432325", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb769ad45-f1", "ovs_interfaceid": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:54:58 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:98:57,bridge_name='br-int',has_traffic_filtering=True,id=b769ad45-f1a8-47b6-9629-1e1a8137957f,network=Network(30f3ce95-cb0a-44df-ac36-3d590ecd5e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb769ad45-f1') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:54:58 user nova-compute[74669]: DEBUG os_vif [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:98:57,bridge_name='br-int',has_traffic_filtering=True,id=b769ad45-f1a8-47b6-9629-1e1a8137957f,network=Network(30f3ce95-cb0a-44df-ac36-3d590ecd5e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb769ad45-f1') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:54:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb769ad45-f1, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fc5ee847-5521-41a3-86de-4b95bd360f6e) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:54:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:58 user nova-compute[74669]: INFO os_vif [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:98:57,bridge_name='br-int',has_traffic_filtering=True,id=b769ad45-f1a8-47b6-9629-1e1a8137957f,network=Network(30f3ce95-cb0a-44df-ac36-3d590ecd5e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb769ad45-f1')
Nov 08 16:54:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:54:58 user nova-compute[74669]:   <nova:package version="0.0.0"/>
Nov 08 16:54:58 user nova-compute[74669]:   <nova:name>tempest-device-tagging-server-1645332005</nova:name>
Nov 08 16:54:58 user nova-compute[74669]:   <nova:creationTime>2023-11-08 16:54:58</nova:creationTime>
Nov 08 16:54:58 user nova-compute[74669]:   <nova:flavor name="m1.tiny">
Nov 08 16:54:58 user nova-compute[74669]:     <nova:memory>512</nova:memory>
Nov 08 16:54:58 user nova-compute[74669]:     <nova:disk>1</nova:disk>
Nov 08 16:54:58 user nova-compute[74669]:     <nova:swap>0</nova:swap>
Nov 08 16:54:58 user nova-compute[74669]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:54:58 user nova-compute[74669]:     <nova:vcpus>1</nova:vcpus>
Nov 08 16:54:58 user nova-compute[74669]:   </nova:flavor>
Nov 08 16:54:58 user nova-compute[74669]:   <nova:owner>
Nov 08 16:54:58 user nova-compute[74669]:     <nova:user uuid="1f25ebab8f83408d8cee32efb4cd93ad">tempest-TaggedAttachmentsTest-1985002595-project-member</nova:user>
Nov 08 16:54:58 user nova-compute[74669]:     <nova:project uuid="363debcc70b64500b0822f6dd6f27ae2">tempest-TaggedAttachmentsTest-1985002595</nova:project>
Nov 08 16:54:58 user nova-compute[74669]:   </nova:owner>
Nov 08 16:54:58 user nova-compute[74669]:   <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:54:58 user nova-compute[74669]:   <nova:ports>
Nov 08 16:54:58 user nova-compute[74669]:     <nova:port uuid="bdd3c052-b244-491c-ae59-dcea51d10b48">
Nov 08 16:54:58 user nova-compute[74669]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 16:54:58 user nova-compute[74669]:     </nova:port>
Nov 08 16:54:58 user nova-compute[74669]:   </nova:ports>
Nov 08 16:54:58 user nova-compute[74669]: </nova:instance>
Nov 08 16:54:58 user nova-compute[74669]:  {{(pid=74669) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 16:54:58 user nova-compute[74669]: DEBUG nova.compute.manager [req-a4ec6e84-0920-4ebd-b5ef-5d17e1ba562c req-aabb9639-3425-4488-aa5c-0ba8216ec33b service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Received event network-vif-deleted-b769ad45-f1a8-47b6-9629-1e1a8137957f {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:54:58 user nova-compute[74669]: INFO nova.compute.manager [req-a4ec6e84-0920-4ebd-b5ef-5d17e1ba562c req-aabb9639-3425-4488-aa5c-0ba8216ec33b service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Neutron deleted interface b769ad45-f1a8-47b6-9629-1e1a8137957f; detaching it from the instance and deleting it from the info cache
Nov 08 16:54:58 user nova-compute[74669]: DEBUG nova.network.neutron [req-a4ec6e84-0920-4ebd-b5ef-5d17e1ba562c req-aabb9639-3425-4488-aa5c-0ba8216ec33b service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Updating instance_info_cache with network_info: [{"id": "bdd3c052-b244-491c-ae59-dcea51d10b48", "address": "fa:16:3e:c7:e2:a1", "network": {"id": "bdc4b376-712f-45e1-aaf4-64336de2ba9b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-338712334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd3c052-b2", "ovs_interfaceid": "bdd3c052-b244-491c-ae59-dcea51d10b48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:54:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Acquiring lock "refresh_cache-3ef7e79a-203b-4608-a430-1dc99f46e326" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:54:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Acquired lock "refresh_cache-3ef7e79a-203b-4608-a430-1dc99f46e326" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:54:58 user nova-compute[74669]: DEBUG nova.network.neutron [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:54:58 user nova-compute[74669]: DEBUG nova.objects.instance [req-a4ec6e84-0920-4ebd-b5ef-5d17e1ba562c req-aabb9639-3425-4488-aa5c-0ba8216ec33b service nova] Lazy-loading 'system_metadata' on Instance uuid 3ef7e79a-203b-4608-a430-1dc99f46e326 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG nova.objects.instance [req-a4ec6e84-0920-4ebd-b5ef-5d17e1ba562c req-aabb9639-3425-4488-aa5c-0ba8216ec33b service nova] Lazy-loading 'flavor' on Instance uuid 3ef7e79a-203b-4608-a430-1dc99f46e326 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG nova.objects.base [req-a4ec6e84-0920-4ebd-b5ef-5d17e1ba562c req-aabb9639-3425-4488-aa5c-0ba8216ec33b service nova] Object Instance<3ef7e79a-203b-4608-a430-1dc99f46e326> lazy-loaded attributes: system_metadata,flavor {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [req-a4ec6e84-0920-4ebd-b5ef-5d17e1ba562c req-aabb9639-3425-4488-aa5c-0ba8216ec33b service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:51:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1645332005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1645332005',id=9,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB3a26wXBmbxS9Ie0rPCqATNjmL9SLaLhAobRJrF3o3vA4h0CU2n8HUE7/qd69ompZDoYTJsZEmW00PGjMGmRpCjD/lO91lrU6txPCpNQUdBwQTXu0cZgfMZw/6mElCMQ==',key_name='tempest-keypair-961371252',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:51:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='363debcc70b64500b0822f6dd6f27ae2',ramdisk_id='',reservation_id='r-gineojlh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1985002595',owner_user_name='tempest-TaggedAttachmentsTest-1985002595-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:51:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f25ebab8f83408d8cee32efb4cd93ad',uuid=3ef7e79a-203b-4608-a430-1dc99f46e326,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "address": "fa:16:3e:7e:98:57", "network": {"id": "30f3ce95-cb0a-44df-ac36-3d590ecd5e19", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-434432325", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb769ad45-f1", "ovs_interfaceid": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG nova.network.os_vif_util [req-a4ec6e84-0920-4ebd-b5ef-5d17e1ba562c req-aabb9639-3425-4488-aa5c-0ba8216ec33b service nova] Converting VIF {"id": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "address": "fa:16:3e:7e:98:57", "network": {"id": "30f3ce95-cb0a-44df-ac36-3d590ecd5e19", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-434432325", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb769ad45-f1", "ovs_interfaceid": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG nova.network.os_vif_util [req-a4ec6e84-0920-4ebd-b5ef-5d17e1ba562c req-aabb9639-3425-4488-aa5c-0ba8216ec33b service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:98:57,bridge_name='br-int',has_traffic_filtering=True,id=b769ad45-f1a8-47b6-9629-1e1a8137957f,network=Network(30f3ce95-cb0a-44df-ac36-3d590ecd5e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb769ad45-f1') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [req-a4ec6e84-0920-4ebd-b5ef-5d17e1ba562c req-aabb9639-3425-4488-aa5c-0ba8216ec33b service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7e:98:57"/><model type="virtio"/><mtu size="1442"/><target dev="tapb769ad45-f1"/></interface> {{(pid=74669) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [req-a4ec6e84-0920-4ebd-b5ef-5d17e1ba562c req-aabb9639-3425-4488-aa5c-0ba8216ec33b service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7e:98:57"/><model type="virtio"/><mtu size="1442"/><target dev="tapb769ad45-f1"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 08 16:54:59 user nova-compute[74669]:   <name>instance-00000009</name>
Nov 08 16:54:59 user nova-compute[74669]:   <uuid>3ef7e79a-203b-4608-a430-1dc99f46e326</uuid>
Nov 08 16:54:59 user nova-compute[74669]:   <metadata>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:54:59 user nova-compute[74669]:   <nova:package version="0.0.0"/>
Nov 08 16:54:59 user nova-compute[74669]:   <nova:name>tempest-device-tagging-server-1645332005</nova:name>
Nov 08 16:54:59 user nova-compute[74669]:   <nova:creationTime>2023-11-08 16:54:58</nova:creationTime>
Nov 08 16:54:59 user nova-compute[74669]:   <nova:flavor name="m1.tiny">
Nov 08 16:54:59 user nova-compute[74669]:     <nova:memory>512</nova:memory>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:disk>1</nova:disk>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:swap>0</nova:swap>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:vcpus>1</nova:vcpus>
Nov 08 16:54:59 user nova-compute[74669]:   </nova:flavor>
Nov 08 16:54:59 user nova-compute[74669]:   <nova:owner>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:user uuid="1f25ebab8f83408d8cee32efb4cd93ad">tempest-TaggedAttachmentsTest-1985002595-project-member</nova:user>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:project uuid="363debcc70b64500b0822f6dd6f27ae2">tempest-TaggedAttachmentsTest-1985002595</nova:project>
Nov 08 16:54:59 user nova-compute[74669]:   </nova:owner>
Nov 08 16:54:59 user nova-compute[74669]:   <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:54:59 user nova-compute[74669]:   <nova:ports>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:port uuid="bdd3c052-b244-491c-ae59-dcea51d10b48">
Nov 08 16:54:59 user nova-compute[74669]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 16:54:59 user nova-compute[74669]:     </nova:port>
Nov 08 16:54:59 user nova-compute[74669]:   </nova:ports>
Nov 08 16:54:59 user nova-compute[74669]: </nova:instance>
Nov 08 16:54:59 user nova-compute[74669]:   </metadata>
Nov 08 16:54:59 user nova-compute[74669]:   <memory unit='KiB'>524288</memory>
Nov 08 16:54:59 user nova-compute[74669]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 16:54:59 user nova-compute[74669]:   <vcpu placement='static'>1</vcpu>
Nov 08 16:54:59 user nova-compute[74669]:   <resource>
Nov 08 16:54:59 user nova-compute[74669]:     <partition>/machine</partition>
Nov 08 16:54:59 user nova-compute[74669]:   </resource>
Nov 08 16:54:59 user nova-compute[74669]:   <sysinfo type='smbios'>
Nov 08 16:54:59 user nova-compute[74669]:     <system>
Nov 08 16:54:59 user nova-compute[74669]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 16:54:59 user nova-compute[74669]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 16:54:59 user nova-compute[74669]:       <entry name='version'>0.0.0</entry>
Nov 08 16:54:59 user nova-compute[74669]:       <entry name='serial'>3ef7e79a-203b-4608-a430-1dc99f46e326</entry>
Nov 08 16:54:59 user nova-compute[74669]:       <entry name='uuid'>3ef7e79a-203b-4608-a430-1dc99f46e326</entry>
Nov 08 16:54:59 user nova-compute[74669]:       <entry name='family'>Virtual Machine</entry>
Nov 08 16:54:59 user nova-compute[74669]:     </system>
Nov 08 16:54:59 user nova-compute[74669]:   </sysinfo>
Nov 08 16:54:59 user nova-compute[74669]:   <os>
Nov 08 16:54:59 user nova-compute[74669]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 16:54:59 user nova-compute[74669]:     <boot dev='hd'/>
Nov 08 16:54:59 user nova-compute[74669]:     <smbios mode='sysinfo'/>
Nov 08 16:54:59 user nova-compute[74669]:   </os>
Nov 08 16:54:59 user nova-compute[74669]:   <features>
Nov 08 16:54:59 user nova-compute[74669]:     <acpi/>
Nov 08 16:54:59 user nova-compute[74669]:     <apic/>
Nov 08 16:54:59 user nova-compute[74669]:     <vmcoreinfo state='on'/>
Nov 08 16:54:59 user nova-compute[74669]:   </features>
Nov 08 16:54:59 user nova-compute[74669]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 16:54:59 user nova-compute[74669]:     <model fallback='forbid'>Nehalem</model>
Nov 08 16:54:59 user nova-compute[74669]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 16:54:59 user nova-compute[74669]:     <feature policy='require' name='vme'/>
Nov 08 16:54:59 user nova-compute[74669]:     <feature policy='require' name='x2apic'/>
Nov 08 16:54:59 user nova-compute[74669]:     <feature policy='require' name='hypervisor'/>
Nov 08 16:54:59 user nova-compute[74669]:   </cpu>
Nov 08 16:54:59 user nova-compute[74669]:   <clock offset='utc'>
Nov 08 16:54:59 user nova-compute[74669]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 16:54:59 user nova-compute[74669]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 16:54:59 user nova-compute[74669]:     <timer name='hpet' present='no'/>
Nov 08 16:54:59 user nova-compute[74669]:   </clock>
Nov 08 16:54:59 user nova-compute[74669]:   <on_poweroff>destroy</on_poweroff>
Nov 08 16:54:59 user nova-compute[74669]:   <on_reboot>restart</on_reboot>
Nov 08 16:54:59 user nova-compute[74669]:   <on_crash>destroy</on_crash>
Nov 08 16:54:59 user nova-compute[74669]:   <devices>
Nov 08 16:54:59 user nova-compute[74669]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 16:54:59 user nova-compute[74669]:     <disk type='file' device='disk'>
Nov 08 16:54:59 user nova-compute[74669]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 16:54:59 user nova-compute[74669]:       <source file='/opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk' index='2'/>
Nov 08 16:54:59 user nova-compute[74669]:       <backingStore type='file' index='3'>
Nov 08 16:54:59 user nova-compute[74669]:         <format type='raw'/>
Nov 08 16:54:59 user nova-compute[74669]:         <source file='/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956'/>
Nov 08 16:54:59 user nova-compute[74669]:         <backingStore/>
Nov 08 16:54:59 user nova-compute[74669]:       </backingStore>
Nov 08 16:54:59 user nova-compute[74669]:       <target dev='vda' bus='virtio'/>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='virtio-disk0'/>
Nov 08 16:54:59 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 16:54:59 user nova-compute[74669]:     </disk>
Nov 08 16:54:59 user nova-compute[74669]:     <disk type='file' device='cdrom'>
Nov 08 16:54:59 user nova-compute[74669]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 16:54:59 user nova-compute[74669]:       <source file='/opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk.config' index='1'/>
Nov 08 16:54:59 user nova-compute[74669]:       <backingStore/>
Nov 08 16:54:59 user nova-compute[74669]:       <target dev='hda' bus='ide'/>
Nov 08 16:54:59 user nova-compute[74669]:       <readonly/>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='ide0-0-0'/>
Nov 08 16:54:59 user nova-compute[74669]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 16:54:59 user nova-compute[74669]:     </disk>
Nov 08 16:54:59 user nova-compute[74669]:     <controller type='usb' index='0' model='none'>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='usb'/>
Nov 08 16:54:59 user nova-compute[74669]:     </controller>
Nov 08 16:54:59 user nova-compute[74669]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='pci.0'/>
Nov 08 16:54:59 user nova-compute[74669]:     </controller>
Nov 08 16:54:59 user nova-compute[74669]:     <controller type='ide' index='0'>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='ide'/>
Nov 08 16:54:59 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 16:54:59 user nova-compute[74669]:     </controller>
Nov 08 16:54:59 user nova-compute[74669]:     <interface type='ethernet'>
Nov 08 16:54:59 user nova-compute[74669]:       <mac address='fa:16:3e:c7:e2:a1'/>
Nov 08 16:54:59 user nova-compute[74669]:       <target dev='tapbdd3c052-b2'/>
Nov 08 16:54:59 user nova-compute[74669]:       <model type='virtio'/>
Nov 08 16:54:59 user nova-compute[74669]:       <mtu size='1442'/>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='net0'/>
Nov 08 16:54:59 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 16:54:59 user nova-compute[74669]:     </interface>
Nov 08 16:54:59 user nova-compute[74669]:     <serial type='pty'>
Nov 08 16:54:59 user nova-compute[74669]:       <source path='/dev/pts/8'/>
Nov 08 16:54:59 user nova-compute[74669]:       <log file='/opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/console.log' append='off'/>
Nov 08 16:54:59 user nova-compute[74669]:       <target type='isa-serial' port='0'>
Nov 08 16:54:59 user nova-compute[74669]:         <model name='isa-serial'/>
Nov 08 16:54:59 user nova-compute[74669]:       </target>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='serial0'/>
Nov 08 16:54:59 user nova-compute[74669]:     </serial>
Nov 08 16:54:59 user nova-compute[74669]:     <console type='pty' tty='/dev/pts/8'>
Nov 08 16:54:59 user nova-compute[74669]:       <source path='/dev/pts/8'/>
Nov 08 16:54:59 user nova-compute[74669]:       <log file='/opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/console.log' append='off'/>
Nov 08 16:54:59 user nova-compute[74669]:       <target type='serial' port='0'/>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='serial0'/>
Nov 08 16:54:59 user nova-compute[74669]:     </console>
Nov 08 16:54:59 user nova-compute[74669]:     <input type='mouse' bus='ps2'>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='input0'/>
Nov 08 16:54:59 user nova-compute[74669]:     </input>
Nov 08 16:54:59 user nova-compute[74669]:     <input type='keyboard' bus='ps2'>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='input1'/>
Nov 08 16:54:59 user nova-compute[74669]:     </input>
Nov 08 16:54:59 user nova-compute[74669]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 08 16:54:59 user nova-compute[74669]:       <listen type='address' address='0.0.0.0'/>
Nov 08 16:54:59 user nova-compute[74669]:     </graphics>
Nov 08 16:54:59 user nova-compute[74669]:     <audio id='1' type='none'/>
Nov 08 16:54:59 user nova-compute[74669]:     <video>
Nov 08 16:54:59 user nova-compute[74669]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='video0'/>
Nov 08 16:54:59 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 16:54:59 user nova-compute[74669]:     </video>
Nov 08 16:54:59 user nova-compute[74669]:     <memballoon model='virtio'>
Nov 08 16:54:59 user nova-compute[74669]:       <stats period='10'/>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='balloon0'/>
Nov 08 16:54:59 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 16:54:59 user nova-compute[74669]:     </memballoon>
Nov 08 16:54:59 user nova-compute[74669]:     <rng model='virtio'>
Nov 08 16:54:59 user nova-compute[74669]:       <backend model='random'>/dev/urandom</backend>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='rng0'/>
Nov 08 16:54:59 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 16:54:59 user nova-compute[74669]:     </rng>
Nov 08 16:54:59 user nova-compute[74669]:   </devices>
Nov 08 16:54:59 user nova-compute[74669]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 16:54:59 user nova-compute[74669]:     <label>libvirt-3ef7e79a-203b-4608-a430-1dc99f46e326</label>
Nov 08 16:54:59 user nova-compute[74669]:     <imagelabel>libvirt-3ef7e79a-203b-4608-a430-1dc99f46e326</imagelabel>
Nov 08 16:54:59 user nova-compute[74669]:   </seclabel>
Nov 08 16:54:59 user nova-compute[74669]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 16:54:59 user nova-compute[74669]:     <label>+64055:+108</label>
Nov 08 16:54:59 user nova-compute[74669]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 16:54:59 user nova-compute[74669]:   </seclabel>
Nov 08 16:54:59 user nova-compute[74669]: </domain>
Nov 08 16:54:59 user nova-compute[74669]:  {{(pid=74669) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [req-a4ec6e84-0920-4ebd-b5ef-5d17e1ba562c req-aabb9639-3425-4488-aa5c-0ba8216ec33b service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7e:98:57"/><model type="virtio"/><mtu size="1442"/><target dev="tapb769ad45-f1"/></interface> {{(pid=74669) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [req-a4ec6e84-0920-4ebd-b5ef-5d17e1ba562c req-aabb9639-3425-4488-aa5c-0ba8216ec33b service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7e:98:57"/><model type="virtio"/><mtu size="1442"/><target dev="tapb769ad45-f1"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 08 16:54:59 user nova-compute[74669]:   <name>instance-00000009</name>
Nov 08 16:54:59 user nova-compute[74669]:   <uuid>3ef7e79a-203b-4608-a430-1dc99f46e326</uuid>
Nov 08 16:54:59 user nova-compute[74669]:   <metadata>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:54:59 user nova-compute[74669]:   <nova:package version="0.0.0"/>
Nov 08 16:54:59 user nova-compute[74669]:   <nova:name>tempest-device-tagging-server-1645332005</nova:name>
Nov 08 16:54:59 user nova-compute[74669]:   <nova:creationTime>2023-11-08 16:54:58</nova:creationTime>
Nov 08 16:54:59 user nova-compute[74669]:   <nova:flavor name="m1.tiny">
Nov 08 16:54:59 user nova-compute[74669]:     <nova:memory>512</nova:memory>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:disk>1</nova:disk>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:swap>0</nova:swap>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:vcpus>1</nova:vcpus>
Nov 08 16:54:59 user nova-compute[74669]:   </nova:flavor>
Nov 08 16:54:59 user nova-compute[74669]:   <nova:owner>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:user uuid="1f25ebab8f83408d8cee32efb4cd93ad">tempest-TaggedAttachmentsTest-1985002595-project-member</nova:user>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:project uuid="363debcc70b64500b0822f6dd6f27ae2">tempest-TaggedAttachmentsTest-1985002595</nova:project>
Nov 08 16:54:59 user nova-compute[74669]:   </nova:owner>
Nov 08 16:54:59 user nova-compute[74669]:   <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:54:59 user nova-compute[74669]:   <nova:ports>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:port uuid="bdd3c052-b244-491c-ae59-dcea51d10b48">
Nov 08 16:54:59 user nova-compute[74669]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 16:54:59 user nova-compute[74669]:     </nova:port>
Nov 08 16:54:59 user nova-compute[74669]:   </nova:ports>
Nov 08 16:54:59 user nova-compute[74669]: </nova:instance>
Nov 08 16:54:59 user nova-compute[74669]:   </metadata>
Nov 08 16:54:59 user nova-compute[74669]:   <memory unit='KiB'>524288</memory>
Nov 08 16:54:59 user nova-compute[74669]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 16:54:59 user nova-compute[74669]:   <vcpu placement='static'>1</vcpu>
Nov 08 16:54:59 user nova-compute[74669]:   <resource>
Nov 08 16:54:59 user nova-compute[74669]:     <partition>/machine</partition>
Nov 08 16:54:59 user nova-compute[74669]:   </resource>
Nov 08 16:54:59 user nova-compute[74669]:   <sysinfo type='smbios'>
Nov 08 16:54:59 user nova-compute[74669]:     <system>
Nov 08 16:54:59 user nova-compute[74669]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 16:54:59 user nova-compute[74669]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 16:54:59 user nova-compute[74669]:       <entry name='version'>0.0.0</entry>
Nov 08 16:54:59 user nova-compute[74669]:       <entry name='serial'>3ef7e79a-203b-4608-a430-1dc99f46e326</entry>
Nov 08 16:54:59 user nova-compute[74669]:       <entry name='uuid'>3ef7e79a-203b-4608-a430-1dc99f46e326</entry>
Nov 08 16:54:59 user nova-compute[74669]:       <entry name='family'>Virtual Machine</entry>
Nov 08 16:54:59 user nova-compute[74669]:     </system>
Nov 08 16:54:59 user nova-compute[74669]:   </sysinfo>
Nov 08 16:54:59 user nova-compute[74669]:   <os>
Nov 08 16:54:59 user nova-compute[74669]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 16:54:59 user nova-compute[74669]:     <boot dev='hd'/>
Nov 08 16:54:59 user nova-compute[74669]:     <smbios mode='sysinfo'/>
Nov 08 16:54:59 user nova-compute[74669]:   </os>
Nov 08 16:54:59 user nova-compute[74669]:   <features>
Nov 08 16:54:59 user nova-compute[74669]:     <acpi/>
Nov 08 16:54:59 user nova-compute[74669]:     <apic/>
Nov 08 16:54:59 user nova-compute[74669]:     <vmcoreinfo state='on'/>
Nov 08 16:54:59 user nova-compute[74669]:   </features>
Nov 08 16:54:59 user nova-compute[74669]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 16:54:59 user nova-compute[74669]:     <model fallback='forbid'>Nehalem</model>
Nov 08 16:54:59 user nova-compute[74669]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 16:54:59 user nova-compute[74669]:     <feature policy='require' name='vme'/>
Nov 08 16:54:59 user nova-compute[74669]:     <feature policy='require' name='x2apic'/>
Nov 08 16:54:59 user nova-compute[74669]:     <feature policy='require' name='hypervisor'/>
Nov 08 16:54:59 user nova-compute[74669]:   </cpu>
Nov 08 16:54:59 user nova-compute[74669]:   <clock offset='utc'>
Nov 08 16:54:59 user nova-compute[74669]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 16:54:59 user nova-compute[74669]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 16:54:59 user nova-compute[74669]:     <timer name='hpet' present='no'/>
Nov 08 16:54:59 user nova-compute[74669]:   </clock>
Nov 08 16:54:59 user nova-compute[74669]:   <on_poweroff>destroy</on_poweroff>
Nov 08 16:54:59 user nova-compute[74669]:   <on_reboot>restart</on_reboot>
Nov 08 16:54:59 user nova-compute[74669]:   <on_crash>destroy</on_crash>
Nov 08 16:54:59 user nova-compute[74669]:   <devices>
Nov 08 16:54:59 user nova-compute[74669]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 16:54:59 user nova-compute[74669]:     <disk type='file' device='disk'>
Nov 08 16:54:59 user nova-compute[74669]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 16:54:59 user nova-compute[74669]:       <source file='/opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk' index='2'/>
Nov 08 16:54:59 user nova-compute[74669]:       <backingStore type='file' index='3'>
Nov 08 16:54:59 user nova-compute[74669]:         <format type='raw'/>
Nov 08 16:54:59 user nova-compute[74669]:         <source file='/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956'/>
Nov 08 16:54:59 user nova-compute[74669]:         <backingStore/>
Nov 08 16:54:59 user nova-compute[74669]:       </backingStore>
Nov 08 16:54:59 user nova-compute[74669]:       <target dev='vda' bus='virtio'/>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='virtio-disk0'/>
Nov 08 16:54:59 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 16:54:59 user nova-compute[74669]:     </disk>
Nov 08 16:54:59 user nova-compute[74669]:     <disk type='file' device='cdrom'>
Nov 08 16:54:59 user nova-compute[74669]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 16:54:59 user nova-compute[74669]:       <source file='/opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/disk.config' index='1'/>
Nov 08 16:54:59 user nova-compute[74669]:       <backingStore/>
Nov 08 16:54:59 user nova-compute[74669]:       <target dev='hda' bus='ide'/>
Nov 08 16:54:59 user nova-compute[74669]:       <readonly/>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='ide0-0-0'/>
Nov 08 16:54:59 user nova-compute[74669]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 16:54:59 user nova-compute[74669]:     </disk>
Nov 08 16:54:59 user nova-compute[74669]:     <controller type='usb' index='0' model='none'>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='usb'/>
Nov 08 16:54:59 user nova-compute[74669]:     </controller>
Nov 08 16:54:59 user nova-compute[74669]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='pci.0'/>
Nov 08 16:54:59 user nova-compute[74669]:     </controller>
Nov 08 16:54:59 user nova-compute[74669]:     <controller type='ide' index='0'>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='ide'/>
Nov 08 16:54:59 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 16:54:59 user nova-compute[74669]:     </controller>
Nov 08 16:54:59 user nova-compute[74669]:     <interface type='ethernet'>
Nov 08 16:54:59 user nova-compute[74669]:       <mac address='fa:16:3e:c7:e2:a1'/>
Nov 08 16:54:59 user nova-compute[74669]:       <target dev='tapbdd3c052-b2'/>
Nov 08 16:54:59 user nova-compute[74669]:       <model type='virtio'/>
Nov 08 16:54:59 user nova-compute[74669]:       <mtu size='1442'/>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='net0'/>
Nov 08 16:54:59 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 16:54:59 user nova-compute[74669]:     </interface>
Nov 08 16:54:59 user nova-compute[74669]:     <serial type='pty'>
Nov 08 16:54:59 user nova-compute[74669]:       <source path='/dev/pts/8'/>
Nov 08 16:54:59 user nova-compute[74669]:       <log file='/opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/console.log' append='off'/>
Nov 08 16:54:59 user nova-compute[74669]:       <target type='isa-serial' port='0'>
Nov 08 16:54:59 user nova-compute[74669]:         <model name='isa-serial'/>
Nov 08 16:54:59 user nova-compute[74669]:       </target>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='serial0'/>
Nov 08 16:54:59 user nova-compute[74669]:     </serial>
Nov 08 16:54:59 user nova-compute[74669]:     <console type='pty' tty='/dev/pts/8'>
Nov 08 16:54:59 user nova-compute[74669]:       <source path='/dev/pts/8'/>
Nov 08 16:54:59 user nova-compute[74669]:       <log file='/opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326/console.log' append='off'/>
Nov 08 16:54:59 user nova-compute[74669]:       <target type='serial' port='0'/>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='serial0'/>
Nov 08 16:54:59 user nova-compute[74669]:     </console>
Nov 08 16:54:59 user nova-compute[74669]:     <input type='mouse' bus='ps2'>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='input0'/>
Nov 08 16:54:59 user nova-compute[74669]:     </input>
Nov 08 16:54:59 user nova-compute[74669]:     <input type='keyboard' bus='ps2'>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='input1'/>
Nov 08 16:54:59 user nova-compute[74669]:     </input>
Nov 08 16:54:59 user nova-compute[74669]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 08 16:54:59 user nova-compute[74669]:       <listen type='address' address='0.0.0.0'/>
Nov 08 16:54:59 user nova-compute[74669]:     </graphics>
Nov 08 16:54:59 user nova-compute[74669]:     <audio id='1' type='none'/>
Nov 08 16:54:59 user nova-compute[74669]:     <video>
Nov 08 16:54:59 user nova-compute[74669]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='video0'/>
Nov 08 16:54:59 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 16:54:59 user nova-compute[74669]:     </video>
Nov 08 16:54:59 user nova-compute[74669]:     <memballoon model='virtio'>
Nov 08 16:54:59 user nova-compute[74669]:       <stats period='10'/>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='balloon0'/>
Nov 08 16:54:59 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 16:54:59 user nova-compute[74669]:     </memballoon>
Nov 08 16:54:59 user nova-compute[74669]:     <rng model='virtio'>
Nov 08 16:54:59 user nova-compute[74669]:       <backend model='random'>/dev/urandom</backend>
Nov 08 16:54:59 user nova-compute[74669]:       <alias name='rng0'/>
Nov 08 16:54:59 user nova-compute[74669]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 16:54:59 user nova-compute[74669]:     </rng>
Nov 08 16:54:59 user nova-compute[74669]:   </devices>
Nov 08 16:54:59 user nova-compute[74669]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 16:54:59 user nova-compute[74669]:     <label>libvirt-3ef7e79a-203b-4608-a430-1dc99f46e326</label>
Nov 08 16:54:59 user nova-compute[74669]:     <imagelabel>libvirt-3ef7e79a-203b-4608-a430-1dc99f46e326</imagelabel>
Nov 08 16:54:59 user nova-compute[74669]:   </seclabel>
Nov 08 16:54:59 user nova-compute[74669]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 16:54:59 user nova-compute[74669]:     <label>+64055:+108</label>
Nov 08 16:54:59 user nova-compute[74669]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 16:54:59 user nova-compute[74669]:   </seclabel>
Nov 08 16:54:59 user nova-compute[74669]: </domain>
Nov 08 16:54:59 user nova-compute[74669]:  {{(pid=74669) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 16:54:59 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [req-a4ec6e84-0920-4ebd-b5ef-5d17e1ba562c req-aabb9639-3425-4488-aa5c-0ba8216ec33b service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Detaching interface fa:16:3e:7e:98:57 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapb769ad45-f1' not found.
Nov 08 16:54:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [req-a4ec6e84-0920-4ebd-b5ef-5d17e1ba562c req-aabb9639-3425-4488-aa5c-0ba8216ec33b service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:51:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1645332005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1645332005',id=9,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB3a26wXBmbxS9Ie0rPCqATNjmL9SLaLhAobRJrF3o3vA4h0CU2n8HUE7/qd69ompZDoYTJsZEmW00PGjMGmRpCjD/lO91lrU6txPCpNQUdBwQTXu0cZgfMZw/6mElCMQ==',key_name='tempest-keypair-961371252',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:51:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='363debcc70b64500b0822f6dd6f27ae2',ramdisk_id='',reservation_id='r-gineojlh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1985002595',owner_user_name='tempest-TaggedAttachmentsTest-1985002595-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:51:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f25ebab8f83408d8cee32efb4cd93ad',uuid=3ef7e79a-203b-4608-a430-1dc99f46e326,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "address": "fa:16:3e:7e:98:57", "network": {"id": "30f3ce95-cb0a-44df-ac36-3d590ecd5e19", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-434432325", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb769ad45-f1", "ovs_interfaceid": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG nova.network.os_vif_util [req-a4ec6e84-0920-4ebd-b5ef-5d17e1ba562c req-aabb9639-3425-4488-aa5c-0ba8216ec33b service nova] Converting VIF {"id": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "address": "fa:16:3e:7e:98:57", "network": {"id": "30f3ce95-cb0a-44df-ac36-3d590ecd5e19", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-434432325", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.49", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb769ad45-f1", "ovs_interfaceid": "b769ad45-f1a8-47b6-9629-1e1a8137957f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG nova.network.os_vif_util [req-a4ec6e84-0920-4ebd-b5ef-5d17e1ba562c req-aabb9639-3425-4488-aa5c-0ba8216ec33b service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:98:57,bridge_name='br-int',has_traffic_filtering=True,id=b769ad45-f1a8-47b6-9629-1e1a8137957f,network=Network(30f3ce95-cb0a-44df-ac36-3d590ecd5e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb769ad45-f1') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_vif [req-a4ec6e84-0920-4ebd-b5ef-5d17e1ba562c req-aabb9639-3425-4488-aa5c-0ba8216ec33b service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:98:57,bridge_name='br-int',has_traffic_filtering=True,id=b769ad45-f1a8-47b6-9629-1e1a8137957f,network=Network(30f3ce95-cb0a-44df-ac36-3d590ecd5e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb769ad45-f1') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb769ad45-f1, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:54:59 user nova-compute[74669]: INFO os_vif [req-a4ec6e84-0920-4ebd-b5ef-5d17e1ba562c req-aabb9639-3425-4488-aa5c-0ba8216ec33b service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:98:57,bridge_name='br-int',has_traffic_filtering=True,id=b769ad45-f1a8-47b6-9629-1e1a8137957f,network=Network(30f3ce95-cb0a-44df-ac36-3d590ecd5e19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb769ad45-f1')
Nov 08 16:54:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [req-a4ec6e84-0920-4ebd-b5ef-5d17e1ba562c req-aabb9639-3425-4488-aa5c-0ba8216ec33b service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:54:59 user nova-compute[74669]:   <nova:package version="0.0.0"/>
Nov 08 16:54:59 user nova-compute[74669]:   <nova:name>tempest-device-tagging-server-1645332005</nova:name>
Nov 08 16:54:59 user nova-compute[74669]:   <nova:creationTime>2023-11-08 16:54:59</nova:creationTime>
Nov 08 16:54:59 user nova-compute[74669]:   <nova:flavor name="m1.tiny">
Nov 08 16:54:59 user nova-compute[74669]:     <nova:memory>512</nova:memory>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:disk>1</nova:disk>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:swap>0</nova:swap>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:vcpus>1</nova:vcpus>
Nov 08 16:54:59 user nova-compute[74669]:   </nova:flavor>
Nov 08 16:54:59 user nova-compute[74669]:   <nova:owner>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:user uuid="1f25ebab8f83408d8cee32efb4cd93ad">tempest-TaggedAttachmentsTest-1985002595-project-member</nova:user>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:project uuid="363debcc70b64500b0822f6dd6f27ae2">tempest-TaggedAttachmentsTest-1985002595</nova:project>
Nov 08 16:54:59 user nova-compute[74669]:   </nova:owner>
Nov 08 16:54:59 user nova-compute[74669]:   <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:54:59 user nova-compute[74669]:   <nova:ports>
Nov 08 16:54:59 user nova-compute[74669]:     <nova:port uuid="bdd3c052-b244-491c-ae59-dcea51d10b48">
Nov 08 16:54:59 user nova-compute[74669]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 16:54:59 user nova-compute[74669]:     </nova:port>
Nov 08 16:54:59 user nova-compute[74669]:   </nova:ports>
Nov 08 16:54:59 user nova-compute[74669]: </nova:instance>
Nov 08 16:54:59 user nova-compute[74669]:  {{(pid=74669) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG nova.network.neutron [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Updating instance_info_cache with network_info: [{"id": "bdd3c052-b244-491c-ae59-dcea51d10b48", "address": "fa:16:3e:c7:e2:a1", "network": {"id": "bdc4b376-712f-45e1-aaf4-64336de2ba9b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-338712334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd3c052-b2", "ovs_interfaceid": "bdd3c052-b244-491c-ae59-dcea51d10b48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Releasing lock "refresh_cache-3ef7e79a-203b-4608-a430-1dc99f46e326" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-59ff37ca-1342-4934-87d7-cd500c352f5e tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "interface-3ef7e79a-203b-4608-a430-1dc99f46e326-b769ad45-f1a8-47b6-9629-1e1a8137957f" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.711s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'izyeXpVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:54:59 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:54:59 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:54:59 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f11026-540c-4766-bc5e-2de7dd793253]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 16:54:59 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e748b12-b959-4ac5-8999-d05cb2abeb19]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6] added
Nov 08 16:54:59 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c34d9c-7c4a-4847-98d7-57d4f0d09b14]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8bec99-c862-4b22-8875-7749e6f07ed5]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v izyeXpVa {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v izyeXpVa" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[802705e4-b700-461f-93e1-f257415f5438]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'izyeXpVa'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[25542a1d-9530-48f9-b58d-e6cc988c3aaf]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[65793efd-a8ec-4f63-ba4a-832108f6cfb3]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:54:59 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:54:59 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:54:59 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:54:59 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:54:59 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:54:59 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8633843-510d-4f5f-8486-36cb5dafeaf6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6, portal: 172.16.0.220,3260]
Nov 08 16:54:59 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6, portal: 172.16.0.220,3260] successful.
Nov 08 16:54:59 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[027d4766-f6aa-4e7e-aad0-7e05cf5a02c2]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5f16a2-a886-4f83-bbac-f65a04708fa7]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:54:59 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:54:59 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:54:59 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:54:59 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:54:59 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:54:59 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:54:59 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:54:59 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f32dc9b-662c-4a56-a40f-efd2c260028c]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:54:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'izyeXpVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 16:55:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:55:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23162306162613839', 'path': '/dev/sdb'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:55:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162306162613839', 'path': '/dev/sdb'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 16:55:00 user nova-compute[74669]: DEBUG nova.objects.instance [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lazy-loading 'flavor' on Instance uuid 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:55:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 16:55:00 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:55:00 user nova-compute[74669]:   <source dev="/dev/sdb"/>
Nov 08 16:55:00 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:55:00 user nova-compute[74669]:   <serial>3991b324-673d-4a72-97b0-e1e7c10a2cb6</serial>
Nov 08 16:55:00 user nova-compute[74669]: </disk>
Nov 08 16:55:00 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 16:55:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "0ad6890a-b71d-472b-a435-0fea19ae012a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "0ad6890a-b71d-472b-a435-0fea19ae012a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 16:55:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:55:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:55:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] No VIF found with MAC fa:16:3e:e0:5c:ca, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:55:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 16:55:01 user nova-compute[74669]: INFO nova.compute.claims [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Claim successful on node user
Nov 08 16:55:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c4a67081-7ed8-437b-99d4-ba98a43544bf tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.998s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:01 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:55:01 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 16:55:02 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 16:55:02 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG nova.policy [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '420018de00394687bba8a1ca64ea51f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f55d1187334b6b9099a9fd647aa721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 16:55:02 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Creating image(s)
Nov 08 16:55:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ad6890a-b71d-472b-a435-0fea19ae012a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "/opt/stack/data/nova/instances/0ad6890a-b71d-472b-a435-0fea19ae012a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "/opt/stack/data/nova/instances/0ad6890a-b71d-472b-a435-0fea19ae012a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.187s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:02 user nova-compute[74669]: INFO nova.compute.manager [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Rescuing
Nov 08 16:55:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquired lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG nova.network.neutron [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.239s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/0ad6890a-b71d-472b-a435-0fea19ae012a/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/0ad6890a-b71d-472b-a435-0fea19ae012a/disk 1073741824" returned: 0 in 0.065s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Successfully created port: 78599e43-1d46-4e63-ae30-2cd109f8ea05 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:55:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.205s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ad6890a-b71d-472b-a435-0fea19ae012a/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad6890a-b71d-472b-a435-0fea19ae012a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad6890a-b71d-472b-a435-0fea19ae012a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Cannot resize image /opt/stack/data/nova/instances/0ad6890a-b71d-472b-a435-0fea19ae012a/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Ensure instance console log exists: /opt/stack/data/nova/instances/0ad6890a-b71d-472b-a435-0fea19ae012a/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG nova.network.neutron [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Updating instance_info_cache with network_info: [{"id": "18b88bab-9376-440a-94f0-478d193b35f5", "address": "fa:16:3e:e0:5c:ca", "network": {"id": "7548ddaf-d550-41df-8f64-fc740e56fcd2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-954808146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa6ad206b6fa4cc099c08a01b051312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b88bab-93", "ovs_interfaceid": "18b88bab-9376-440a-94f0-478d193b35f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Releasing lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Successfully updated port: 78599e43-1d46-4e63-ae30-2cd109f8ea05 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "refresh_cache-0ad6890a-b71d-472b-a435-0fea19ae012a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquired lock "refresh_cache-0ad6890a-b71d-472b-a435-0fea19ae012a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG nova.compute.manager [req-16691b01-fcbc-482b-aa89-dfb1b0aaa5b3 req-08e60f14-446b-49e0-8179-1830222fa5b5 service nova] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Received event network-changed-78599e43-1d46-4e63-ae30-2cd109f8ea05 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG nova.compute.manager [req-16691b01-fcbc-482b-aa89-dfb1b0aaa5b3 req-08e60f14-446b-49e0-8179-1830222fa5b5 service nova] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Refreshing instance network info cache due to event network-changed-78599e43-1d46-4e63-ae30-2cd109f8ea05. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-16691b01-fcbc-482b-aa89-dfb1b0aaa5b3 req-08e60f14-446b-49e0-8179-1830222fa5b5 service nova] Acquiring lock "refresh_cache-0ad6890a-b71d-472b-a435-0fea19ae012a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG nova.compute.manager [req-c4ebf205-a24e-471a-b971-8a5a0b909186 req-5be51f16-3682-454e-b4f3-b065ffcbaaec service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received event network-vif-unplugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c4ebf205-a24e-471a-b971-8a5a0b909186 req-5be51f16-3682-454e-b4f3-b065ffcbaaec service nova] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c4ebf205-a24e-471a-b971-8a5a0b909186 req-5be51f16-3682-454e-b4f3-b065ffcbaaec service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c4ebf205-a24e-471a-b971-8a5a0b909186 req-5be51f16-3682-454e-b4f3-b065ffcbaaec service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:03 user nova-compute[74669]: DEBUG nova.compute.manager [req-c4ebf205-a24e-471a-b971-8a5a0b909186 req-5be51f16-3682-454e-b4f3-b065ffcbaaec service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] No waiting events found dispatching network-vif-unplugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:03 user nova-compute[74669]: WARNING nova.compute.manager [req-c4ebf205-a24e-471a-b971-8a5a0b909186 req-5be51f16-3682-454e-b4f3-b065ffcbaaec service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received unexpected event network-vif-unplugged-18b88bab-9376-440a-94f0-478d193b35f5 for instance with vm_state active and task_state rescuing.
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Updating instance_info_cache with network_info: [{"id": "78599e43-1d46-4e63-ae30-2cd109f8ea05", "address": "fa:16:3e:e0:c8:8b", "network": {"id": "387522d7-947f-4a57-b80b-cefb0257df3e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-177095636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6f55d1187334b6b9099a9fd647aa721", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78599e43-1d", "ovs_interfaceid": "78599e43-1d46-4e63-ae30-2cd109f8ea05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Releasing lock "refresh_cache-0ad6890a-b71d-472b-a435-0fea19ae012a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Instance network_info: |[{"id": "78599e43-1d46-4e63-ae30-2cd109f8ea05", "address": "fa:16:3e:e0:c8:8b", "network": {"id": "387522d7-947f-4a57-b80b-cefb0257df3e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-177095636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6f55d1187334b6b9099a9fd647aa721", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78599e43-1d", "ovs_interfaceid": "78599e43-1d46-4e63-ae30-2cd109f8ea05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-16691b01-fcbc-482b-aa89-dfb1b0aaa5b3 req-08e60f14-446b-49e0-8179-1830222fa5b5 service nova] Acquired lock "refresh_cache-0ad6890a-b71d-472b-a435-0fea19ae012a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.network.neutron [req-16691b01-fcbc-482b-aa89-dfb1b0aaa5b3 req-08e60f14-446b-49e0-8179-1830222fa5b5 service nova] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Refreshing network info cache for port 78599e43-1d46-4e63-ae30-2cd109f8ea05 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Start _get_guest_xml network_info=[{"id": "78599e43-1d46-4e63-ae30-2cd109f8ea05", "address": "fa:16:3e:e0:c8:8b", "network": {"id": "387522d7-947f-4a57-b80b-cefb0257df3e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-177095636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6f55d1187334b6b9099a9fd647aa721", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78599e43-1d", "ovs_interfaceid": "78599e43-1d46-4e63-ae30-2cd109f8ea05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:55:04 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:55:04 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:55:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1882583335',display_name='tempest-VolumesAdminNegativeTest-server-1882583335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1882583335',id=12,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6f55d1187334b6b9099a9fd647aa721',ramdisk_id='',reservation_id='r-hmvgr0oi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1861077985',owner_user_name='tempest-VolumesAdminNegativeTest-1861077985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:55:02Z,user_data=None,user_id='420018de00394687bba8a1ca64ea51f3',uuid=0ad6890a-b71d-472b-a435-0fea19ae012a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78599e43-1d46-4e63-ae30-2cd109f8ea05", "address": "fa:16:3e:e0:c8:8b", "network": {"id": "387522d7-947f-4a57-b80b-cefb0257df3e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-177095636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6f55d1187334b6b9099a9fd647aa721", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78599e43-1d", "ovs_interfaceid": "78599e43-1d46-4e63-ae30-2cd109f8ea05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Converting VIF {"id": "78599e43-1d46-4e63-ae30-2cd109f8ea05", "address": "fa:16:3e:e0:c8:8b", "network": {"id": "387522d7-947f-4a57-b80b-cefb0257df3e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-177095636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6f55d1187334b6b9099a9fd647aa721", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78599e43-1d", "ovs_interfaceid": "78599e43-1d46-4e63-ae30-2cd109f8ea05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c8:8b,bridge_name='br-int',has_traffic_filtering=True,id=78599e43-1d46-4e63-ae30-2cd109f8ea05,network=Network(387522d7-947f-4a57-b80b-cefb0257df3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78599e43-1d') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ad6890a-b71d-472b-a435-0fea19ae012a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:55:04 user nova-compute[74669]:   <uuid>0ad6890a-b71d-472b-a435-0fea19ae012a</uuid>
Nov 08 16:55:04 user nova-compute[74669]:   <name>instance-0000000c</name>
Nov 08 16:55:04 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:55:04 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:55:04 user nova-compute[74669]:   <metadata>
Nov 08 16:55:04 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:55:04 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:55:04 user nova-compute[74669]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1882583335</nova:name>
Nov 08 16:55:04 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:55:04</nova:creationTime>
Nov 08 16:55:04 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:55:04 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:55:04 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:55:04 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:55:04 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:55:04 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:55:04 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:55:04 user nova-compute[74669]:       <nova:owner>
Nov 08 16:55:04 user nova-compute[74669]:         <nova:user uuid="420018de00394687bba8a1ca64ea51f3">tempest-VolumesAdminNegativeTest-1861077985-project-member</nova:user>
Nov 08 16:55:04 user nova-compute[74669]:         <nova:project uuid="a6f55d1187334b6b9099a9fd647aa721">tempest-VolumesAdminNegativeTest-1861077985</nova:project>
Nov 08 16:55:04 user nova-compute[74669]:       </nova:owner>
Nov 08 16:55:04 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:55:04 user nova-compute[74669]:       <nova:ports>
Nov 08 16:55:04 user nova-compute[74669]:         <nova:port uuid="78599e43-1d46-4e63-ae30-2cd109f8ea05">
Nov 08 16:55:04 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 16:55:04 user nova-compute[74669]:         </nova:port>
Nov 08 16:55:04 user nova-compute[74669]:       </nova:ports>
Nov 08 16:55:04 user nova-compute[74669]:     </nova:instance>
Nov 08 16:55:04 user nova-compute[74669]:   </metadata>
Nov 08 16:55:04 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:55:04 user nova-compute[74669]:     <system>
Nov 08 16:55:04 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:55:04 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:55:04 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:55:04 user nova-compute[74669]:       <entry name="serial">0ad6890a-b71d-472b-a435-0fea19ae012a</entry>
Nov 08 16:55:04 user nova-compute[74669]:       <entry name="uuid">0ad6890a-b71d-472b-a435-0fea19ae012a</entry>
Nov 08 16:55:04 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:55:04 user nova-compute[74669]:     </system>
Nov 08 16:55:04 user nova-compute[74669]:   </sysinfo>
Nov 08 16:55:04 user nova-compute[74669]:   <os>
Nov 08 16:55:04 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:55:04 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 16:55:04 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:55:04 user nova-compute[74669]:   </os>
Nov 08 16:55:04 user nova-compute[74669]:   <features>
Nov 08 16:55:04 user nova-compute[74669]:     <acpi/>
Nov 08 16:55:04 user nova-compute[74669]:     <apic/>
Nov 08 16:55:04 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:55:04 user nova-compute[74669]:   </features>
Nov 08 16:55:04 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:55:04 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:55:04 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:55:04 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:55:04 user nova-compute[74669]:   </clock>
Nov 08 16:55:04 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:55:04 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:55:04 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:55:04 user nova-compute[74669]:   </cpu>
Nov 08 16:55:04 user nova-compute[74669]:   <devices>
Nov 08 16:55:04 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:55:04 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:55:04 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/0ad6890a-b71d-472b-a435-0fea19ae012a/disk"/>
Nov 08 16:55:04 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:55:04 user nova-compute[74669]:     </disk>
Nov 08 16:55:04 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:55:04 user nova-compute[74669]:       <mac address="fa:16:3e:e0:c8:8b"/>
Nov 08 16:55:04 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:55:04 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:55:04 user nova-compute[74669]:       <target dev="tap78599e43-1d"/>
Nov 08 16:55:04 user nova-compute[74669]:     </interface>
Nov 08 16:55:04 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:55:04 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/0ad6890a-b71d-472b-a435-0fea19ae012a/console.log" append="off"/>
Nov 08 16:55:04 user nova-compute[74669]:     </serial>
Nov 08 16:55:04 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:55:04 user nova-compute[74669]:     <video>
Nov 08 16:55:04 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:55:04 user nova-compute[74669]:     </video>
Nov 08 16:55:04 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:55:04 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:55:04 user nova-compute[74669]:     </rng>
Nov 08 16:55:04 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:55:04 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:55:04 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:55:04 user nova-compute[74669]:     </memballoon>
Nov 08 16:55:04 user nova-compute[74669]:   </devices>
Nov 08 16:55:04 user nova-compute[74669]: </domain>
Nov 08 16:55:04 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:55:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1882583335',display_name='tempest-VolumesAdminNegativeTest-server-1882583335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1882583335',id=12,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6f55d1187334b6b9099a9fd647aa721',ramdisk_id='',reservation_id='r-hmvgr0oi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1861077985',owner_user_name='tempest-VolumesAdminNegativeTest-1861077985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:55:02Z,user_data=None,user_id='420018de00394687bba8a1ca64ea51f3',uuid=0ad6890a-b71d-472b-a435-0fea19ae012a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78599e43-1d46-4e63-ae30-2cd109f8ea05", "address": "fa:16:3e:e0:c8:8b", "network": {"id": "387522d7-947f-4a57-b80b-cefb0257df3e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-177095636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6f55d1187334b6b9099a9fd647aa721", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78599e43-1d", "ovs_interfaceid": "78599e43-1d46-4e63-ae30-2cd109f8ea05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Converting VIF {"id": "78599e43-1d46-4e63-ae30-2cd109f8ea05", "address": "fa:16:3e:e0:c8:8b", "network": {"id": "387522d7-947f-4a57-b80b-cefb0257df3e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-177095636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6f55d1187334b6b9099a9fd647aa721", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78599e43-1d", "ovs_interfaceid": "78599e43-1d46-4e63-ae30-2cd109f8ea05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c8:8b,bridge_name='br-int',has_traffic_filtering=True,id=78599e43-1d46-4e63-ae30-2cd109f8ea05,network=Network(387522d7-947f-4a57-b80b-cefb0257df3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78599e43-1d') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG os_vif [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c8:8b,bridge_name='br-int',has_traffic_filtering=True,id=78599e43-1d46-4e63-ae30-2cd109f8ea05,network=Network(387522d7-947f-4a57-b80b-cefb0257df3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78599e43-1d') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f62db7c0-16f1-5f9d-a73f-623cf623240b', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78599e43-1d, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78599e43-1d, col_values=(('qos', UUID('a5283c61-17d5-4ace-adec-9ec60d1a0cff')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78599e43-1d, col_values=(('external_ids', {'iface-id': '78599e43-1d46-4e63-ae30-2cd109f8ea05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:c8:8b', 'vm-uuid': '0ad6890a-b71d-472b-a435-0fea19ae012a'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:04 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Instance destroyed successfully.
Nov 08 16:55:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:04 user nova-compute[74669]: INFO os_vif [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c8:8b,bridge_name='br-int',has_traffic_filtering=True,id=78599e43-1d46-4e63-ae30-2cd109f8ea05,network=Network(387522d7-947f-4a57-b80b-cefb0257df3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78599e43-1d')
Nov 08 16:55:04 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Attempting a stable device rescue
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74669) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Instance directory exists: not creating {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 16:55:04 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Creating image(s)
Nov 08 16:55:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "/opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "/opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "/opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.objects.instance [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lazy-loading 'trusted_certs' on Instance uuid 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] No VIF found with MAC fa:16:3e:e0:c8:8b, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "20e54b946f4cf7dc92eadf332bdf6be8df44c361" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "20e54b946f4cf7dc92eadf332bdf6be8df44c361" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/20e54b946f4cf7dc92eadf332bdf6be8df44c361.part --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:05 user nova-compute[74669]: DEBUG nova.network.neutron [req-16691b01-fcbc-482b-aa89-dfb1b0aaa5b3 req-08e60f14-446b-49e0-8179-1830222fa5b5 service nova] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Updated VIF entry in instance network info cache for port 78599e43-1d46-4e63-ae30-2cd109f8ea05. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:55:05 user nova-compute[74669]: DEBUG nova.network.neutron [req-16691b01-fcbc-482b-aa89-dfb1b0aaa5b3 req-08e60f14-446b-49e0-8179-1830222fa5b5 service nova] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Updating instance_info_cache with network_info: [{"id": "78599e43-1d46-4e63-ae30-2cd109f8ea05", "address": "fa:16:3e:e0:c8:8b", "network": {"id": "387522d7-947f-4a57-b80b-cefb0257df3e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-177095636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6f55d1187334b6b9099a9fd647aa721", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78599e43-1d", "ovs_interfaceid": "78599e43-1d46-4e63-ae30-2cd109f8ea05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:55:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-16691b01-fcbc-482b-aa89-dfb1b0aaa5b3 req-08e60f14-446b-49e0-8179-1830222fa5b5 service nova] Releasing lock "refresh_cache-0ad6890a-b71d-472b-a435-0fea19ae012a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:55:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/20e54b946f4cf7dc92eadf332bdf6be8df44c361.part --force-share --output=json" returned: 0 in 0.188s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:05 user nova-compute[74669]: DEBUG nova.virt.images [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] df3da796-6fbc-43be-848b-3853113b572b was qcow2, converting to raw {{(pid=74669) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 16:55:05 user nova-compute[74669]: DEBUG nova.privsep.utils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74669) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 16:55:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/20e54b946f4cf7dc92eadf332bdf6be8df44c361.part /opt/stack/data/nova/instances/_base/20e54b946f4cf7dc92eadf332bdf6be8df44c361.converted {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:05 user nova-compute[74669]: DEBUG nova.compute.manager [req-a69e94c2-211d-4764-b59d-b97d1908c952 req-7fd41adf-d740-4e3d-9478-44da6b2a3e81 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a69e94c2-211d-4764-b59d-b97d1908c952 req-7fd41adf-d740-4e3d-9478-44da6b2a3e81 service nova] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a69e94c2-211d-4764-b59d-b97d1908c952 req-7fd41adf-d740-4e3d-9478-44da6b2a3e81 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a69e94c2-211d-4764-b59d-b97d1908c952 req-7fd41adf-d740-4e3d-9478-44da6b2a3e81 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:05 user nova-compute[74669]: DEBUG nova.compute.manager [req-a69e94c2-211d-4764-b59d-b97d1908c952 req-7fd41adf-d740-4e3d-9478-44da6b2a3e81 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] No waiting events found dispatching network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:05 user nova-compute[74669]: WARNING nova.compute.manager [req-a69e94c2-211d-4764-b59d-b97d1908c952 req-7fd41adf-d740-4e3d-9478-44da6b2a3e81 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received unexpected event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 for instance with vm_state active and task_state rescuing.
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/20e54b946f4cf7dc92eadf332bdf6be8df44c361.part /opt/stack/data/nova/instances/_base/20e54b946f4cf7dc92eadf332bdf6be8df44c361.converted" returned: 0 in 0.221s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/20e54b946f4cf7dc92eadf332bdf6be8df44c361.converted --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/20e54b946f4cf7dc92eadf332bdf6be8df44c361.converted --force-share --output=json" returned: 0 in 0.214s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "20e54b946f4cf7dc92eadf332bdf6be8df44c361" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.701s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "20e54b946f4cf7dc92eadf332bdf6be8df44c361" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "20e54b946f4cf7dc92eadf332bdf6be8df44c361" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/20e54b946f4cf7dc92eadf332bdf6be8df44c361 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.compute.manager [req-be1f7fc3-35e5-40b5-bb36-f317e368b7de req-9b14b4af-1926-4128-8ec6-d978f28df036 service nova] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Received event network-vif-plugged-78599e43-1d46-4e63-ae30-2cd109f8ea05 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-be1f7fc3-35e5-40b5-bb36-f317e368b7de req-9b14b4af-1926-4128-8ec6-d978f28df036 service nova] Acquiring lock "0ad6890a-b71d-472b-a435-0fea19ae012a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-be1f7fc3-35e5-40b5-bb36-f317e368b7de req-9b14b4af-1926-4128-8ec6-d978f28df036 service nova] Lock "0ad6890a-b71d-472b-a435-0fea19ae012a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-be1f7fc3-35e5-40b5-bb36-f317e368b7de req-9b14b4af-1926-4128-8ec6-d978f28df036 service nova] Lock "0ad6890a-b71d-472b-a435-0fea19ae012a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.compute.manager [req-be1f7fc3-35e5-40b5-bb36-f317e368b7de req-9b14b4af-1926-4128-8ec6-d978f28df036 service nova] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] No waiting events found dispatching network-vif-plugged-78599e43-1d46-4e63-ae30-2cd109f8ea05 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:06 user nova-compute[74669]: WARNING nova.compute.manager [req-be1f7fc3-35e5-40b5-bb36-f317e368b7de req-9b14b4af-1926-4128-8ec6-d978f28df036 service nova] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Received unexpected event network-vif-plugged-78599e43-1d46-4e63-ae30-2cd109f8ea05 for instance with vm_state building and task_state spawning.
Nov 08 16:55:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/20e54b946f4cf7dc92eadf332bdf6be8df44c361 --force-share --output=json" returned: 0 in 0.233s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/20e54b946f4cf7dc92eadf332bdf6be8df44c361,backing_fmt=raw /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk.rescue {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/20e54b946f4cf7dc92eadf332bdf6be8df44c361,backing_fmt=raw /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk.rescue" returned: 0 in 0.058s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "20e54b946f4cf7dc92eadf332bdf6be8df44c361" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.objects.instance [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lazy-loading 'migration_context' on Instance uuid 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.objects.base [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Object Instance<45d48da2-85b1-4b7f-9661-8fe4e8346ca6> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Start _get_guest_xml network_info=[{"id": "18b88bab-9376-440a-94f0-478d193b35f5", "address": "fa:16:3e:e0:5c:ca", "network": {"id": "7548ddaf-d550-41df-8f64-fc740e56fcd2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-954808146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-954808146-network", "vif_mac": "fa:16:3e:e0:5c:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa6ad206b6fa4cc099c08a01b051312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b88bab-93", "ovs_interfaceid": "18b88bab-9376-440a-94f0-478d193b35f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'df3da796-6fbc-43be-848b-3853113b572b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'd417b7b3-b1ff-43bb-9953-f60770768b25', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'izyeXpVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '45d48da2-85b1-4b7f-9661-8fe4e8346ca6', 'attached_at': '', 'detached_at': '', 'volume_id': '3991b324-673d-4a72-97b0-e1e7c10a2cb6', 'serial': '3991b324-673d-4a72-97b0-e1e7c10a2cb6'}, 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.objects.instance [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lazy-loading 'resources' on Instance uuid 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.objects.base [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Object Instance<45d48da2-85b1-4b7f-9661-8fe4e8346ca6> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.objects.instance [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lazy-loading 'numa_topology' on Instance uuid 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.objects.base [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Object Instance<45d48da2-85b1-4b7f-9661-8fe4e8346ca6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:55:06 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:55:06 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.objects.instance [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lazy-loading 'vcpu_model' on Instance uuid 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.objects.base [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Object Instance<45d48da2-85b1-4b7f-9661-8fe4e8346ca6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'izyeXpVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:55:06 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:55:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:55:06 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:55:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:55:06 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d11498a-349f-4c87-813c-9f27d7718ae8]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = izyeXpVa\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 16:55:06 user nova-compute[74669]: node.name = iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6
Nov 08 16:55:06 user nova-compute[74669]: node.tpgt = -1
Nov 08 16:55:06 user nova-compute[74669]: node.startup = automatic
Nov 08 16:55:06 user nova-compute[74669]: node.leading_login = No
Nov 08 16:55:06 user nova-compute[74669]: iface.iscsi_ifacename = default
Nov 08 16:55:06 user nova-compute[74669]: iface.net_ifacename = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.ipaddress = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.prefix_len = 0
Nov 08 16:55:06 user nova-compute[74669]: iface.hwaddress = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.transport_name = tcp
Nov 08 16:55:06 user nova-compute[74669]: iface.initiatorname = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.state = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.vlan_id = 0
Nov 08 16:55:06 user nova-compute[74669]: iface.vlan_priority = 0
Nov 08 16:55:06 user nova-compute[74669]: iface.vlan_state = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.iface_num = 0
Nov 08 16:55:06 user nova-compute[74669]: iface.mtu = 0
Nov 08 16:55:06 user nova-compute[74669]: iface.port = 0
Nov 08 16:55:06 user nova-compute[74669]: iface.bootproto = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.subnet_mask = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.gateway = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.dhcp_alt_client_id = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.dhcp_dns = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.dhcp_learn_iqn = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.dhcp_vendor_id_state = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.dhcp_vendor_id = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.dhcp_slp_da = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.fragmentation = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.gratuitous_arp = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.incoming_forwarding = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.tos_state = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.tos = 0
Nov 08 16:55:06 user nova-compute[74669]: iface.ttl = 0
Nov 08 16:55:06 user nova-compute[74669]: iface.delayed_ack = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.tcp_nagle = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.tcp_wsf_state = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.tcp_wsf = 0
Nov 08 16:55:06 user nova-compute[74669]: iface.tcp_timer_scale = 0
Nov 08 16:55:06 user nova-compute[74669]: iface.tcp_timestamp = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.redirect = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.def_task_mgmt_timeout = 0
Nov 08 16:55:06 user nova-compute[74669]: iface.header_digest = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.data_digest = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.immediate_data = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.initial_r2t = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.data_seq_inorder = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.data_pdu_inorder = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.erl = 0
Nov 08 16:55:06 user nova-compute[74669]: iface.max_receive_data_len = 0
Nov 08 16:55:06 user nova-compute[74669]: iface.first_burst_len = 0
Nov 08 16:55:06 user nova-compute[74669]: iface.max_outstanding_r2t = 0
Nov 08 16:55:06 user nova-compute[74669]: iface.max_burst_len = 0
Nov 08 16:55:06 user nova-compute[74669]: iface.chap_auth = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.bidi_chap = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.strict_login_compliance = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.discovery_auth = <empty>
Nov 08 16:55:06 user nova-compute[74669]: iface.discovery_logout = <empty>
Nov 08 16:55:06 user nova-compute[74669]: node.discovery_address = <empty>
Nov 08 16:55:06 user nova-compute[74669]: node.discovery_port = 0
Nov 08 16:55:06 user nova-compute[74669]: node.discovery_type = static
Nov 08 16:55:06 user nova-compute[74669]: node.session.initial_cmdsn = 0
Nov 08 16:55:06 user nova-compute[74669]: node.session.initial_login_retry_max = 8
Nov 08 16:55:06 user nova-compute[74669]: node.session.xmit_thread_priority = -20
Nov 08 16:55:06 user nova-compute[74669]: node.session.cmds_max = 128
Nov 08 16:55:06 user nova-compute[74669]: node.session.queue_depth = 32
Nov 08 16:55:06 user nova-compute[74669]: node.session.nr_sessions = 1
Nov 08 16:55:06 user nova-compute[74669]: node.session.auth.authmethod = CHAP
Nov 08 16:55:06 user nova-compute[74669]: node.session.auth.username = izyeXpVa
Nov 08 16:55:06 user nova-compute[74669]: node.session.auth.password = ***
Nov 08 16:55:06 user nova-compute[74669]: node.session.auth.username_in = <empty>
Nov 08 16:55:06 user nova-compute[74669]: node.session.auth.password_in = <empty>
Nov 08 16:55:06 user nova-compute[74669]: node.session.auth.chap_algs = MD5
Nov 08 16:55:06 user nova-compute[74669]: node.session.timeo.replacement_timeout = 120
Nov 08 16:55:06 user nova-compute[74669]: node.session.err_timeo.abort_timeout = 15
Nov 08 16:55:06 user nova-compute[74669]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 16:55:06 user nova-compute[74669]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 16:55:06 user nova-compute[74669]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 16:55:06 user nova-compute[74669]: node.session.iscsi.FastAbort = Yes
Nov 08 16:55:06 user nova-compute[74669]: node.session.iscsi.InitialR2T = No
Nov 08 16:55:06 user nova-compute[74669]: node.session.iscsi.ImmediateData = Yes
Nov 08 16:55:06 user nova-compute[74669]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 16:55:06 user nova-compute[74669]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 16:55:06 user nova-compute[74669]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 16:55:06 user nova-compute[74669]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 16:55:06 user nova-compute[74669]: node.session.iscsi.MaxConnections = 1
Nov 08 16:55:06 user nova-compute[74669]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 16:55:06 user nova-compute[74669]: node.session.iscsi.ERL = 0
Nov 08 16:55:06 user nova-compute[74669]: node.session.scan = manual
Nov 08 16:55:06 user nova-compute[74669]: node.session.reopen_max = 0
Nov 08 16:55:06 user nova-compute[74669]: node.conn[0].address = 172.16.0.220
Nov 08 16:55:06 user nova-compute[74669]: node.conn[0].port = 3260
Nov 08 16:55:06 user nova-compute[74669]: node.conn[0].startup = manual
Nov 08 16:55:06 user nova-compute[74669]: node.conn[0].tcp.window_size = 524288
Nov 08 16:55:06 user nova-compute[74669]: node.conn[0].tcp.type_of_service = 0
Nov 08 16:55:06 user nova-compute[74669]: node.conn[0].timeo.logout_timeout = 15
Nov 08 16:55:06 user nova-compute[74669]: node.conn[0].timeo.login_timeout = 15
Nov 08 16:55:06 user nova-compute[74669]: node.conn[0].timeo.auth_timeout = 45
Nov 08 16:55:06 user nova-compute[74669]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 16:55:06 user nova-compute[74669]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 16:55:06 user nova-compute[74669]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 16:55:06 user nova-compute[74669]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 16:55:06 user nova-compute[74669]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 16:55:06 user nova-compute[74669]: node.conn[0].iscsi.DataDigest = None
Nov 08 16:55:06 user nova-compute[74669]: node.conn[0].iscsi.IFMarker = No
Nov 08 16:55:06 user nova-compute[74669]: node.conn[0].iscsi.OFMarker = No
Nov 08 16:55:06 user nova-compute[74669]: # END RECORD
Nov 08 16:55:06 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86e9854-6815-49b6-9aeb-b40b7ac435d7]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3205938-a362-4c68-aaf8-70ffedc46978]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v izyeXpVa {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v izyeXpVa" returned: 0 in 0.111s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74d0061-e5f9-4ffd-8a5b-40c7bc83dfc2]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'izyeXpVa'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.045s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebffac76-6b59-4d03-98f3-207e5d8dbf1c]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[741094fe-cde7-4d9e-85cc-579f31132ab2]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:55:07 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:55:07 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:55:07 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:55:07 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:55:07 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:55:07 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:55:07 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:55:07 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] HCTL ('33', '0', '0', 0) found on session 9 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3f9410-6e5f-4a85-b4a7-5f13b9c4ea13]: (4, ('0 0 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Searching for a device in session 9 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'izyeXpVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.324s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] <== connect_volume: return (326ms) {'type': 'block', 'scsi_wwn': '23162306162613839', 'path': '/dev/sdb'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162306162613839', 'path': '/dev/sdb'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-293486561',display_name='tempest-ServerStableDeviceRescueTest-server-293486561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-293486561',id=1,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmu3Qb3c9l4i23U9c4l4qVC6jnYjQ9lJDCwk1SO6vmxzEZ5k3Eq2G3HcNjyCsmyUNDyUDS4LqNxryD+xx2cfvcvkOePH5phGWrbgtkBx3y3xYxDeeeP0zACi3EXNGPKUw==',key_name='tempest-keypair-1527492350',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:51:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa6ad206b6fa4cc099c08a01b051312c',ramdisk_id='',reservation_id='r-sr1uui35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2011852447',owner_user_name='tempest-ServerStableDeviceRescueTest-2011852447-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:52:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bce0d71611084f1694789c5f5cd695cf',uuid=45d48da2-85b1-4b7f-9661-8fe4e8346ca6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18b88bab-9376-440a-94f0-478d193b35f5", "address": "fa:16:3e:e0:5c:ca", "network": {"id": "7548ddaf-d550-41df-8f64-fc740e56fcd2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-954808146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-954808146-network", "vif_mac": "fa:16:3e:e0:5c:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa6ad206b6fa4cc099c08a01b051312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b88bab-93", "ovs_interfaceid": "18b88bab-9376-440a-94f0-478d193b35f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Converting VIF {"id": "18b88bab-9376-440a-94f0-478d193b35f5", "address": "fa:16:3e:e0:5c:ca", "network": {"id": "7548ddaf-d550-41df-8f64-fc740e56fcd2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-954808146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-954808146-network", "vif_mac": "fa:16:3e:e0:5c:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa6ad206b6fa4cc099c08a01b051312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b88bab-93", "ovs_interfaceid": "18b88bab-9376-440a-94f0-478d193b35f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:5c:ca,bridge_name='br-int',has_traffic_filtering=True,id=18b88bab-9376-440a-94f0-478d193b35f5,network=Network(7548ddaf-d550-41df-8f64-fc740e56fcd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18b88bab-93') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG nova.objects.instance [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lazy-loading 'pci_devices' on Instance uuid 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG nova.objects.base [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Object Instance<45d48da2-85b1-4b7f-9661-8fe4e8346ca6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:55:07 user nova-compute[74669]:   <uuid>45d48da2-85b1-4b7f-9661-8fe4e8346ca6</uuid>
Nov 08 16:55:07 user nova-compute[74669]:   <name>instance-00000001</name>
Nov 08 16:55:07 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:55:07 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:55:07 user nova-compute[74669]:   <metadata>
Nov 08 16:55:07 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:55:07 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:55:07 user nova-compute[74669]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-293486561</nova:name>
Nov 08 16:55:07 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:55:06</nova:creationTime>
Nov 08 16:55:07 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:55:07 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:55:07 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:55:07 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:55:07 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:55:07 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:55:07 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:55:07 user nova-compute[74669]:       <nova:owner>
Nov 08 16:55:07 user nova-compute[74669]:         <nova:user uuid="bce0d71611084f1694789c5f5cd695cf">tempest-ServerStableDeviceRescueTest-2011852447-project-member</nova:user>
Nov 08 16:55:07 user nova-compute[74669]:         <nova:project uuid="fa6ad206b6fa4cc099c08a01b051312c">tempest-ServerStableDeviceRescueTest-2011852447</nova:project>
Nov 08 16:55:07 user nova-compute[74669]:       </nova:owner>
Nov 08 16:55:07 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:55:07 user nova-compute[74669]:       <nova:ports>
Nov 08 16:55:07 user nova-compute[74669]:         <nova:port uuid="18b88bab-9376-440a-94f0-478d193b35f5">
Nov 08 16:55:07 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 16:55:07 user nova-compute[74669]:         </nova:port>
Nov 08 16:55:07 user nova-compute[74669]:       </nova:ports>
Nov 08 16:55:07 user nova-compute[74669]:     </nova:instance>
Nov 08 16:55:07 user nova-compute[74669]:   </metadata>
Nov 08 16:55:07 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:55:07 user nova-compute[74669]:     <system>
Nov 08 16:55:07 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:55:07 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:55:07 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:55:07 user nova-compute[74669]:       <entry name="serial">45d48da2-85b1-4b7f-9661-8fe4e8346ca6</entry>
Nov 08 16:55:07 user nova-compute[74669]:       <entry name="uuid">45d48da2-85b1-4b7f-9661-8fe4e8346ca6</entry>
Nov 08 16:55:07 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:55:07 user nova-compute[74669]:     </system>
Nov 08 16:55:07 user nova-compute[74669]:   </sysinfo>
Nov 08 16:55:07 user nova-compute[74669]:   <os>
Nov 08 16:55:07 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:55:07 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:55:07 user nova-compute[74669]:   </os>
Nov 08 16:55:07 user nova-compute[74669]:   <features>
Nov 08 16:55:07 user nova-compute[74669]:     <acpi/>
Nov 08 16:55:07 user nova-compute[74669]:     <apic/>
Nov 08 16:55:07 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:55:07 user nova-compute[74669]:   </features>
Nov 08 16:55:07 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:55:07 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:55:07 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:55:07 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:55:07 user nova-compute[74669]:   </clock>
Nov 08 16:55:07 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:55:07 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:55:07 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:55:07 user nova-compute[74669]:   </cpu>
Nov 08 16:55:07 user nova-compute[74669]:   <devices>
Nov 08 16:55:07 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:55:07 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:55:07 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk"/>
Nov 08 16:55:07 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:55:07 user nova-compute[74669]:     </disk>
Nov 08 16:55:07 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 16:55:07 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:55:07 user nova-compute[74669]:       <source dev="/dev/sdb"/>
Nov 08 16:55:07 user nova-compute[74669]:       <target dev="vdb" bus="virtio"/>
Nov 08 16:55:07 user nova-compute[74669]:       <serial>3991b324-673d-4a72-97b0-e1e7c10a2cb6</serial>
Nov 08 16:55:07 user nova-compute[74669]:     </disk>
Nov 08 16:55:07 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:55:07 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:55:07 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk.rescue"/>
Nov 08 16:55:07 user nova-compute[74669]:       <target dev="vdc" bus="virtio"/>
Nov 08 16:55:07 user nova-compute[74669]:       <boot order="1"/>
Nov 08 16:55:07 user nova-compute[74669]:     </disk>
Nov 08 16:55:07 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:55:07 user nova-compute[74669]:       <mac address="fa:16:3e:e0:5c:ca"/>
Nov 08 16:55:07 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:55:07 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:55:07 user nova-compute[74669]:       <target dev="tap18b88bab-93"/>
Nov 08 16:55:07 user nova-compute[74669]:     </interface>
Nov 08 16:55:07 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:55:07 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/console.log" append="off"/>
Nov 08 16:55:07 user nova-compute[74669]:     </serial>
Nov 08 16:55:07 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:55:07 user nova-compute[74669]:     <video>
Nov 08 16:55:07 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:55:07 user nova-compute[74669]:     </video>
Nov 08 16:55:07 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:55:07 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:55:07 user nova-compute[74669]:     </rng>
Nov 08 16:55:07 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:55:07 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:55:07 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:55:07 user nova-compute[74669]:     </memballoon>
Nov 08 16:55:07 user nova-compute[74669]:   </devices>
Nov 08 16:55:07 user nova-compute[74669]: </domain>
Nov 08 16:55:07 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:55:07 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Instance destroyed successfully.
Nov 08 16:55:07 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] No VIF found with MAC fa:16:3e:e0:5c:ca, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:55:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:08 user nova-compute[74669]: DEBUG nova.compute.manager [req-e8ad4a83-1421-40a9-9a20-bde214061189 req-e870a297-c41f-474b-8e17-c36c6b252d56 service nova] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Received event network-vif-plugged-78599e43-1d46-4e63-ae30-2cd109f8ea05 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e8ad4a83-1421-40a9-9a20-bde214061189 req-e870a297-c41f-474b-8e17-c36c6b252d56 service nova] Acquiring lock "0ad6890a-b71d-472b-a435-0fea19ae012a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e8ad4a83-1421-40a9-9a20-bde214061189 req-e870a297-c41f-474b-8e17-c36c6b252d56 service nova] Lock "0ad6890a-b71d-472b-a435-0fea19ae012a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e8ad4a83-1421-40a9-9a20-bde214061189 req-e870a297-c41f-474b-8e17-c36c6b252d56 service nova] Lock "0ad6890a-b71d-472b-a435-0fea19ae012a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:08 user nova-compute[74669]: DEBUG nova.compute.manager [req-e8ad4a83-1421-40a9-9a20-bde214061189 req-e870a297-c41f-474b-8e17-c36c6b252d56 service nova] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] No waiting events found dispatching network-vif-plugged-78599e43-1d46-4e63-ae30-2cd109f8ea05 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:08 user nova-compute[74669]: WARNING nova.compute.manager [req-e8ad4a83-1421-40a9-9a20-bde214061189 req-e870a297-c41f-474b-8e17-c36c6b252d56 service nova] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Received unexpected event network-vif-plugged-78599e43-1d46-4e63-ae30-2cd109f8ea05 for instance with vm_state building and task_state spawning.
Nov 08 16:55:08 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 16:55:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 16:55:08 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Instance spawned successfully.
Nov 08 16:55:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 16:55:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:55:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:55:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:55:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:55:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:55:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:55:08 user nova-compute[74669]: INFO nova.compute.manager [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Took 6.45 seconds to spawn the instance on the hypervisor.
Nov 08 16:55:08 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:55:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:09 user nova-compute[74669]: INFO nova.compute.manager [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Took 7.56 seconds to build instance.
Nov 08 16:55:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d9de8a8a-4b23-49ba-a22f-b60c488cc5a9 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "0ad6890a-b71d-472b-a435-0fea19ae012a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.708s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-3ecd384d-7892-4166-a71f-bbdb3b9173d7 req-5db2e8f4-d3de-4798-b675-b25542defdf7 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3ecd384d-7892-4166-a71f-bbdb3b9173d7 req-5db2e8f4-d3de-4798-b675-b25542defdf7 service nova] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3ecd384d-7892-4166-a71f-bbdb3b9173d7 req-5db2e8f4-d3de-4798-b675-b25542defdf7 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3ecd384d-7892-4166-a71f-bbdb3b9173d7 req-5db2e8f4-d3de-4798-b675-b25542defdf7 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-3ecd384d-7892-4166-a71f-bbdb3b9173d7 req-5db2e8f4-d3de-4798-b675-b25542defdf7 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] No waiting events found dispatching network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:09 user nova-compute[74669]: WARNING nova.compute.manager [req-3ecd384d-7892-4166-a71f-bbdb3b9173d7 req-5db2e8f4-d3de-4798-b675-b25542defdf7 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received unexpected event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 for instance with vm_state active and task_state rescuing.
Nov 08 16:55:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:11 user nova-compute[74669]: DEBUG nova.compute.manager [req-8f1fe221-d014-4caf-b7cd-3330d725e41f req-a8b2a864-48dd-4bb1-b86f-e1832e0d2483 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8f1fe221-d014-4caf-b7cd-3330d725e41f req-a8b2a864-48dd-4bb1-b86f-e1832e0d2483 service nova] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8f1fe221-d014-4caf-b7cd-3330d725e41f req-a8b2a864-48dd-4bb1-b86f-e1832e0d2483 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8f1fe221-d014-4caf-b7cd-3330d725e41f req-a8b2a864-48dd-4bb1-b86f-e1832e0d2483 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:11 user nova-compute[74669]: DEBUG nova.compute.manager [req-8f1fe221-d014-4caf-b7cd-3330d725e41f req-a8b2a864-48dd-4bb1-b86f-e1832e0d2483 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] No waiting events found dispatching network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:11 user nova-compute[74669]: WARNING nova.compute.manager [req-8f1fe221-d014-4caf-b7cd-3330d725e41f req-a8b2a864-48dd-4bb1-b86f-e1832e0d2483 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received unexpected event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 for instance with vm_state active and task_state rescuing.
Nov 08 16:55:11 user nova-compute[74669]: DEBUG nova.compute.manager [None req-42c7192e-b606-4c9c-8cce-2284484251a8 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:55:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Acquiring lock "af94bfaa-45bc-4bac-9594-f363fce8727e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Lock "af94bfaa-45bc-4bac-9594-f363fce8727e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Acquiring lock "af94bfaa-45bc-4bac-9594-f363fce8727e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Lock "af94bfaa-45bc-4bac-9594-f363fce8727e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Lock "af94bfaa-45bc-4bac-9594-f363fce8727e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:16 user nova-compute[74669]: INFO nova.compute.manager [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Terminating instance
Nov 08 16:55:16 user nova-compute[74669]: DEBUG nova.compute.manager [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 16:55:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-06f45186-e19b-462b-b4f4-8b72f4e32ac5 req-567dbb6e-7a30-41a2-9902-158496026870 service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Received event network-vif-unplugged-1b0ec571-edb1-4c11-bbeb-24123bd96f09 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-06f45186-e19b-462b-b4f4-8b72f4e32ac5 req-567dbb6e-7a30-41a2-9902-158496026870 service nova] Acquiring lock "af94bfaa-45bc-4bac-9594-f363fce8727e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-06f45186-e19b-462b-b4f4-8b72f4e32ac5 req-567dbb6e-7a30-41a2-9902-158496026870 service nova] Lock "af94bfaa-45bc-4bac-9594-f363fce8727e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-06f45186-e19b-462b-b4f4-8b72f4e32ac5 req-567dbb6e-7a30-41a2-9902-158496026870 service nova] Lock "af94bfaa-45bc-4bac-9594-f363fce8727e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-06f45186-e19b-462b-b4f4-8b72f4e32ac5 req-567dbb6e-7a30-41a2-9902-158496026870 service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] No waiting events found dispatching network-vif-unplugged-1b0ec571-edb1-4c11-bbeb-24123bd96f09 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-06f45186-e19b-462b-b4f4-8b72f4e32ac5 req-567dbb6e-7a30-41a2-9902-158496026870 service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Received event network-vif-unplugged-1b0ec571-edb1-4c11-bbeb-24123bd96f09 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 16:55:17 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Instance destroyed successfully.
Nov 08 16:55:17 user nova-compute[74669]: DEBUG nova.objects.instance [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Lazy-loading 'resources' on Instance uuid af94bfaa-45bc-4bac-9594-f363fce8727e {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:55:17 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:51:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1775156653',display_name='tempest-VolumesAssistedSnapshotsTest-server-1775156653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1775156653',id=8,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmSbruixunUh0wgAmxAi2Vzmxnz0NTwsHdOv+/2oPjHP2AN9io1uFHxfWV+VvGwYLJNurPO0k7aXhG4sxIqnU0XVFtAPwc9yY10A4kwxsd8x1UPiBFQxW758gaHileDqg==',key_name='tempest-keypair-477436463',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:51:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b48aa79104ae4b668b0b73c6b3e2b18c',ramdisk_id='',reservation_id='r-xeg0euij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-733888851',owner_user_name='tempest-VolumesAssistedSnapshotsTest-733888851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:51:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b33fb251aa84d589b91f762cb3fbe62',uuid=af94bfaa-45bc-4bac-9594-f363fce8727e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b0ec571-edb1-4c11-bbeb-24123bd96f09", "address": "fa:16:3e:2c:9a:3e", "network": {"id": "d4ab50d4-89ec-4706-b8bc-2fd83ae1d0df", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2136930753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48aa79104ae4b668b0b73c6b3e2b18c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0ec571-ed", "ovs_interfaceid": "1b0ec571-edb1-4c11-bbeb-24123bd96f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:55:17 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Converting VIF {"id": "1b0ec571-edb1-4c11-bbeb-24123bd96f09", "address": "fa:16:3e:2c:9a:3e", "network": {"id": "d4ab50d4-89ec-4706-b8bc-2fd83ae1d0df", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2136930753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48aa79104ae4b668b0b73c6b3e2b18c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0ec571-ed", "ovs_interfaceid": "1b0ec571-edb1-4c11-bbeb-24123bd96f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:55:17 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:9a:3e,bridge_name='br-int',has_traffic_filtering=True,id=1b0ec571-edb1-4c11-bbeb-24123bd96f09,network=Network(d4ab50d4-89ec-4706-b8bc-2fd83ae1d0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0ec571-ed') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:55:17 user nova-compute[74669]: DEBUG os_vif [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:9a:3e,bridge_name='br-int',has_traffic_filtering=True,id=1b0ec571-edb1-4c11-bbeb-24123bd96f09,network=Network(d4ab50d4-89ec-4706-b8bc-2fd83ae1d0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0ec571-ed') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:55:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b0ec571-ed, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=440ce77b-554b-4d1c-8774-720087f7bf14) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:17 user nova-compute[74669]: INFO os_vif [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:9a:3e,bridge_name='br-int',has_traffic_filtering=True,id=1b0ec571-edb1-4c11-bbeb-24123bd96f09,network=Network(d4ab50d4-89ec-4706-b8bc-2fd83ae1d0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0ec571-ed')
Nov 08 16:55:17 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Deleting instance files /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e_del
Nov 08 16:55:17 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Deletion of /opt/stack/data/nova/instances/af94bfaa-45bc-4bac-9594-f363fce8727e_del complete
Nov 08 16:55:17 user nova-compute[74669]: INFO nova.compute.manager [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 08 16:55:17 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 16:55:17 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 16:55:17 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 16:55:19 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:55:19 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Took 1.32 seconds to deallocate network for instance.
Nov 08 16:55:19 user nova-compute[74669]: DEBUG nova.compute.manager [req-2f530b50-d0cd-4d3d-82dc-f035a32d4af9 req-82ccd6aa-5886-424c-8cf7-cf68412e04db service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Received event network-vif-deleted-1b0ec571-edb1-4c11-bbeb-24123bd96f09 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:19 user nova-compute[74669]: INFO nova.compute.manager [req-2f530b50-d0cd-4d3d-82dc-f035a32d4af9 req-82ccd6aa-5886-424c-8cf7-cf68412e04db service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Neutron deleted interface 1b0ec571-edb1-4c11-bbeb-24123bd96f09; detaching it from the instance and deleting it from the info cache
Nov 08 16:55:19 user nova-compute[74669]: DEBUG nova.network.neutron [req-2f530b50-d0cd-4d3d-82dc-f035a32d4af9 req-82ccd6aa-5886-424c-8cf7-cf68412e04db service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:55:19 user nova-compute[74669]: DEBUG nova.compute.manager [req-2f530b50-d0cd-4d3d-82dc-f035a32d4af9 req-82ccd6aa-5886-424c-8cf7-cf68412e04db service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Detach interface failed, port_id=1b0ec571-edb1-4c11-bbeb-24123bd96f09, reason: Instance af94bfaa-45bc-4bac-9594-f363fce8727e could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 16:55:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:19 user nova-compute[74669]: DEBUG nova.compute.manager [req-3800da19-e8fd-474e-989a-7db33a2f861a req-73cd4ff7-0bc0-4a90-ae89-d3b67b03d8da service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Received event network-vif-plugged-1b0ec571-edb1-4c11-bbeb-24123bd96f09 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3800da19-e8fd-474e-989a-7db33a2f861a req-73cd4ff7-0bc0-4a90-ae89-d3b67b03d8da service nova] Acquiring lock "af94bfaa-45bc-4bac-9594-f363fce8727e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3800da19-e8fd-474e-989a-7db33a2f861a req-73cd4ff7-0bc0-4a90-ae89-d3b67b03d8da service nova] Lock "af94bfaa-45bc-4bac-9594-f363fce8727e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3800da19-e8fd-474e-989a-7db33a2f861a req-73cd4ff7-0bc0-4a90-ae89-d3b67b03d8da service nova] Lock "af94bfaa-45bc-4bac-9594-f363fce8727e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:19 user nova-compute[74669]: DEBUG nova.compute.manager [req-3800da19-e8fd-474e-989a-7db33a2f861a req-73cd4ff7-0bc0-4a90-ae89-d3b67b03d8da service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] No waiting events found dispatching network-vif-plugged-1b0ec571-edb1-4c11-bbeb-24123bd96f09 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:19 user nova-compute[74669]: WARNING nova.compute.manager [req-3800da19-e8fd-474e-989a-7db33a2f861a req-73cd4ff7-0bc0-4a90-ae89-d3b67b03d8da service nova] [instance: af94bfaa-45bc-4bac-9594-f363fce8727e] Received unexpected event network-vif-plugged-1b0ec571-edb1-4c11-bbeb-24123bd96f09 for instance with vm_state deleted and task_state None.
Nov 08 16:55:19 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:55:19 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:55:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.525s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:19 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Deleted allocations for instance af94bfaa-45bc-4bac-9594-f363fce8727e
Nov 08 16:55:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-588886eb-06ae-412d-85e2-d247ff3b4bf0 tempest-VolumesAssistedSnapshotsTest-733888851 tempest-VolumesAssistedSnapshotsTest-733888851-project-member] Lock "af94bfaa-45bc-4bac-9594-f363fce8727e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.422s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQHpYXey', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:55:23 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:55:23 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:55:23 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef2c27e-3a41-4ccf-ae5a-823d2460a74d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 16:55:23 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab2c626-498f-4383-9e6e-2ea667c4a553]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630] added
Nov 08 16:55:23 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf20e077-61f1-4ebb-9dbf-0f7f0f9e7131]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f40189-c233-4d6c-92e4-a3bf4308aa62]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rQHpYXey {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rQHpYXey" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[53032caf-b0d6-4018-9bb1-a87e1dc6399a]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rQHpYXey'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecd44e3-efc2-431f-b96b-8e3f2d4a5d5b]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b9ee3b-c395-4ad6-bce0-582df8d9000d]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:55:23 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:55:23 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:55:23 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:55:23 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:55:23 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:55:23 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:55:23 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:55:23 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdf011a-2b5a-4e7a-8d9d-54d82e692132]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630, portal: 172.16.0.220,3260]
Nov 08 16:55:23 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630, portal: 172.16.0.220,3260] successful.
Nov 08 16:55:23 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c3398e-31e4-4ecf-b4fc-91a8c48d736a]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca36e3b-94f6-4165-8334-c5ab2318290c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:55:23 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:55:23 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:55:23 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:55:23 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:55:23 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:55:23 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:55:23 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:55:23 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:55:23 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:55:23 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] HCTL ('34', '-', '-', 0) found on session 10 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[21aea2b2-fdc5-442a-9d5e-d6d6ff0d6aaa]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:55:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQHpYXey', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 16:55:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:55:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23134373761386133', 'path': '/dev/sdc'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:55:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134373761386133', 'path': '/dev/sdc'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 16:55:24 user nova-compute[74669]: DEBUG nova.objects.instance [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lazy-loading 'flavor' on Instance uuid 0829b734-daec-4dc6-b24b-cbe89000160c {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:55:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 16:55:24 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:55:24 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 16:55:24 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:55:24 user nova-compute[74669]:   <serial>081598cb-5af2-45bf-b15f-cfc2ff95f630</serial>
Nov 08 16:55:24 user nova-compute[74669]: </disk>
Nov 08 16:55:24 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 16:55:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:55:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:55:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] No VIF found with MAC fa:16:3e:36:41:2f, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:55:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0d4d0702-67e5-48a3-a1c8-7c7f91b3db2e tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "0829b734-daec-4dc6-b24b-cbe89000160c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.458s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 16:55:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 16:55:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 16:55:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Acquiring lock "3ef7e79a-203b-4608-a430-1dc99f46e326" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Acquiring lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:28 user nova-compute[74669]: INFO nova.compute.manager [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Terminating instance
Nov 08 16:55:28 user nova-compute[74669]: DEBUG nova.compute.manager [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 16:55:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-6c8babea-53e4-4bd5-b078-f7288c4d3809 req-7bd046f5-1770-4afc-ac9a-e308ed3ebb47 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Received event network-vif-unplugged-bdd3c052-b244-491c-ae59-dcea51d10b48 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6c8babea-53e4-4bd5-b078-f7288c4d3809 req-7bd046f5-1770-4afc-ac9a-e308ed3ebb47 service nova] Acquiring lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6c8babea-53e4-4bd5-b078-f7288c4d3809 req-7bd046f5-1770-4afc-ac9a-e308ed3ebb47 service nova] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6c8babea-53e4-4bd5-b078-f7288c4d3809 req-7bd046f5-1770-4afc-ac9a-e308ed3ebb47 service nova] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-6c8babea-53e4-4bd5-b078-f7288c4d3809 req-7bd046f5-1770-4afc-ac9a-e308ed3ebb47 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] No waiting events found dispatching network-vif-unplugged-bdd3c052-b244-491c-ae59-dcea51d10b48 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-6c8babea-53e4-4bd5-b078-f7288c4d3809 req-7bd046f5-1770-4afc-ac9a-e308ed3ebb47 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Received event network-vif-unplugged-bdd3c052-b244-491c-ae59-dcea51d10b48 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 16:55:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:29 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Instance destroyed successfully.
Nov 08 16:55:29 user nova-compute[74669]: DEBUG nova.objects.instance [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lazy-loading 'resources' on Instance uuid 3ef7e79a-203b-4608-a430-1dc99f46e326 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:55:29 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:51:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1645332005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1645332005',id=9,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJB3a26wXBmbxS9Ie0rPCqATNjmL9SLaLhAobRJrF3o3vA4h0CU2n8HUE7/qd69ompZDoYTJsZEmW00PGjMGmRpCjD/lO91lrU6txPCpNQUdBwQTXu0cZgfMZw/6mElCMQ==',key_name='tempest-keypair-961371252',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:51:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='363debcc70b64500b0822f6dd6f27ae2',ramdisk_id='',reservation_id='r-gineojlh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1985002595',owner_user_name='tempest-TaggedAttachmentsTest-1985002595-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:51:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f25ebab8f83408d8cee32efb4cd93ad',uuid=3ef7e79a-203b-4608-a430-1dc99f46e326,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdd3c052-b244-491c-ae59-dcea51d10b48", "address": "fa:16:3e:c7:e2:a1", "network": {"id": "bdc4b376-712f-45e1-aaf4-64336de2ba9b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-338712334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd3c052-b2", "ovs_interfaceid": "bdd3c052-b244-491c-ae59-dcea51d10b48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:55:29 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Converting VIF {"id": "bdd3c052-b244-491c-ae59-dcea51d10b48", "address": "fa:16:3e:c7:e2:a1", "network": {"id": "bdc4b376-712f-45e1-aaf4-64336de2ba9b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-338712334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "363debcc70b64500b0822f6dd6f27ae2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdd3c052-b2", "ovs_interfaceid": "bdd3c052-b244-491c-ae59-dcea51d10b48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:55:29 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:e2:a1,bridge_name='br-int',has_traffic_filtering=True,id=bdd3c052-b244-491c-ae59-dcea51d10b48,network=Network(bdc4b376-712f-45e1-aaf4-64336de2ba9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd3c052-b2') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:55:29 user nova-compute[74669]: DEBUG os_vif [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:e2:a1,bridge_name='br-int',has_traffic_filtering=True,id=bdd3c052-b244-491c-ae59-dcea51d10b48,network=Network(bdc4b376-712f-45e1-aaf4-64336de2ba9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd3c052-b2') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:55:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbdd3c052-b2, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4015eef9-31e9-4ab5-86a3-4fdb0c59a86f) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:29 user nova-compute[74669]: INFO os_vif [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:e2:a1,bridge_name='br-int',has_traffic_filtering=True,id=bdd3c052-b244-491c-ae59-dcea51d10b48,network=Network(bdc4b376-712f-45e1-aaf4-64336de2ba9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdd3c052-b2')
Nov 08 16:55:29 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Deleting instance files /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326_del
Nov 08 16:55:29 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Deletion of /opt/stack/data/nova/instances/3ef7e79a-203b-4608-a430-1dc99f46e326_del complete
Nov 08 16:55:29 user nova-compute[74669]: INFO nova.compute.manager [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 08 16:55:29 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 16:55:29 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 16:55:29 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 16:55:30 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:55:30 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Took 0.82 seconds to deallocate network for instance.
Nov 08 16:55:30 user nova-compute[74669]: DEBUG nova.compute.manager [req-d8cce964-3277-48ce-be83-b2bc17842f8a req-a35c37f9-e779-493f-bbc8-c2be9a03f0b8 service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Received event network-vif-deleted-bdd3c052-b244-491c-ae59-dcea51d10b48 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:30 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:55:31 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:55:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:31 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Deleted allocations for instance 3ef7e79a-203b-4608-a430-1dc99f46e326
Nov 08 16:55:31 user nova-compute[74669]: DEBUG nova.compute.manager [req-aa346601-155f-4216-8178-3e443ac58c09 req-f629e924-6316-4732-9999-f3820fc3ebeb service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Received event network-vif-plugged-bdd3c052-b244-491c-ae59-dcea51d10b48 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-aa346601-155f-4216-8178-3e443ac58c09 req-f629e924-6316-4732-9999-f3820fc3ebeb service nova] Acquiring lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-aa346601-155f-4216-8178-3e443ac58c09 req-f629e924-6316-4732-9999-f3820fc3ebeb service nova] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-aa346601-155f-4216-8178-3e443ac58c09 req-f629e924-6316-4732-9999-f3820fc3ebeb service nova] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:31 user nova-compute[74669]: DEBUG nova.compute.manager [req-aa346601-155f-4216-8178-3e443ac58c09 req-f629e924-6316-4732-9999-f3820fc3ebeb service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] No waiting events found dispatching network-vif-plugged-bdd3c052-b244-491c-ae59-dcea51d10b48 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:31 user nova-compute[74669]: WARNING nova.compute.manager [req-aa346601-155f-4216-8178-3e443ac58c09 req-f629e924-6316-4732-9999-f3820fc3ebeb service nova] [instance: 3ef7e79a-203b-4608-a430-1dc99f46e326] Received unexpected event network-vif-plugged-bdd3c052-b244-491c-ae59-dcea51d10b48 for instance with vm_state deleted and task_state None.
Nov 08 16:55:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-737e3ac2-783c-4a5c-9b56-ffe1a57e41f3 tempest-TaggedAttachmentsTest-1985002595 tempest-TaggedAttachmentsTest-1985002595-project-member] Lock "3ef7e79a-203b-4608-a430-1dc99f46e326" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.448s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:40 user nova-compute[74669]: INFO nova.compute.manager [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Rescuing
Nov 08 16:55:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "refresh_cache-e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:55:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquired lock "refresh_cache-e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:55:40 user nova-compute[74669]: DEBUG nova.network.neutron [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:55:40 user nova-compute[74669]: DEBUG nova.network.neutron [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Updating instance_info_cache with network_info: [{"id": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "address": "fa:16:3e:8f:9e:16", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b48f6d-e0", "ovs_interfaceid": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:55:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Releasing lock "refresh_cache-e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:55:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:40 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:55:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:40 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:55:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-3d46453d-f503-43a9-a01b-0aa9785fd755 req-93023df5-85e5-48ef-ac97-e1b29f255fd2 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received event network-changed-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-3d46453d-f503-43a9-a01b-0aa9785fd755 req-93023df5-85e5-48ef-ac97-e1b29f255fd2 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Refreshing instance network info cache due to event network-changed-bf29f8cc-1793-457b-a4a6-8158d048eac9. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:55:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3d46453d-f503-43a9-a01b-0aa9785fd755 req-93023df5-85e5-48ef-ac97-e1b29f255fd2 service nova] Acquiring lock "refresh_cache-0829b734-daec-4dc6-b24b-cbe89000160c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:55:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3d46453d-f503-43a9-a01b-0aa9785fd755 req-93023df5-85e5-48ef-ac97-e1b29f255fd2 service nova] Acquired lock "refresh_cache-0829b734-daec-4dc6-b24b-cbe89000160c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:55:40 user nova-compute[74669]: DEBUG nova.network.neutron [req-3d46453d-f503-43a9-a01b-0aa9785fd755 req-93023df5-85e5-48ef-ac97-e1b29f255fd2 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Refreshing network info cache for port bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:55:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:41 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Instance destroyed successfully.
Nov 08 16:55:41 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Attempting rescue
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74669) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Instance directory exists: not creating {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 16:55:41 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Creating image(s)
Nov 08 16:55:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "/opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "/opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.objects.instance [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'trusted_certs' on Instance uuid e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.248s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk.rescue {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk.rescue" returned: 0 in 0.056s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.objects.instance [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'migration_context' on Instance uuid e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.objects.base [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Object Instance<e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Start _get_guest_xml network_info=[{"id": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "address": "fa:16:3e:8f:9e:16", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "vif_mac": "fa:16:3e:8f:9e:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b48f6d-e0", "ovs_interfaceid": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.objects.instance [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'resources' on Instance uuid e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.objects.base [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Object Instance<e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.objects.instance [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'numa_topology' on Instance uuid e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.objects.base [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Object Instance<e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:41 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:55:41 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.objects.instance [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'vcpu_model' on Instance uuid e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.objects.base [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Object Instance<e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-806433756',display_name='tempest-ServerRescueNegativeTestJSON-server-806433756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-806433756',id=3,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:51:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='632d3acc026b4a869be4899a0ed2e2e2',ramdisk_id='',reservation_id='r-zvbxh990',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1743978403',owner_user_name='tempest-ServerRescueNegativeTestJSON-1743978403-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:51:03Z,user_data=None,user_id='4836f11b0e8346a2a7e835a6012f53fb',uuid=e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "address": "fa:16:3e:8f:9e:16", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "vif_mac": "fa:16:3e:8f:9e:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b48f6d-e0", "ovs_interfaceid": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converting VIF {"id": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "address": "fa:16:3e:8f:9e:16", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "vif_mac": "fa:16:3e:8f:9e:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b48f6d-e0", "ovs_interfaceid": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=44b48f6d-e0fe-4178-badd-f5f57cd1cd6e,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44b48f6d-e0') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.objects.instance [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'pci_devices' on Instance uuid e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.objects.base [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Object Instance<e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:55:41 user nova-compute[74669]:   <uuid>e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a</uuid>
Nov 08 16:55:41 user nova-compute[74669]:   <name>instance-00000003</name>
Nov 08 16:55:41 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:55:41 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:55:41 user nova-compute[74669]:   <metadata>
Nov 08 16:55:41 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:55:41 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:55:41 user nova-compute[74669]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-806433756</nova:name>
Nov 08 16:55:41 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:55:41</nova:creationTime>
Nov 08 16:55:41 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:55:41 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:55:41 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:55:41 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:55:41 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:55:41 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:55:41 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:55:41 user nova-compute[74669]:       <nova:owner>
Nov 08 16:55:41 user nova-compute[74669]:         <nova:user uuid="4836f11b0e8346a2a7e835a6012f53fb">tempest-ServerRescueNegativeTestJSON-1743978403-project-member</nova:user>
Nov 08 16:55:41 user nova-compute[74669]:         <nova:project uuid="632d3acc026b4a869be4899a0ed2e2e2">tempest-ServerRescueNegativeTestJSON-1743978403</nova:project>
Nov 08 16:55:41 user nova-compute[74669]:       </nova:owner>
Nov 08 16:55:41 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:55:41 user nova-compute[74669]:       <nova:ports>
Nov 08 16:55:41 user nova-compute[74669]:         <nova:port uuid="44b48f6d-e0fe-4178-badd-f5f57cd1cd6e">
Nov 08 16:55:41 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 16:55:41 user nova-compute[74669]:         </nova:port>
Nov 08 16:55:41 user nova-compute[74669]:       </nova:ports>
Nov 08 16:55:41 user nova-compute[74669]:     </nova:instance>
Nov 08 16:55:41 user nova-compute[74669]:   </metadata>
Nov 08 16:55:41 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:55:41 user nova-compute[74669]:     <system>
Nov 08 16:55:41 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:55:41 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:55:41 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:55:41 user nova-compute[74669]:       <entry name="serial">e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a</entry>
Nov 08 16:55:41 user nova-compute[74669]:       <entry name="uuid">e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a</entry>
Nov 08 16:55:41 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:55:41 user nova-compute[74669]:     </system>
Nov 08 16:55:41 user nova-compute[74669]:   </sysinfo>
Nov 08 16:55:41 user nova-compute[74669]:   <os>
Nov 08 16:55:41 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:55:41 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:55:41 user nova-compute[74669]:   </os>
Nov 08 16:55:41 user nova-compute[74669]:   <features>
Nov 08 16:55:41 user nova-compute[74669]:     <acpi/>
Nov 08 16:55:41 user nova-compute[74669]:     <apic/>
Nov 08 16:55:41 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:55:41 user nova-compute[74669]:   </features>
Nov 08 16:55:41 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:55:41 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:55:41 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:55:41 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:55:41 user nova-compute[74669]:   </clock>
Nov 08 16:55:41 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:55:41 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:55:41 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:55:41 user nova-compute[74669]:   </cpu>
Nov 08 16:55:41 user nova-compute[74669]:   <devices>
Nov 08 16:55:41 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:55:41 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:55:41 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk.rescue"/>
Nov 08 16:55:41 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:55:41 user nova-compute[74669]:     </disk>
Nov 08 16:55:41 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:55:41 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:55:41 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk"/>
Nov 08 16:55:41 user nova-compute[74669]:       <target dev="vdb" bus="virtio"/>
Nov 08 16:55:41 user nova-compute[74669]:     </disk>
Nov 08 16:55:41 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:55:41 user nova-compute[74669]:       <mac address="fa:16:3e:8f:9e:16"/>
Nov 08 16:55:41 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:55:41 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:55:41 user nova-compute[74669]:       <target dev="tap44b48f6d-e0"/>
Nov 08 16:55:41 user nova-compute[74669]:     </interface>
Nov 08 16:55:41 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:55:41 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/console.log" append="off"/>
Nov 08 16:55:41 user nova-compute[74669]:     </serial>
Nov 08 16:55:41 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:55:41 user nova-compute[74669]:     <video>
Nov 08 16:55:41 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:55:41 user nova-compute[74669]:     </video>
Nov 08 16:55:41 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:55:41 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:55:41 user nova-compute[74669]:     </rng>
Nov 08 16:55:41 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:55:41 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:55:41 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:55:41 user nova-compute[74669]:     </memballoon>
Nov 08 16:55:41 user nova-compute[74669]:   </devices>
Nov 08 16:55:41 user nova-compute[74669]: </domain>
Nov 08 16:55:41 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:55:41 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Instance destroyed successfully.
Nov 08 16:55:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] No VIF found with MAC fa:16:3e:8f:9e:16, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.network.neutron [req-3d46453d-f503-43a9-a01b-0aa9785fd755 req-93023df5-85e5-48ef-ac97-e1b29f255fd2 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Updated VIF entry in instance network info cache for port bf29f8cc-1793-457b-a4a6-8158d048eac9. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG nova.network.neutron [req-3d46453d-f503-43a9-a01b-0aa9785fd755 req-93023df5-85e5-48ef-ac97-e1b29f255fd2 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Updating instance_info_cache with network_info: [{"id": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "address": "fa:16:3e:36:41:2f", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29f8cc-17", "ovs_interfaceid": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:55:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3d46453d-f503-43a9-a01b-0aa9785fd755 req-93023df5-85e5-48ef-ac97-e1b29f255fd2 service nova] Releasing lock "refresh_cache-0829b734-daec-4dc6-b24b-cbe89000160c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-1e980dad-7594-4d67-bfc3-80d3b1be739b req-e3e02011-3938-4760-b0bd-6d3385cdc34d service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-changed-4514f25c-5ce0-4ba0-95cd-55298ce3e832 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-1e980dad-7594-4d67-bfc3-80d3b1be739b req-e3e02011-3938-4760-b0bd-6d3385cdc34d service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Refreshing instance network info cache due to event network-changed-4514f25c-5ce0-4ba0-95cd-55298ce3e832. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1e980dad-7594-4d67-bfc3-80d3b1be739b req-e3e02011-3938-4760-b0bd-6d3385cdc34d service nova] Acquiring lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1e980dad-7594-4d67-bfc3-80d3b1be739b req-e3e02011-3938-4760-b0bd-6d3385cdc34d service nova] Acquired lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG nova.network.neutron [req-1e980dad-7594-4d67-bfc3-80d3b1be739b req-e3e02011-3938-4760-b0bd-6d3385cdc34d service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Refreshing network info cache for port 4514f25c-5ce0-4ba0-95cd-55298ce3e832 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-32d6184c-4b23-4692-8f8b-d8e321c8b08b req-e48df32d-6740-407b-8591-82b3be26db5e service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received event network-vif-unplugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-32d6184c-4b23-4692-8f8b-d8e321c8b08b req-e48df32d-6740-407b-8591-82b3be26db5e service nova] Acquiring lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-32d6184c-4b23-4692-8f8b-d8e321c8b08b req-e48df32d-6740-407b-8591-82b3be26db5e service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-32d6184c-4b23-4692-8f8b-d8e321c8b08b req-e48df32d-6740-407b-8591-82b3be26db5e service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-32d6184c-4b23-4692-8f8b-d8e321c8b08b req-e48df32d-6740-407b-8591-82b3be26db5e service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] No waiting events found dispatching network-vif-unplugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:42 user nova-compute[74669]: WARNING nova.compute.manager [req-32d6184c-4b23-4692-8f8b-d8e321c8b08b req-e48df32d-6740-407b-8591-82b3be26db5e service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received unexpected event network-vif-unplugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e for instance with vm_state active and task_state rescuing.
Nov 08 16:55:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-32d6184c-4b23-4692-8f8b-d8e321c8b08b req-e48df32d-6740-407b-8591-82b3be26db5e service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received event network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-32d6184c-4b23-4692-8f8b-d8e321c8b08b req-e48df32d-6740-407b-8591-82b3be26db5e service nova] Acquiring lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-32d6184c-4b23-4692-8f8b-d8e321c8b08b req-e48df32d-6740-407b-8591-82b3be26db5e service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-32d6184c-4b23-4692-8f8b-d8e321c8b08b req-e48df32d-6740-407b-8591-82b3be26db5e service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-32d6184c-4b23-4692-8f8b-d8e321c8b08b req-e48df32d-6740-407b-8591-82b3be26db5e service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] No waiting events found dispatching network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:42 user nova-compute[74669]: WARNING nova.compute.manager [req-32d6184c-4b23-4692-8f8b-d8e321c8b08b req-e48df32d-6740-407b-8591-82b3be26db5e service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received unexpected event network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e for instance with vm_state active and task_state rescuing.
Nov 08 16:55:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk.rescue --force-share --output=json" returned: 0 in 0.236s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:43 user nova-compute[74669]: DEBUG nova.network.neutron [req-1e980dad-7594-4d67-bfc3-80d3b1be739b req-e3e02011-3938-4760-b0bd-6d3385cdc34d service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Updated VIF entry in instance network info cache for port 4514f25c-5ce0-4ba0-95cd-55298ce3e832. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:55:43 user nova-compute[74669]: DEBUG nova.network.neutron [req-1e980dad-7594-4d67-bfc3-80d3b1be739b req-e3e02011-3938-4760-b0bd-6d3385cdc34d service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Updating instance_info_cache with network_info: [{"id": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "address": "fa:16:3e:43:30:8e", "network": {"id": "8718876b-101b-476e-bede-b881ac6c346f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-189935542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4514f25c-5c", "ovs_interfaceid": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "address": "fa:16:3e:aa:ef:0f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f5d804-7e", "ovs_interfaceid": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "address": "fa:16:3e:0b:c0:66", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap263210b8-c7", "ovs_interfaceid": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "address": "fa:16:3e:87:0f:90", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5cb6f9-46", "ovs_interfaceid": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "address": "fa:16:3e:76:80:9f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7639563-89", "ovs_interfaceid": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "address": "fa:16:3e:20:ca:e1", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcee60b9-29", "ovs_interfaceid": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "address": "fa:16:3e:c4:68:51", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6856bd-1e", "ovs_interfaceid": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:55:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1e980dad-7594-4d67-bfc3-80d3b1be739b req-e3e02011-3938-4760-b0bd-6d3385cdc34d service nova] Releasing lock "refresh_cache-220b317c-a111-4600-b1e2-2a63e22de78a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:55:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 16:55:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 16:55:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 16:55:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 16:55:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad6890a-b71d-472b-a435-0fea19ae012a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad6890a-b71d-472b-a435-0fea19ae012a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad6890a-b71d-472b-a435-0fea19ae012a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad6890a-b71d-472b-a435-0fea19ae012a/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-67dc303d-a0c3-4702-b76d-bf8b26d5130f req-21c6e994-fa85-4ae9-84fc-d9d25a8669f5 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received event network-changed-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-67dc303d-a0c3-4702-b76d-bf8b26d5130f req-21c6e994-fa85-4ae9-84fc-d9d25a8669f5 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Refreshing instance network info cache due to event network-changed-bf29f8cc-1793-457b-a4a6-8158d048eac9. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-67dc303d-a0c3-4702-b76d-bf8b26d5130f req-21c6e994-fa85-4ae9-84fc-d9d25a8669f5 service nova] Acquiring lock "refresh_cache-0829b734-daec-4dc6-b24b-cbe89000160c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-67dc303d-a0c3-4702-b76d-bf8b26d5130f req-21c6e994-fa85-4ae9-84fc-d9d25a8669f5 service nova] Acquired lock "refresh_cache-0829b734-daec-4dc6-b24b-cbe89000160c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG nova.network.neutron [req-67dc303d-a0c3-4702-b76d-bf8b26d5130f req-21c6e994-fa85-4ae9-84fc-d9d25a8669f5 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Refreshing network info cache for port bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk.rescue --force-share --output=json" returned: 0 in 0.236s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG nova.network.neutron [req-67dc303d-a0c3-4702-b76d-bf8b26d5130f req-21c6e994-fa85-4ae9-84fc-d9d25a8669f5 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Updated VIF entry in instance network info cache for port bf29f8cc-1793-457b-a4a6-8158d048eac9. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG nova.network.neutron [req-67dc303d-a0c3-4702-b76d-bf8b26d5130f req-21c6e994-fa85-4ae9-84fc-d9d25a8669f5 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Updating instance_info_cache with network_info: [{"id": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "address": "fa:16:3e:36:41:2f", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29f8cc-17", "ovs_interfaceid": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-67dc303d-a0c3-4702-b76d-bf8b26d5130f req-21c6e994-fa85-4ae9-84fc-d9d25a8669f5 service nova] Releasing lock "refresh_cache-0829b734-daec-4dc6-b24b-cbe89000160c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-b566a5ec-d30d-4764-b788-be63c4c86840 req-f2af0992-4a85-4ec2-a6ee-f6e2153e40ac service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received event network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b566a5ec-d30d-4764-b788-be63c4c86840 req-f2af0992-4a85-4ec2-a6ee-f6e2153e40ac service nova] Acquiring lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b566a5ec-d30d-4764-b788-be63c4c86840 req-f2af0992-4a85-4ec2-a6ee-f6e2153e40ac service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b566a5ec-d30d-4764-b788-be63c4c86840 req-f2af0992-4a85-4ec2-a6ee-f6e2153e40ac service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-b566a5ec-d30d-4764-b788-be63c4c86840 req-f2af0992-4a85-4ec2-a6ee-f6e2153e40ac service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] No waiting events found dispatching network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:44 user nova-compute[74669]: WARNING nova.compute.manager [req-b566a5ec-d30d-4764-b788-be63c4c86840 req-f2af0992-4a85-4ec2-a6ee-f6e2153e40ac service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received unexpected event network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e for instance with vm_state active and task_state rescuing.
Nov 08 16:55:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-b566a5ec-d30d-4764-b788-be63c4c86840 req-f2af0992-4a85-4ec2-a6ee-f6e2153e40ac service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received event network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b566a5ec-d30d-4764-b788-be63c4c86840 req-f2af0992-4a85-4ec2-a6ee-f6e2153e40ac service nova] Acquiring lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b566a5ec-d30d-4764-b788-be63c4c86840 req-f2af0992-4a85-4ec2-a6ee-f6e2153e40ac service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b566a5ec-d30d-4764-b788-be63c4c86840 req-f2af0992-4a85-4ec2-a6ee-f6e2153e40ac service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-b566a5ec-d30d-4764-b788-be63c4c86840 req-f2af0992-4a85-4ec2-a6ee-f6e2153e40ac service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] No waiting events found dispatching network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:44 user nova-compute[74669]: WARNING nova.compute.manager [req-b566a5ec-d30d-4764-b788-be63c4c86840 req-f2af0992-4a85-4ec2-a6ee-f6e2153e40ac service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received unexpected event network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e for instance with vm_state active and task_state rescuing.
Nov 08 16:55:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "220b317c-a111-4600-b1e2-2a63e22de78a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:45 user nova-compute[74669]: INFO nova.compute.manager [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Terminating instance
Nov 08 16:55:45 user nova-compute[74669]: DEBUG nova.compute.manager [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 16:55:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:45 user nova-compute[74669]: DEBUG nova.compute.manager [None req-759e7f56-136d-4658-9b65-4de124de0e57 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:55:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-3d613938-7d27-49c7-bdf5-1fe6bd50e561 req-aeaa00ab-9c39-4e7e-a01c-77bbd2179b27 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-unplugged-263210b8-c77f-49af-a1c0-146dcb0a5dc5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3d613938-7d27-49c7-bdf5-1fe6bd50e561 req-aeaa00ab-9c39-4e7e-a01c-77bbd2179b27 service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3d613938-7d27-49c7-bdf5-1fe6bd50e561 req-aeaa00ab-9c39-4e7e-a01c-77bbd2179b27 service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3d613938-7d27-49c7-bdf5-1fe6bd50e561 req-aeaa00ab-9c39-4e7e-a01c-77bbd2179b27 service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-3d613938-7d27-49c7-bdf5-1fe6bd50e561 req-aeaa00ab-9c39-4e7e-a01c-77bbd2179b27 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-unplugged-263210b8-c77f-49af-a1c0-146dcb0a5dc5 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-3d613938-7d27-49c7-bdf5-1fe6bd50e561 req-aeaa00ab-9c39-4e7e-a01c-77bbd2179b27 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-unplugged-263210b8-c77f-49af-a1c0-146dcb0a5dc5 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-36569b87-e9e9-4fe7-b9ae-bf086d9e8610 req-1ade6403-02f6-4166-8b90-44ed971b8800 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-unplugged-4514f25c-5ce0-4ba0-95cd-55298ce3e832 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-36569b87-e9e9-4fe7-b9ae-bf086d9e8610 req-1ade6403-02f6-4166-8b90-44ed971b8800 service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-36569b87-e9e9-4fe7-b9ae-bf086d9e8610 req-1ade6403-02f6-4166-8b90-44ed971b8800 service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-36569b87-e9e9-4fe7-b9ae-bf086d9e8610 req-1ade6403-02f6-4166-8b90-44ed971b8800 service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-36569b87-e9e9-4fe7-b9ae-bf086d9e8610 req-1ade6403-02f6-4166-8b90-44ed971b8800 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-unplugged-4514f25c-5ce0-4ba0-95cd-55298ce3e832 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-36569b87-e9e9-4fe7-b9ae-bf086d9e8610 req-1ade6403-02f6-4166-8b90-44ed971b8800 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-unplugged-4514f25c-5ce0-4ba0-95cd-55298ce3e832 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-36569b87-e9e9-4fe7-b9ae-bf086d9e8610 req-1ade6403-02f6-4166-8b90-44ed971b8800 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-plugged-4514f25c-5ce0-4ba0-95cd-55298ce3e832 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-36569b87-e9e9-4fe7-b9ae-bf086d9e8610 req-1ade6403-02f6-4166-8b90-44ed971b8800 service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-36569b87-e9e9-4fe7-b9ae-bf086d9e8610 req-1ade6403-02f6-4166-8b90-44ed971b8800 service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-36569b87-e9e9-4fe7-b9ae-bf086d9e8610 req-1ade6403-02f6-4166-8b90-44ed971b8800 service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-36569b87-e9e9-4fe7-b9ae-bf086d9e8610 req-1ade6403-02f6-4166-8b90-44ed971b8800 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-plugged-4514f25c-5ce0-4ba0-95cd-55298ce3e832 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:47 user nova-compute[74669]: WARNING nova.compute.manager [req-36569b87-e9e9-4fe7-b9ae-bf086d9e8610 req-1ade6403-02f6-4166-8b90-44ed971b8800 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received unexpected event network-vif-plugged-4514f25c-5ce0-4ba0-95cd-55298ce3e832 for instance with vm_state active and task_state deleting.
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-unplugged-48f5d804-7e38-4c85-af5e-ab6e55c736ac {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-unplugged-48f5d804-7e38-4c85-af5e-ab6e55c736ac {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-unplugged-48f5d804-7e38-4c85-af5e-ab6e55c736ac for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-plugged-48f5d804-7e38-4c85-af5e-ab6e55c736ac {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-plugged-48f5d804-7e38-4c85-af5e-ab6e55c736ac {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:47 user nova-compute[74669]: WARNING nova.compute.manager [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received unexpected event network-vif-plugged-48f5d804-7e38-4c85-af5e-ab6e55c736ac for instance with vm_state active and task_state deleting.
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-unplugged-bcee60b9-29f1-49cd-b769-d3dbf7b0f11d {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-unplugged-bcee60b9-29f1-49cd-b769-d3dbf7b0f11d {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-unplugged-bcee60b9-29f1-49cd-b769-d3dbf7b0f11d for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-plugged-bcee60b9-29f1-49cd-b769-d3dbf7b0f11d {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-plugged-bcee60b9-29f1-49cd-b769-d3dbf7b0f11d {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:47 user nova-compute[74669]: WARNING nova.compute.manager [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received unexpected event network-vif-plugged-bcee60b9-29f1-49cd-b769-d3dbf7b0f11d for instance with vm_state active and task_state deleting.
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-unplugged-6f6856bd-1e1d-406b-8d39-7f3f288d135b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-unplugged-6f6856bd-1e1d-406b-8d39-7f3f288d135b {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-unplugged-6f6856bd-1e1d-406b-8d39-7f3f288d135b for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-plugged-6f6856bd-1e1d-406b-8d39-7f3f288d135b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-plugged-6f6856bd-1e1d-406b-8d39-7f3f288d135b {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:47 user nova-compute[74669]: WARNING nova.compute.manager [req-ff53984b-9a30-4346-b8fe-44bcb206e463 req-389de3ad-1543-4f5d-a8a3-31b254ad463e service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received unexpected event network-vif-plugged-6f6856bd-1e1d-406b-8d39-7f3f288d135b for instance with vm_state active and task_state deleting.
Nov 08 16:55:47 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:55:47 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=7848MB free_disk=25.533885955810547GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:47 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Instance destroyed successfully.
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.objects.instance [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lazy-loading 'resources' on Instance uuid 220b317c-a111-4600-b1e2-2a63e22de78a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-881607780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-881607780',id=11,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm9lQ3SAiMNJZrxiyPCWI4ahlhBAnR9vvGizl11pHKwSyyBqoISKJhwufG6prBVxtppmree8vWIMKH/ZTi6sDbJkA+8UEh7PlmPeUfhVDPq9UvYWyRV2e1YAP/hna/EKg==',key_name='tempest-keypair-1554170018',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef553fbdfa6a49f5bb2bdde29020e6ee',ramdisk_id='',reservation_id='r-vhxz9s0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-70363984',owner_user_name='tempest-TaggedBootDevicesTest_v242-70363984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:54:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d5080c9af64051ab23b87414b5ec48',uuid=220b317c-a111-4600-b1e2-2a63e22de78a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "address": "fa:16:3e:43:30:8e", "network": {"id": "8718876b-101b-476e-bede-b881ac6c346f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-189935542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4514f25c-5c", "ovs_interfaceid": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converting VIF {"id": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "address": "fa:16:3e:43:30:8e", "network": {"id": "8718876b-101b-476e-bede-b881ac6c346f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-189935542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4514f25c-5c", "ovs_interfaceid": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:30:8e,bridge_name='br-int',has_traffic_filtering=True,id=4514f25c-5ce0-4ba0-95cd-55298ce3e832,network=Network(8718876b-101b-476e-bede-b881ac6c346f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4514f25c-5c') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG os_vif [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:30:8e,bridge_name='br-int',has_traffic_filtering=True,id=4514f25c-5ce0-4ba0-95cd-55298ce3e832,network=Network(8718876b-101b-476e-bede-b881ac6c346f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4514f25c-5c') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4514f25c-5c, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygTldqYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:55:47 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:55:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:55:47 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:55:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:55:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:55:48 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fcba20-2cb2-443e-8cde-d95bc76dc20c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 16:55:48 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b81179b-c461-420e-a2b4-0396753fbf53) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de58ab5-9fb6-44bd-9e64-3ffbd639c88e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263] added
Nov 08 16:55:48 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b017a43-56e1-4899-9196-8b0a1c80bb6a]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b26dbeeb-b629-414d-bcca-cdde6c207789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2d42d5ce-db73-40e6-9b35-f662a3cf0091 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0829b734-daec-4dc6-b24b-cbe89000160c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 220b317c-a111-4600-b1e2-2a63e22de78a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0ad6890a-b71d-472b-a435-0fea19ae012a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e09e356-1778-4010-a1bd-e024018711ec]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ygTldqYN {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:48 user nova-compute[74669]: INFO os_vif [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:30:8e,bridge_name='br-int',has_traffic_filtering=True,id=4514f25c-5ce0-4ba0-95cd-55298ce3e832,network=Network(8718876b-101b-476e-bede-b881ac6c346f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4514f25c-5c')
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-881607780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-881607780',id=11,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm9lQ3SAiMNJZrxiyPCWI4ahlhBAnR9vvGizl11pHKwSyyBqoISKJhwufG6prBVxtppmree8vWIMKH/ZTi6sDbJkA+8UEh7PlmPeUfhVDPq9UvYWyRV2e1YAP/hna/EKg==',key_name='tempest-keypair-1554170018',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef553fbdfa6a49f5bb2bdde29020e6ee',ramdisk_id='',reservation_id='r-vhxz9s0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-70363984',owner_user_name='tempest-TaggedBootDevicesTest_v242-70363984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:54:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d5080c9af64051ab23b87414b5ec48',uuid=220b317c-a111-4600-b1e2-2a63e22de78a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "address": "fa:16:3e:aa:ef:0f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f5d804-7e", "ovs_interfaceid": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converting VIF {"id": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "address": "fa:16:3e:aa:ef:0f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f5d804-7e", "ovs_interfaceid": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:ef:0f,bridge_name='br-int',has_traffic_filtering=True,id=48f5d804-7e38-4c85-af5e-ab6e55c736ac,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap48f5d804-7e') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_vif [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:ef:0f,bridge_name='br-int',has_traffic_filtering=True,id=48f5d804-7e38-4c85-af5e-ab6e55c736ac,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap48f5d804-7e') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48f5d804-7e, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ygTldqYN" returned: 0 in 0.027s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c665bf6-eaf3-4670-bd0e-b4d7e8a100f1]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ygTldqYN'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-unplugged-8a5cb6f9-4637-4473-a64d-651ebf09be49 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-unplugged-8a5cb6f9-4637-4473-a64d-651ebf09be49 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-unplugged-8a5cb6f9-4637-4473-a64d-651ebf09be49 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-plugged-8a5cb6f9-4637-4473-a64d-651ebf09be49 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-plugged-8a5cb6f9-4637-4473-a64d-651ebf09be49 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:48 user nova-compute[74669]: WARNING nova.compute.manager [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received unexpected event network-vif-plugged-8a5cb6f9-4637-4473-a64d-651ebf09be49 for instance with vm_state active and task_state deleting.
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-unplugged-e7639563-89fb-44bf-89e2-ca44e79ad44a {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-unplugged-e7639563-89fb-44bf-89e2-ca44e79ad44a {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-unplugged-e7639563-89fb-44bf-89e2-ca44e79ad44a for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-plugged-e7639563-89fb-44bf-89e2-ca44e79ad44a {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-plugged-e7639563-89fb-44bf-89e2-ca44e79ad44a {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:48 user nova-compute[74669]: WARNING nova.compute.manager [req-5706f19e-f36f-4c6c-ab00-2d33a052fca6 req-39e4322e-f51b-4cce-96c1-d3e57fd53adc service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received unexpected event network-vif-plugged-e7639563-89fb-44bf-89e2-ca44e79ad44a for instance with vm_state active and task_state deleting.
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc9b6e9-fd30-4e4a-afc3-d2bf1f166cd4]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dce6ca36-5a4e-485d-a5e2-221fda0515de) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-08cc64cf-95c3-4e2c-b3a1-74cb51b2c1e5 req-053fa3c2-b9e3-4adb-ac1c-9aa5afe7ba1b service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-plugged-263210b8-c77f-49af-a1c0-146dcb0a5dc5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-08cc64cf-95c3-4e2c-b3a1-74cb51b2c1e5 req-053fa3c2-b9e3-4adb-ac1c-9aa5afe7ba1b service nova] Acquiring lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-08cc64cf-95c3-4e2c-b3a1-74cb51b2c1e5 req-053fa3c2-b9e3-4adb-ac1c-9aa5afe7ba1b service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-08cc64cf-95c3-4e2c-b3a1-74cb51b2c1e5 req-053fa3c2-b9e3-4adb-ac1c-9aa5afe7ba1b service nova] Lock "220b317c-a111-4600-b1e2-2a63e22de78a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-08cc64cf-95c3-4e2c-b3a1-74cb51b2c1e5 req-053fa3c2-b9e3-4adb-ac1c-9aa5afe7ba1b service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] No waiting events found dispatching network-vif-plugged-263210b8-c77f-49af-a1c0-146dcb0a5dc5 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:48 user nova-compute[74669]: WARNING nova.compute.manager [req-08cc64cf-95c3-4e2c-b3a1-74cb51b2c1e5 req-053fa3c2-b9e3-4adb-ac1c-9aa5afe7ba1b service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received unexpected event network-vif-plugged-263210b8-c77f-49af-a1c0-146dcb0a5dc5 for instance with vm_state active and task_state deleting.
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81f93d2-a0a9-41aa-a68b-146b3170be35]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:55:48 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:55:48 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:55:48 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:55:48 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:55:48 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:55:48 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:55:48 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:55:48 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:55:48 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:55:48 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: INFO os_vif [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:ef:0f,bridge_name='br-int',has_traffic_filtering=True,id=48f5d804-7e38-4c85-af5e-ab6e55c736ac,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap48f5d804-7e')
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-881607780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-881607780',id=11,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm9lQ3SAiMNJZrxiyPCWI4ahlhBAnR9vvGizl11pHKwSyyBqoISKJhwufG6prBVxtppmree8vWIMKH/ZTi6sDbJkA+8UEh7PlmPeUfhVDPq9UvYWyRV2e1YAP/hna/EKg==',key_name='tempest-keypair-1554170018',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef553fbdfa6a49f5bb2bdde29020e6ee',ramdisk_id='',reservation_id='r-vhxz9s0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-70363984',owner_user_name='tempest-TaggedBootDevicesTest_v242-70363984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:54:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d5080c9af64051ab23b87414b5ec48',uuid=220b317c-a111-4600-b1e2-2a63e22de78a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "address": "fa:16:3e:0b:c0:66", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap263210b8-c7", "ovs_interfaceid": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converting VIF {"id": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "address": "fa:16:3e:0b:c0:66", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap263210b8-c7", "ovs_interfaceid": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c0:66,bridge_name='br-int',has_traffic_filtering=True,id=263210b8-c77f-49af-a1c0-146dcb0a5dc5,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap263210b8-c7') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_vif [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c0:66,bridge_name='br-int',has_traffic_filtering=True,id=263210b8-c77f-49af-a1c0-146dcb0a5dc5,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap263210b8-c7') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap263210b8-c7, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca1bdda0-e43b-479b-9553-ab6d3dcb893b) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --login" returned: 0 in 0.119s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57bdedd-9d19-4b4c-828f-c49170ec0e88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260]
Nov 08 16:55:48 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260] successful.
Nov 08 16:55:48 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: INFO os_vif [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c0:66,bridge_name='br-int',has_traffic_filtering=True,id=263210b8-c77f-49af-a1c0-146dcb0a5dc5,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap263210b8-c7')
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-881607780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-881607780',id=11,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm9lQ3SAiMNJZrxiyPCWI4ahlhBAnR9vvGizl11pHKwSyyBqoISKJhwufG6prBVxtppmree8vWIMKH/ZTi6sDbJkA+8UEh7PlmPeUfhVDPq9UvYWyRV2e1YAP/hna/EKg==',key_name='tempest-keypair-1554170018',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef553fbdfa6a49f5bb2bdde29020e6ee',ramdisk_id='',reservation_id='r-vhxz9s0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-70363984',owner_user_name='tempest-TaggedBootDevicesTest_v242-70363984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:54:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d5080c9af64051ab23b87414b5ec48',uuid=220b317c-a111-4600-b1e2-2a63e22de78a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "address": "fa:16:3e:87:0f:90", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5cb6f9-46", "ovs_interfaceid": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converting VIF {"id": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "address": "fa:16:3e:87:0f:90", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5cb6f9-46", "ovs_interfaceid": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:0f:90,bridge_name='br-int',has_traffic_filtering=True,id=8a5cb6f9-4637-4473-a64d-651ebf09be49,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a5cb6f9-46') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_vif [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:0f:90,bridge_name='br-int',has_traffic_filtering=True,id=8a5cb6f9-4637-4473-a64d-651ebf09be49,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a5cb6f9-46') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a5cb6f9-46, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3fde21-89e6-499b-b9fe-eaa10cc485af]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[17844a59-c836-470e-9b63-9f059ee69dee]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:55:48 user nova-compute[74669]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:55:48 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:55:48 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:55:48 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:55:48 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:55:48 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:55:48 user nova-compute[74669]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:55:48 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:55:48 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:55:48 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:55:48 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:55:48 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.452s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] HCTL ('35', '-', '-', 0) found on session 11 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7588b04-a459-41f4-a382-db00935adc62) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.541s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a765926-c798-4efd-863c-5d5a989ce5e6]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Searching for a device in session 11 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygTldqYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: INFO os_vif [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:0f:90,bridge_name='br-int',has_traffic_filtering=True,id=8a5cb6f9-4637-4473-a64d-651ebf09be49,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a5cb6f9-46')
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-881607780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-881607780',id=11,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm9lQ3SAiMNJZrxiyPCWI4ahlhBAnR9vvGizl11pHKwSyyBqoISKJhwufG6prBVxtppmree8vWIMKH/ZTi6sDbJkA+8UEh7PlmPeUfhVDPq9UvYWyRV2e1YAP/hna/EKg==',key_name='tempest-keypair-1554170018',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef553fbdfa6a49f5bb2bdde29020e6ee',ramdisk_id='',reservation_id='r-vhxz9s0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-70363984',owner_user_name='tempest-TaggedBootDevicesTest_v242-70363984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:54:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d5080c9af64051ab23b87414b5ec48',uuid=220b317c-a111-4600-b1e2-2a63e22de78a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "address": "fa:16:3e:76:80:9f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7639563-89", "ovs_interfaceid": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converting VIF {"id": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "address": "fa:16:3e:76:80:9f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7639563-89", "ovs_interfaceid": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:80:9f,bridge_name='br-int',has_traffic_filtering=True,id=e7639563-89fb-44bf-89e2-ca44e79ad44a,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7639563-89') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_vif [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:80:9f,bridge_name='br-int',has_traffic_filtering=True,id=e7639563-89fb-44bf-89e2-ca44e79ad44a,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7639563-89') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7639563-89, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=233a8431-c338-420e-b600-d7b1b882186e) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: INFO os_vif [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:80:9f,bridge_name='br-int',has_traffic_filtering=True,id=e7639563-89fb-44bf-89e2-ca44e79ad44a,network=Network(de4750af-f132-4fab-a627-2007aafb0838),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7639563-89')
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-881607780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-881607780',id=11,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm9lQ3SAiMNJZrxiyPCWI4ahlhBAnR9vvGizl11pHKwSyyBqoISKJhwufG6prBVxtppmree8vWIMKH/ZTi6sDbJkA+8UEh7PlmPeUfhVDPq9UvYWyRV2e1YAP/hna/EKg==',key_name='tempest-keypair-1554170018',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef553fbdfa6a49f5bb2bdde29020e6ee',ramdisk_id='',reservation_id='r-vhxz9s0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-70363984',owner_user_name='tempest-TaggedBootDevicesTest_v242-70363984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:54:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d5080c9af64051ab23b87414b5ec48',uuid=220b317c-a111-4600-b1e2-2a63e22de78a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "address": "fa:16:3e:20:ca:e1", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcee60b9-29", "ovs_interfaceid": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converting VIF {"id": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "address": "fa:16:3e:20:ca:e1", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcee60b9-29", "ovs_interfaceid": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:ca:e1,bridge_name='br-int',has_traffic_filtering=True,id=bcee60b9-29f1-49cd-b769-d3dbf7b0f11d,network=Network(d87f85ee-10af-4cbb-9514-02cc98f3edfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcee60b9-29') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_vif [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:ca:e1,bridge_name='br-int',has_traffic_filtering=True,id=bcee60b9-29f1-49cd-b769-d3dbf7b0f11d,network=Network(d87f85ee-10af-4cbb-9514-02cc98f3edfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcee60b9-29') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcee60b9-29, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee160d93-1f80-4a72-9f8f-e58fc62446fe) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: INFO os_vif [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:ca:e1,bridge_name='br-int',has_traffic_filtering=True,id=bcee60b9-29f1-49cd-b769-d3dbf7b0f11d,network=Network(d87f85ee-10af-4cbb-9514-02cc98f3edfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcee60b9-29')
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-881607780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-881607780',id=11,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKm9lQ3SAiMNJZrxiyPCWI4ahlhBAnR9vvGizl11pHKwSyyBqoISKJhwufG6prBVxtppmree8vWIMKH/ZTi6sDbJkA+8UEh7PlmPeUfhVDPq9UvYWyRV2e1YAP/hna/EKg==',key_name='tempest-keypair-1554170018',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef553fbdfa6a49f5bb2bdde29020e6ee',ramdisk_id='',reservation_id='r-vhxz9s0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-70363984',owner_user_name='tempest-TaggedBootDevicesTest_v242-70363984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:54:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d5080c9af64051ab23b87414b5ec48',uuid=220b317c-a111-4600-b1e2-2a63e22de78a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "address": "fa:16:3e:c4:68:51", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6856bd-1e", "ovs_interfaceid": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converting VIF {"id": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "address": "fa:16:3e:c4:68:51", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6856bd-1e", "ovs_interfaceid": "6f6856bd-1e1d-406b-8d39-7f3f288d135b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:68:51,bridge_name='br-int',has_traffic_filtering=True,id=6f6856bd-1e1d-406b-8d39-7f3f288d135b,network=Network(d87f85ee-10af-4cbb-9514-02cc98f3edfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f6856bd-1e') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_vif [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:68:51,bridge_name='br-int',has_traffic_filtering=True,id=6f6856bd-1e1d-406b-8d39-7f3f288d135b,network=Network(d87f85ee-10af-4cbb-9514-02cc98f3edfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f6856bd-1e') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f6856bd-1e, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2374b466-663e-4cff-8acb-5a03b3bbbfc7) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:48 user nova-compute[74669]: INFO os_vif [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:68:51,bridge_name='br-int',has_traffic_filtering=True,id=6f6856bd-1e1d-406b-8d39-7f3f288d135b,network=Network(d87f85ee-10af-4cbb-9514-02cc98f3edfc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f6856bd-1e')
Nov 08 16:55:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pCNzaGbU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:55:48 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:55:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.497s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] <== connect_volume: return (1498ms) {'type': 'block', 'scsi_wwn': '23333376538313966', 'path': '/dev/sdd'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333376538313966', 'path': '/dev/sdd'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.851s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG nova.objects.instance [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lazy-loading 'flavor' on Instance uuid b26dbeeb-b629-414d-bcca-cdde6c207789 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abce47f-6be4-4bac-8ee1-11296c3d7bc2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 16:55:49 user nova-compute[74669]: No targets found.
Nov 08 16:55:49 user nova-compute[74669]: iSNS:
Nov 08 16:55:49 user nova-compute[74669]: No targets found.
Nov 08 16:55:49 user nova-compute[74669]: STATIC:
Nov 08 16:55:49 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263
Nov 08 16:55:49 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:55:49 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:55:49 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e
Nov 08 16:55:49 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:55:49 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:55:49 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e
Nov 08 16:55:49 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:55:49 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:55:49 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6
Nov 08 16:55:49 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:55:49 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:55:49 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630
Nov 08 16:55:49 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:55:49 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:55:49 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb
Nov 08 16:55:49 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:55:49 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:55:49 user nova-compute[74669]: FIRMWARE:
Nov 08 16:55:49 user nova-compute[74669]: No targets found.
Nov 08 16:55:49 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 16:55:49 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 16:55:49 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b0f7e9-7067-4f9c-b765-1ef43b67485e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 16:55:49 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:55:49 user nova-compute[74669]:   <source dev="/dev/sdd"/>
Nov 08 16:55:49 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:55:49 user nova-compute[74669]:   <serial>f1176f50-24fe-4e13-aa36-02955f521263</serial>
Nov 08 16:55:49 user nova-compute[74669]: </disk>
Nov 08 16:55:49 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfb4edc-7f63-4fb9-a819-26be83f82d10]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:55:49 user nova-compute[74669]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:55:49 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:55:49 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:55:49 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:55:49 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:55:49 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:55:49 user nova-compute[74669]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:55:49 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:55:49 user nova-compute[74669]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb (non-flash)
Nov 08 16:55:49 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:55:49 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:55:49 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9a825b0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb'): ({'sdf'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Removing single pathed devices sdf {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcabfd3-a359-4b75-be71-96ab81685249]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b2b733-0c16-45c4-bbd6-e9c679dbc716]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Flushing IO for device /dev/sdf {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0379102-e54a-4263-ad97-8c4420c456b9]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ba7956-9f47-4d4a-a5e7-982208589124]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] SCSI volumes sdf have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb5608f-4402-468b-895d-1c1d7e691b68]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a094c5e-ec10-45aa-a212-f498e98cd01e]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb, portal: 172.16.0.220,3260]
Nov 08 16:55:49 user nova-compute[74669]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb, portal: 172.16.0.220,3260] successful.
Nov 08 16:55:49 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391df8b1-b8a5-4886-9a8c-87fb65dfc5eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5402f9-0e3e-4417-9e06-8dd68ac75334]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] <== disconnect_volume: return (1252ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVyhUpZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:55:49 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85f994f-7f65-4b95-a1d9-094ee165d8a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 16:55:49 user nova-compute[74669]: No targets found.
Nov 08 16:55:49 user nova-compute[74669]: iSNS:
Nov 08 16:55:49 user nova-compute[74669]: No targets found.
Nov 08 16:55:49 user nova-compute[74669]: STATIC:
Nov 08 16:55:49 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263
Nov 08 16:55:49 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:55:49 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:55:49 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e
Nov 08 16:55:49 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:55:49 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:55:49 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e
Nov 08 16:55:49 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:55:49 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:55:49 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6
Nov 08 16:55:49 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:55:49 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:55:49 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630
Nov 08 16:55:49 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:55:49 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:55:49 user nova-compute[74669]: FIRMWARE:
Nov 08 16:55:49 user nova-compute[74669]: No targets found.
Nov 08 16:55:49 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 16:55:49 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 16:55:49 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8022c7-467a-48bc-ac65-b1ceb5e79a1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c402a41-9088-45c8-a920-10dde187b78d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:55:50 user nova-compute[74669]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:55:50 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:55:50 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:55:50 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:55:50 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:55:50 user nova-compute[74669]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:55:50 user nova-compute[74669]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e (non-flash)
Nov 08 16:55:50 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:55:50 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:55:50 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9a825b0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e'): ({'sde'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Removing single pathed devices sde {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db95b52-c202-4d5c-88f7-74c695c2040c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[79951765-d971-4ddb-999a-c05a591e962f]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Flushing IO for device /dev/sde {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18aa32e-bf0b-4e28-9d20-a995cf7ee64e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] No VIF found with MAC fa:16:3e:33:33:ae, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[646aff17-7fec-414a-bafd-11b63e846e88]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] SCSI volumes sde have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f804704-7edc-4f0b-a607-efd1e5355330]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9c05a4-9f17-4742-a8a4-67921d578180]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e, portal: 172.16.0.220,3260]
Nov 08 16:55:50 user nova-compute[74669]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e, portal: 172.16.0.220,3260] successful.
Nov 08 16:55:50 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:734606a5-2915-4dc6-97dd-7ab519822f6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d28dd50-c834-4191-9c6c-ef9cc6d91d5b]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] <== disconnect_volume: return (377ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pEDQWmcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:55:50 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e2150c-1cc8-443c-b575-8a159fdd0d87]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 16:55:50 user nova-compute[74669]: No targets found.
Nov 08 16:55:50 user nova-compute[74669]: iSNS:
Nov 08 16:55:50 user nova-compute[74669]: No targets found.
Nov 08 16:55:50 user nova-compute[74669]: STATIC:
Nov 08 16:55:50 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263
Nov 08 16:55:50 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:55:50 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:55:50 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e
Nov 08 16:55:50 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:55:50 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:55:50 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6
Nov 08 16:55:50 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:55:50 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:55:50 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630
Nov 08 16:55:50 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:55:50 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:55:50 user nova-compute[74669]: FIRMWARE:
Nov 08 16:55:50 user nova-compute[74669]: No targets found.
Nov 08 16:55:50 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 16:55:50 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 16:55:50 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffa8b6c-30fa-497b-bcd1-fc907235ac62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdc5aa7-8541-4f54-a787-256cce75b084]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:55:50 user nova-compute[74669]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:55:50 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:55:50 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:55:50 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:55:50 user nova-compute[74669]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:55:50 user nova-compute[74669]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e (non-flash)
Nov 08 16:55:50 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:55:50 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9846becb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e'): ({'sdg'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Removing single pathed devices sdg {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[46255c69-10ea-4ffb-b60d-62c1800237ec]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1d6a32-dedc-4008-a86b-8d1245e7358d]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Flushing IO for device /dev/sdg {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0763d0-8f4b-45ae-ad2c-04c0a2ffb105]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[34064147-ce26-4915-9b5d-35885130c361]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] SCSI volumes sdg have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e616e9d-403b-4436-9e55-d056f968b914]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a2ccea-ff0b-4c0b-b25d-181cfbd5b62a]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e, portal: 172.16.0.220,3260]
Nov 08 16:55:50 user nova-compute[74669]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e, portal: 172.16.0.220,3260] successful.
Nov 08 16:55:50 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1ff7ee36-a8f0-4bb7-adbb-2ab8cb14b02d tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 64.165s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9297ac72-cbae-419f-a8bf-4627f4075e5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cd53ee-70e5-4511-ad9c-d24c6e32879a]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] <== disconnect_volume: return (361ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 16:55:50 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Deleting instance files /opt/stack/data/nova/instances/220b317c-a111-4600-b1e2-2a63e22de78a_del
Nov 08 16:55:50 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Deletion of /opt/stack/data/nova/instances/220b317c-a111-4600-b1e2-2a63e22de78a_del complete
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 16:55:50 user nova-compute[74669]: INFO nova.compute.manager [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Took 5.36 seconds to destroy the instance on the hypervisor.
Nov 08 16:55:50 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 16:55:50 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 16:55:51 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Updating instance_info_cache with network_info: [{"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:55:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:55:51 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 16:55:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:55:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:55:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:55:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:55:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:55:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:55:51 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:55:52 user nova-compute[74669]: DEBUG nova.compute.manager [req-bd39667f-cf6d-4192-b18e-ddcd2a3e44e3 req-0370b5a1-7a75-4722-801a-4f1817f355b9 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-deleted-6f6856bd-1e1d-406b-8d39-7f3f288d135b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:52 user nova-compute[74669]: INFO nova.compute.manager [req-bd39667f-cf6d-4192-b18e-ddcd2a3e44e3 req-0370b5a1-7a75-4722-801a-4f1817f355b9 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Neutron deleted interface 6f6856bd-1e1d-406b-8d39-7f3f288d135b; detaching it from the instance and deleting it from the info cache
Nov 08 16:55:52 user nova-compute[74669]: DEBUG nova.network.neutron [req-bd39667f-cf6d-4192-b18e-ddcd2a3e44e3 req-0370b5a1-7a75-4722-801a-4f1817f355b9 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Updating instance_info_cache with network_info: [{"id": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "address": "fa:16:3e:43:30:8e", "network": {"id": "8718876b-101b-476e-bede-b881ac6c346f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-189935542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4514f25c-5c", "ovs_interfaceid": "4514f25c-5ce0-4ba0-95cd-55298ce3e832", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "address": "fa:16:3e:aa:ef:0f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f5d804-7e", "ovs_interfaceid": "48f5d804-7e38-4c85-af5e-ab6e55c736ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "address": "fa:16:3e:0b:c0:66", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap263210b8-c7", "ovs_interfaceid": "263210b8-c77f-49af-a1c0-146dcb0a5dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "address": "fa:16:3e:87:0f:90", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a5cb6f9-46", "ovs_interfaceid": "8a5cb6f9-4637-4473-a64d-651ebf09be49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "address": "fa:16:3e:76:80:9f", "network": {"id": "de4750af-f132-4fab-a627-2007aafb0838", "bridge": "br-int", "label": "tempest-device-tagging-net1-1521908776", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7639563-89", "ovs_interfaceid": "e7639563-89fb-44bf-89e2-ca44e79ad44a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "address": "fa:16:3e:20:ca:e1", "network": {"id": "d87f85ee-10af-4cbb-9514-02cc98f3edfc", "bridge": "br-int", "label": "tempest-device-tagging-net2-420752961", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ef553fbdfa6a49f5bb2bdde29020e6ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcee60b9-29", "ovs_interfaceid": "bcee60b9-29f1-49cd-b769-d3dbf7b0f11d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:55:52 user nova-compute[74669]: DEBUG nova.compute.manager [req-bd39667f-cf6d-4192-b18e-ddcd2a3e44e3 req-0370b5a1-7a75-4722-801a-4f1817f355b9 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Detach interface failed, port_id=6f6856bd-1e1d-406b-8d39-7f3f288d135b, reason: Instance 220b317c-a111-4600-b1e2-2a63e22de78a could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 16:55:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:53 user nova-compute[74669]: DEBUG nova.compute.manager [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Stashing vm_state: active {{(pid=74669) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 08 16:55:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 16:55:53 user nova-compute[74669]: INFO nova.compute.claims [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Claim successful on node user
Nov 08 16:55:53 user nova-compute[74669]: INFO nova.compute.resource_tracker [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Updating resource usage from migration c2bca562-a8f7-4f0c-99ad-9347ae824001
Nov 08 16:55:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:53 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:55:53 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:55:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.543s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:53 user nova-compute[74669]: INFO nova.compute.manager [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Migrating
Nov 08 16:55:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:55:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:55:53 user nova-compute[74669]: INFO nova.compute.rpcapi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 08 16:55:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:55:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:55:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquired lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:55:54 user nova-compute[74669]: DEBUG nova.network.neutron [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:55:54 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:55:54 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Took 3.67 seconds to deallocate network for instance.
Nov 08 16:55:54 user nova-compute[74669]: DEBUG nova.network.neutron [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Updating instance_info_cache with network_info: [{"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:55:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Releasing lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:55:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-a96a0c83-b919-457f-b451-b2bde2b432dc req-5c7acf13-cb46-497d-b8eb-4201c18ae998 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-deleted-e7639563-89fb-44bf-89e2-ca44e79ad44a {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-a96a0c83-b919-457f-b451-b2bde2b432dc req-5c7acf13-cb46-497d-b8eb-4201c18ae998 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-deleted-8a5cb6f9-4637-4473-a64d-651ebf09be49 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-a96a0c83-b919-457f-b451-b2bde2b432dc req-5c7acf13-cb46-497d-b8eb-4201c18ae998 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-deleted-bcee60b9-29f1-49cd-b769-d3dbf7b0f11d {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-a96a0c83-b919-457f-b451-b2bde2b432dc req-5c7acf13-cb46-497d-b8eb-4201c18ae998 service nova] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Received event network-vif-deleted-4514f25c-5ce0-4ba0-95cd-55298ce3e832 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Starting migrate_disk_and_power_off {{(pid=74669) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG nova.compute.manager [req-bb4af0fb-612e-4464-abed-348a86dc81a7 req-a5a709d2-302c-4825-ad10-7554714868ea service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received event network-vif-unplugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-bb4af0fb-612e-4464-abed-348a86dc81a7 req-a5a709d2-302c-4825-ad10-7554714868ea service nova] Acquiring lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-bb4af0fb-612e-4464-abed-348a86dc81a7 req-a5a709d2-302c-4825-ad10-7554714868ea service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-bb4af0fb-612e-4464-abed-348a86dc81a7 req-a5a709d2-302c-4825-ad10-7554714868ea service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG nova.compute.manager [req-bb4af0fb-612e-4464-abed-348a86dc81a7 req-a5a709d2-302c-4825-ad10-7554714868ea service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] No waiting events found dispatching network-vif-unplugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:55 user nova-compute[74669]: WARNING nova.compute.manager [req-bb4af0fb-612e-4464-abed-348a86dc81a7 req-a5a709d2-302c-4825-ad10-7554714868ea service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received unexpected event network-vif-unplugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 for instance with vm_state active and task_state resize_migrating.
Nov 08 16:55:55 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Instance destroyed successfully.
Nov 08 16:55:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-82074997',display_name='tempest-ServerActionsTestOtherB-server-82074997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-82074997',id=5,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVVAiZ/J+loI4/5CGCEcHyBdao/VDdeBeozCcJvl0eh7qycgoJCVfo066fltlkQiowyw4815L1dFrqeYMGOPhwhd9fpfcyVQWgEILP3lJeo6lsJtZZ3WMWpczoYeL0t+w==',key_name='tempest-keypair-1692388907',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:51:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9bc128b2ae524ce0aff2afb7301888bf',ramdisk_id='',reservation_id='r-fjmhrntp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-839528249',owner_user_name='tempest-ServerActionsTestOtherB-839528249-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:55:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acb95477d6ba46d4be3b34280c5892e5',uuid=b26dbeeb-b629-414d-bcca-cdde6c207789,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1823624814-network", "vif_mac": "fa:16:3e:33:33:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Converting VIF {"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1823624814-network", "vif_mac": "fa:16:3e:33:33:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:33:ae,bridge_name='br-int',has_traffic_filtering=True,id=47c9314f-4ea9-49c3-9b34-2fb94cc1eac4,network=Network(35a879d8-439e-4ac4-a8ae-292e3b9a1966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9314f-4e') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG os_vif [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:33:ae,bridge_name='br-int',has_traffic_filtering=True,id=47c9314f-4ea9-49c3-9b34-2fb94cc1eac4,network=Network(35a879d8-439e-4ac4-a8ae-292e3b9a1966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9314f-4e') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47c9314f-4e, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc67e742-5269-4865-8f4e-ef4ed89bdc1f) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:55:55 user nova-compute[74669]: INFO os_vif [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:33:ae,bridge_name='br-int',has_traffic_filtering=True,id=47c9314f-4ea9-49c3-9b34-2fb94cc1eac4,network=Network(35a879d8-439e-4ac4-a8ae-292e3b9a1966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9314f-4e')
Nov 08 16:55:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygTldqYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:55:55 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:55:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.040s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4920d258-34c4-4c04-91fc-77c32dbd07c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 16:55:55 user nova-compute[74669]: No targets found.
Nov 08 16:55:55 user nova-compute[74669]: iSNS:
Nov 08 16:55:55 user nova-compute[74669]: No targets found.
Nov 08 16:55:55 user nova-compute[74669]: STATIC:
Nov 08 16:55:55 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263
Nov 08 16:55:55 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:55:55 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:55:55 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6
Nov 08 16:55:55 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:55:55 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:55:55 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630
Nov 08 16:55:55 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:55:55 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:55:55 user nova-compute[74669]: FIRMWARE:
Nov 08 16:55:55 user nova-compute[74669]: No targets found.
Nov 08 16:55:55 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 16:55:55 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 16:55:55 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 16:55:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d381234-1a17-4bb5-a963-cc68c2ba1e28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b28c591-6ef0-490a-8d1e-e3645d93282f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:55:56 user nova-compute[74669]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:55:56 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:55:56 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:55:56 user nova-compute[74669]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:55:56 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:55:56 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9a8381510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263'): ({'sdd'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Removing single pathed devices sdd {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b53ab1-6d96-4d17-8099-033abc4354ed]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1cda18-ee83-4e63-b084-d4c4a1ddd125]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Flushing IO for device /dev/sdd {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ac51e1-9d22-4141-8f8f-ab87bf46f30c]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2785297-4f66-4718-8f5f-dd531555af24]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] SCSI volumes sdd have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4feaf1e-c1b0-403c-af9f-163b93280289]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[17050f27-ebff-4bfc-ab22-7d93d8108ccf]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260]
Nov 08 16:55:56 user nova-compute[74669]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260] successful.
Nov 08 16:55:56 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[61275af6-dc1c-4ce6-9eef-700c666c3929]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] <== disconnect_volume: return (374ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 16:55:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789_resize/disk /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] CMD "cp -r /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789_resize/disk /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk" returned: 0 in 0.380s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789_resize/disk.info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk.info {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:55:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] CMD "cp -r /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789_resize/disk.info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk.info" returned: 0 in 0.034s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:55:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-68b170ad-2493-483c-9436-13542a0a1087 req-04cac0da-596f-40c4-b8f6-f1dd2c479813 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received event network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:55:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-68b170ad-2493-483c-9436-13542a0a1087 req-04cac0da-596f-40c4-b8f6-f1dd2c479813 service nova] Acquiring lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-68b170ad-2493-483c-9436-13542a0a1087 req-04cac0da-596f-40c4-b8f6-f1dd2c479813 service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-68b170ad-2493-483c-9436-13542a0a1087 req-04cac0da-596f-40c4-b8f6-f1dd2c479813 service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-68b170ad-2493-483c-9436-13542a0a1087 req-04cac0da-596f-40c4-b8f6-f1dd2c479813 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] No waiting events found dispatching network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:55:57 user nova-compute[74669]: WARNING nova.compute.manager [req-68b170ad-2493-483c-9436-13542a0a1087 req-04cac0da-596f-40c4-b8f6-f1dd2c479813 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received unexpected event network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 for instance with vm_state active and task_state resize_migrating.
Nov 08 16:55:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "0829b734-daec-4dc6-b24b-cbe89000160c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "0829b734-daec-4dc6-b24b-cbe89000160c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:58 user nova-compute[74669]: INFO nova.compute.manager [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Rebooting instance
Nov 08 16:55:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "refresh_cache-0829b734-daec-4dc6-b24b-cbe89000160c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:55:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquired lock "refresh_cache-0829b734-daec-4dc6-b24b-cbe89000160c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:55:58 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:55:58 user nova-compute[74669]: INFO nova.compute.manager [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] [instance: 220b317c-a111-4600-b1e2-2a63e22de78a] Took 4.48 seconds to detach 3 volumes for instance.
Nov 08 16:55:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:55:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:55:59 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:55:59 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:55:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:59 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Deleted allocations for instance 220b317c-a111-4600-b1e2-2a63e22de78a
Nov 08 16:55:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1923ef12-dc75-4e46-9fc9-0a51001dc670 tempest-TaggedBootDevicesTest_v242-70363984 tempest-TaggedBootDevicesTest_v242-70363984-project-member] Lock "220b317c-a111-4600-b1e2-2a63e22de78a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.131s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:55:59 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Updating instance_info_cache with network_info: [{"id": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "address": "fa:16:3e:36:41:2f", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29f8cc-17", "ovs_interfaceid": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:55:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Releasing lock "refresh_cache-0829b734-daec-4dc6-b24b-cbe89000160c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:55:59 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:55:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:55:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.compute.manager [req-62fdb169-b5ac-40c1-8f44-7173509982b1 req-55764149-fd72-4fa5-a724-0e72cecc3997 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received event network-vif-unplugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-62fdb169-b5ac-40c1-8f44-7173509982b1 req-55764149-fd72-4fa5-a724-0e72cecc3997 service nova] Acquiring lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-62fdb169-b5ac-40c1-8f44-7173509982b1 req-55764149-fd72-4fa5-a724-0e72cecc3997 service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-62fdb169-b5ac-40c1-8f44-7173509982b1 req-55764149-fd72-4fa5-a724-0e72cecc3997 service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.compute.manager [req-62fdb169-b5ac-40c1-8f44-7173509982b1 req-55764149-fd72-4fa5-a724-0e72cecc3997 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] No waiting events found dispatching network-vif-unplugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:56:00 user nova-compute[74669]: WARNING nova.compute.manager [req-62fdb169-b5ac-40c1-8f44-7173509982b1 req-55764149-fd72-4fa5-a724-0e72cecc3997 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received unexpected event network-vif-unplugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 for instance with vm_state active and task_state reboot_started_hard.
Nov 08 16:56:00 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Instance destroyed successfully.
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.objects.instance [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lazy-loading 'resources' on Instance uuid 0829b734-daec-4dc6-b24b-cbe89000160c {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2095546845',display_name='tempest-TestMinimumBasicScenario-server-2095546845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2095546845',id=10,image_ref='3366e51a-0116-435e-986c-98029c349c7c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDCQBYjn/Hods1dA/c0oPfDp3cwT4dyVCGcb0ID5M60Gd7dyV3FAvOuBsZNEfm3X2qGrL/Vod9cs6+bU5t30ezJJY5GG8nc+IhfueGtZ6S/Q4AyYX+J0/Eq1unC6wT6mw==',key_name='tempest-TestMinimumBasicScenario-1047548378',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:53:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39bcebfdde5c48dc8857824275b0082e',ramdisk_id='',reservation_id='r-qvrwnzz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3366e51a-0116-435e-986c-98029c349c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1167063302',owner_user_name='tempest-TestMinimumBasicScenario-1167063302-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:56:00Z,user_data=None,user_id='d6fd033f262943cdabb12db63b11eca8',uuid=0829b734-daec-4dc6-b24b-cbe89000160c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "address": "fa:16:3e:36:41:2f", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29f8cc-17", "ovs_interfaceid": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Converting VIF {"id": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "address": "fa:16:3e:36:41:2f", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29f8cc-17", "ovs_interfaceid": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:41:2f,bridge_name='br-int',has_traffic_filtering=True,id=bf29f8cc-1793-457b-a4a6-8158d048eac9,network=Network(c618e3db-19f3-4b21-aa37-98985a7bf610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf29f8cc-17') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_vif [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:41:2f,bridge_name='br-int',has_traffic_filtering=True,id=bf29f8cc-1793-457b-a4a6-8158d048eac9,network=Network(c618e3db-19f3-4b21-aa37-98985a7bf610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf29f8cc-17') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf29f8cc-17, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67ac924d-e69b-463a-af44-3db8799054eb) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:56:00 user nova-compute[74669]: INFO os_vif [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:41:2f,bridge_name='br-int',has_traffic_filtering=True,id=bf29f8cc-1793-457b-a4a6-8158d048eac9,network=Network(c618e3db-19f3-4b21-aa37-98985a7bf610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf29f8cc-17')
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQHpYXey', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:56:00 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff0c59e-b3c0-4993-9644-a33725b9633a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 16:56:00 user nova-compute[74669]: No targets found.
Nov 08 16:56:00 user nova-compute[74669]: iSNS:
Nov 08 16:56:00 user nova-compute[74669]: No targets found.
Nov 08 16:56:00 user nova-compute[74669]: STATIC:
Nov 08 16:56:00 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6
Nov 08 16:56:00 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:56:00 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:56:00 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630
Nov 08 16:56:00 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:56:00 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:56:00 user nova-compute[74669]: FIRMWARE:
Nov 08 16:56:00 user nova-compute[74669]: No targets found.
Nov 08 16:56:00 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 16:56:00 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 16:56:00 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4bd0e3-7ee5-483c-8151-6f972803ef81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[473cfbd9-d357-43fe-a221-160747c8836e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:56:00 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:56:00 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:56:00 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:56:00 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9a83803a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630'): ({'sdc'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Removing single pathed devices sdc {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b085f2-db8f-42ce-a1d3-049254e04a62]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa10235-1338-43ab-b146-8a0213cce9ec]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Flushing IO for device /dev/sdc {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ff232c-0120-4cdd-a719-278935a06838]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02c461a-b347-4bbe-8fd0-c600d1bfe571]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[59700501-f871-42bb-8856-94dc89e57e09]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f20d56e-26d8-4105-b067-24c8486ef869]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630, portal: 172.16.0.220,3260]
Nov 08 16:56:00 user nova-compute[74669]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630, portal: 172.16.0.220,3260] successful.
Nov 08 16:56:00 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01e9c12-26fb-418a-99ec-c81ad8af62c1]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] <== disconnect_volume: return (298ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Start _get_guest_xml network_info=[{"id": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "address": "fa:16:3e:36:41:2f", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29f8cc-17", "ovs_interfaceid": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3366e51a-0116-435e-986c-98029c349c7c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '3366e51a-0116-435e-986c-98029c349c7c'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'ecd3222a-a22a-483f-81d1-cf4f86e824eb', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQHpYXey', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '0829b734-daec-4dc6-b24b-cbe89000160c', 'attached_at': '', 'detached_at': '', 'volume_id': '081598cb-5af2-45bf-b15f-cfc2ff95f630', 'serial': '081598cb-5af2-45bf-b15f-cfc2ff95f630'}, 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:56:00 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:56:00 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=3366e51a-0116-435e-986c-98029c349c7c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.objects.instance [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0829b734-daec-4dc6-b24b-cbe89000160c {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.objects.base [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Object Instance<0829b734-daec-4dc6-b24b-cbe89000160c> lazy-loaded attributes: resources,vcpu_model {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQHpYXey', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:56:00 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:56:00 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:56:00 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e2e36f-7210-486f-b01e-7c2cef2170ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 16:56:00 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85de2a2-0ef7-4d4c-9156-39693c6da3db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630] added
Nov 08 16:56:00 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65f4bd4-7571-4149-8f2f-9c0c6a6bcf79]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b029b22f-14c5-4761-8702-4b8c13297622]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rQHpYXey {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rQHpYXey" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[69328d8f-8719-4149-bb74-e9d4217f3e27]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:00 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rQHpYXey'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9256aaa-a039-48b8-bbad-61adcf3888d3]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c873ec-e2c4-46ec-b000-70a4aec7c1e8]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:56:01 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:56:01 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cff0b6a-1fb4-4aa9-baf7-2d0face51660]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630, portal: 172.16.0.220,3260]
Nov 08 16:56:01 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630, portal: 172.16.0.220,3260] successful.
Nov 08 16:56:01 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffbd6c6-46dc-40bc-ad44-79648c7a5c6a]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[54669667-5eef-4a83-85c5-c8ea44c71fc9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:56:01 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:56:01 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:56:01 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:56:01 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[82646525-54f4-454a-8ceb-a9b5dcf8fc09]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:01 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: None {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG nova.compute.manager [req-6f397443-9aef-415f-ac1a-ab29e9f33898 req-58537036-48be-4eda-a278-fe03af369f9b service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received event network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6f397443-9aef-415f-ac1a-ab29e9f33898 req-58537036-48be-4eda-a278-fe03af369f9b service nova] Acquiring lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6f397443-9aef-415f-ac1a-ab29e9f33898 req-58537036-48be-4eda-a278-fe03af369f9b service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6f397443-9aef-415f-ac1a-ab29e9f33898 req-58537036-48be-4eda-a278-fe03af369f9b service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG nova.compute.manager [req-6f397443-9aef-415f-ac1a-ab29e9f33898 req-58537036-48be-4eda-a278-fe03af369f9b service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] No waiting events found dispatching network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:56:02 user nova-compute[74669]: WARNING nova.compute.manager [req-6f397443-9aef-415f-ac1a-ab29e9f33898 req-58537036-48be-4eda-a278-fe03af369f9b service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received unexpected event network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 for instance with vm_state active and task_state reboot_started_hard.
Nov 08 16:56:02 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQHpYXey', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23134373761386133', 'path': '/dev/sdc'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134373761386133', 'path': '/dev/sdc'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2095546845',display_name='tempest-TestMinimumBasicScenario-server-2095546845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2095546845',id=10,image_ref='3366e51a-0116-435e-986c-98029c349c7c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDCQBYjn/Hods1dA/c0oPfDp3cwT4dyVCGcb0ID5M60Gd7dyV3FAvOuBsZNEfm3X2qGrL/Vod9cs6+bU5t30ezJJY5GG8nc+IhfueGtZ6S/Q4AyYX+J0/Eq1unC6wT6mw==',key_name='tempest-TestMinimumBasicScenario-1047548378',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:53:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39bcebfdde5c48dc8857824275b0082e',ramdisk_id='',reservation_id='r-qvrwnzz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3366e51a-0116-435e-986c-98029c349c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1167063302',owner_user_name='tempest-TestMinimumBasicScenario-1167063302-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:56:00Z,user_data=None,user_id='d6fd033f262943cdabb12db63b11eca8',uuid=0829b734-daec-4dc6-b24b-cbe89000160c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "address": "fa:16:3e:36:41:2f", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29f8cc-17", "ovs_interfaceid": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Converting VIF {"id": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "address": "fa:16:3e:36:41:2f", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29f8cc-17", "ovs_interfaceid": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:41:2f,bridge_name='br-int',has_traffic_filtering=True,id=bf29f8cc-1793-457b-a4a6-8158d048eac9,network=Network(c618e3db-19f3-4b21-aa37-98985a7bf610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf29f8cc-17') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG nova.objects.instance [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lazy-loading 'pci_devices' on Instance uuid 0829b734-daec-4dc6-b24b-cbe89000160c {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG nova.objects.base [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Object Instance<0829b734-daec-4dc6-b24b-cbe89000160c> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:56:02 user nova-compute[74669]:   <uuid>0829b734-daec-4dc6-b24b-cbe89000160c</uuid>
Nov 08 16:56:02 user nova-compute[74669]:   <name>instance-0000000a</name>
Nov 08 16:56:02 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:56:02 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:56:02 user nova-compute[74669]:   <metadata>
Nov 08 16:56:02 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:56:02 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:56:02 user nova-compute[74669]:       <nova:name>tempest-TestMinimumBasicScenario-server-2095546845</nova:name>
Nov 08 16:56:02 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:56:00</nova:creationTime>
Nov 08 16:56:02 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:56:02 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:56:02 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:56:02 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:56:02 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:56:02 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:56:02 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:56:02 user nova-compute[74669]:       <nova:owner>
Nov 08 16:56:02 user nova-compute[74669]:         <nova:user uuid="d6fd033f262943cdabb12db63b11eca8">tempest-TestMinimumBasicScenario-1167063302-project-member</nova:user>
Nov 08 16:56:02 user nova-compute[74669]:         <nova:project uuid="39bcebfdde5c48dc8857824275b0082e">tempest-TestMinimumBasicScenario-1167063302</nova:project>
Nov 08 16:56:02 user nova-compute[74669]:       </nova:owner>
Nov 08 16:56:02 user nova-compute[74669]:       <nova:root type="image" uuid="3366e51a-0116-435e-986c-98029c349c7c"/>
Nov 08 16:56:02 user nova-compute[74669]:       <nova:ports>
Nov 08 16:56:02 user nova-compute[74669]:         <nova:port uuid="bf29f8cc-1793-457b-a4a6-8158d048eac9">
Nov 08 16:56:02 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 16:56:02 user nova-compute[74669]:         </nova:port>
Nov 08 16:56:02 user nova-compute[74669]:       </nova:ports>
Nov 08 16:56:02 user nova-compute[74669]:     </nova:instance>
Nov 08 16:56:02 user nova-compute[74669]:   </metadata>
Nov 08 16:56:02 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:56:02 user nova-compute[74669]:     <system>
Nov 08 16:56:02 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:56:02 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:56:02 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:56:02 user nova-compute[74669]:       <entry name="serial">0829b734-daec-4dc6-b24b-cbe89000160c</entry>
Nov 08 16:56:02 user nova-compute[74669]:       <entry name="uuid">0829b734-daec-4dc6-b24b-cbe89000160c</entry>
Nov 08 16:56:02 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:56:02 user nova-compute[74669]:     </system>
Nov 08 16:56:02 user nova-compute[74669]:   </sysinfo>
Nov 08 16:56:02 user nova-compute[74669]:   <os>
Nov 08 16:56:02 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:56:02 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 16:56:02 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:56:02 user nova-compute[74669]:   </os>
Nov 08 16:56:02 user nova-compute[74669]:   <features>
Nov 08 16:56:02 user nova-compute[74669]:     <acpi/>
Nov 08 16:56:02 user nova-compute[74669]:     <apic/>
Nov 08 16:56:02 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:56:02 user nova-compute[74669]:   </features>
Nov 08 16:56:02 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:56:02 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:56:02 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:56:02 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:56:02 user nova-compute[74669]:   </clock>
Nov 08 16:56:02 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:56:02 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:56:02 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:56:02 user nova-compute[74669]:   </cpu>
Nov 08 16:56:02 user nova-compute[74669]:   <devices>
Nov 08 16:56:02 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:56:02 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:56:02 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk"/>
Nov 08 16:56:02 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:56:02 user nova-compute[74669]:     </disk>
Nov 08 16:56:02 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 16:56:02 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:56:02 user nova-compute[74669]:       <source dev="/dev/sdc"/>
Nov 08 16:56:02 user nova-compute[74669]:       <target dev="vdb" bus="virtio"/>
Nov 08 16:56:02 user nova-compute[74669]:       <serial>081598cb-5af2-45bf-b15f-cfc2ff95f630</serial>
Nov 08 16:56:02 user nova-compute[74669]:     </disk>
Nov 08 16:56:02 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:56:02 user nova-compute[74669]:       <mac address="fa:16:3e:36:41:2f"/>
Nov 08 16:56:02 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:56:02 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:56:02 user nova-compute[74669]:       <target dev="tapbf29f8cc-17"/>
Nov 08 16:56:02 user nova-compute[74669]:     </interface>
Nov 08 16:56:02 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:56:02 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/console.log" append="off"/>
Nov 08 16:56:02 user nova-compute[74669]:     </serial>
Nov 08 16:56:02 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:56:02 user nova-compute[74669]:     <video>
Nov 08 16:56:02 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:56:02 user nova-compute[74669]:     </video>
Nov 08 16:56:02 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:56:02 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:56:02 user nova-compute[74669]:     </rng>
Nov 08 16:56:02 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:56:02 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:56:02 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:56:02 user nova-compute[74669]:     </memballoon>
Nov 08 16:56:02 user nova-compute[74669]:   </devices>
Nov 08 16:56:02 user nova-compute[74669]: </domain>
Nov 08 16:56:02 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG nova.objects.instance [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0829b734-daec-4dc6-b24b-cbe89000160c {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG nova.objects.base [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Object Instance<0829b734-daec-4dc6-b24b-cbe89000160c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77f42b4b9d8a55c61f5c6daafa24b193b585b71c --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77f42b4b9d8a55c61f5c6daafa24b193b585b71c --force-share --output=json" returned: 0 in 0.181s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 16:56:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:03 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Cannot resize image /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 16:56:03 user nova-compute[74669]: DEBUG nova.objects.instance [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lazy-loading 'migration_context' on Instance uuid 0829b734-daec-4dc6-b24b-cbe89000160c {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:56:03 user nova-compute[74669]: DEBUG nova.objects.base [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Object Instance<0829b734-daec-4dc6-b24b-cbe89000160c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:56:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2095546845',display_name='tempest-TestMinimumBasicScenario-server-2095546845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2095546845',id=10,image_ref='3366e51a-0116-435e-986c-98029c349c7c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDCQBYjn/Hods1dA/c0oPfDp3cwT4dyVCGcb0ID5M60Gd7dyV3FAvOuBsZNEfm3X2qGrL/Vod9cs6+bU5t30ezJJY5GG8nc+IhfueGtZ6S/Q4AyYX+J0/Eq1unC6wT6mw==',key_name='tempest-TestMinimumBasicScenario-1047548378',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:53:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='39bcebfdde5c48dc8857824275b0082e',ramdisk_id='',reservation_id='r-qvrwnzz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3366e51a-0116-435e-986c-98029c349c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1167063302',owner_user_name='tempest-TestMinimumBasicScenario-1167063302-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:56:00Z,user_data=None,user_id='d6fd033f262943cdabb12db63b11eca8',uuid=0829b734-daec-4dc6-b24b-cbe89000160c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "address": "fa:16:3e:36:41:2f", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29f8cc-17", "ovs_interfaceid": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:56:03 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Converting VIF {"id": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "address": "fa:16:3e:36:41:2f", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29f8cc-17", "ovs_interfaceid": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:56:03 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:41:2f,bridge_name='br-int',has_traffic_filtering=True,id=bf29f8cc-1793-457b-a4a6-8158d048eac9,network=Network(c618e3db-19f3-4b21-aa37-98985a7bf610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf29f8cc-17') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:56:03 user nova-compute[74669]: DEBUG os_vif [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:41:2f,bridge_name='br-int',has_traffic_filtering=True,id=bf29f8cc-1793-457b-a4a6-8158d048eac9,network=Network(c618e3db-19f3-4b21-aa37-98985a7bf610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf29f8cc-17') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:56:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:56:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:56:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0fe86aec-a97c-5504-92e1-7e08a9959425', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:56:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:56:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf29f8cc-17, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:56:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf29f8cc-17, col_values=(('qos', UUID('229d5b94-d4df-458c-b0fa-b99a51d0589b')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:56:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf29f8cc-17, col_values=(('external_ids', {'iface-id': 'bf29f8cc-1793-457b-a4a6-8158d048eac9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:41:2f', 'vm-uuid': '0829b734-daec-4dc6-b24b-cbe89000160c'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:56:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:56:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:03 user nova-compute[74669]: INFO os_vif [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:41:2f,bridge_name='br-int',has_traffic_filtering=True,id=bf29f8cc-1793-457b-a4a6-8158d048eac9,network=Network(c618e3db-19f3-4b21-aa37-98985a7bf610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf29f8cc-17')
Nov 08 16:56:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:04 user nova-compute[74669]: DEBUG nova.compute.manager [req-e24bba0e-f27c-4462-bc34-078c2c807a63 req-93292aaf-f928-4648-b3aa-8b6464b5a020 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received event network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:56:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e24bba0e-f27c-4462-bc34-078c2c807a63 req-93292aaf-f928-4648-b3aa-8b6464b5a020 service nova] Acquiring lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:56:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e24bba0e-f27c-4462-bc34-078c2c807a63 req-93292aaf-f928-4648-b3aa-8b6464b5a020 service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:56:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e24bba0e-f27c-4462-bc34-078c2c807a63 req-93292aaf-f928-4648-b3aa-8b6464b5a020 service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:56:04 user nova-compute[74669]: DEBUG nova.compute.manager [req-e24bba0e-f27c-4462-bc34-078c2c807a63 req-93292aaf-f928-4648-b3aa-8b6464b5a020 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] No waiting events found dispatching network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:56:04 user nova-compute[74669]: WARNING nova.compute.manager [req-e24bba0e-f27c-4462-bc34-078c2c807a63 req-93292aaf-f928-4648-b3aa-8b6464b5a020 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received unexpected event network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 for instance with vm_state active and task_state reboot_started_hard.
Nov 08 16:56:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 16:56:06 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Instance rebooted successfully.
Nov 08 16:56:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:56:06 user nova-compute[74669]: DEBUG nova.compute.manager [req-da3c5589-e2bb-4b5a-be36-a4be7ccf33ba req-3f6e67f1-0d5c-4056-a365-5bdd20927ff4 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received event network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:56:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-da3c5589-e2bb-4b5a-be36-a4be7ccf33ba req-3f6e67f1-0d5c-4056-a365-5bdd20927ff4 service nova] Acquiring lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:56:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-da3c5589-e2bb-4b5a-be36-a4be7ccf33ba req-3f6e67f1-0d5c-4056-a365-5bdd20927ff4 service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:56:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-da3c5589-e2bb-4b5a-be36-a4be7ccf33ba req-3f6e67f1-0d5c-4056-a365-5bdd20927ff4 service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:56:06 user nova-compute[74669]: DEBUG nova.compute.manager [req-da3c5589-e2bb-4b5a-be36-a4be7ccf33ba req-3f6e67f1-0d5c-4056-a365-5bdd20927ff4 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] No waiting events found dispatching network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:56:06 user nova-compute[74669]: WARNING nova.compute.manager [req-da3c5589-e2bb-4b5a-be36-a4be7ccf33ba req-3f6e67f1-0d5c-4056-a365-5bdd20927ff4 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received unexpected event network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 for instance with vm_state active and task_state reboot_started_hard.
Nov 08 16:56:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a2dbc813-0604-4750-aa80-5693f09ba689 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "0829b734-daec-4dc6-b24b-cbe89000160c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.101s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:56:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:10 user nova-compute[74669]: DEBUG nova.network.neutron [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Port 47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 binding to destination host user is already ACTIVE {{(pid=74669) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 16:56:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:56:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:56:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:56:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:56:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquired lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:56:10 user nova-compute[74669]: DEBUG nova.network.neutron [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:56:11 user nova-compute[74669]: DEBUG nova.network.neutron [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Updating instance_info_cache with network_info: [{"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:56:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Releasing lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:56:11 user nova-compute[74669]: DEBUG os_brick.utils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:56:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3165834-a5f9-4b77-947e-afb5d8e8fa23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b116def9-1010-455b-aff6-320189510e1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b9819b-0f10-4f73-90b2-b8fd211267cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6e7524-c132-4026-8348-05536edc780c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:56:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 16:56:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:56:11 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 16:56:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[568fe143-b7f3-4acb-92ff-5feb70d63c63]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 16:56:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 16:56:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 16:56:11 user nova-compute[74669]: DEBUG os_brick.utils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:56:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:31 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:39 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:56:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 16:56:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] There are 0 instances to clean {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 16:56:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Acquiring lock "1b9ad090-c7bb-4a11-a056-19902844dbf0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:56:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "1b9ad090-c7bb-4a11-a056-19902844dbf0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:56:41 user nova-compute[74669]: DEBUG nova.compute.manager [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 16:56:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:56:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:56:41 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 16:56:41 user nova-compute[74669]: INFO nova.compute.claims [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Claim successful on node user
Nov 08 16:56:41 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:56:41 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:56:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:56:41 user nova-compute[74669]: DEBUG nova.compute.manager [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 16:56:41 user nova-compute[74669]: DEBUG nova.compute.manager [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 16:56:41 user nova-compute[74669]: DEBUG nova.network.neutron [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 16:56:41 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 08 16:56:41 user nova-compute[74669]: DEBUG nova.compute.manager [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 16:56:42 user nova-compute[74669]: DEBUG nova.compute.manager [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 16:56:42 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 16:56:42 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Creating image(s)
Nov 08 16:56:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:56:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "/opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:56:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "/opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:56:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Acquiring lock "571637caf9d73ed6f84bf3b2d80cf4f3d9549016" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:56:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "571637caf9d73ed6f84bf3b2d80cf4f3d9549016" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:56:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/571637caf9d73ed6f84bf3b2d80cf4f3d9549016.part --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:42 user nova-compute[74669]: DEBUG nova.policy [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd4e7c5cf7424df0a0b8f684284eae8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba6ed05fa648a6ab7618d83d11a4a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 16:56:42 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:56:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/571637caf9d73ed6f84bf3b2d80cf4f3d9549016.part --force-share --output=json" returned: 0 in 0.241s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:42 user nova-compute[74669]: DEBUG nova.virt.images [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] d713d2a4-1cef-4336-9ea3-593965526391 was qcow2, converting to raw {{(pid=74669) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 16:56:42 user nova-compute[74669]: DEBUG nova.privsep.utils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74669) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 16:56:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/571637caf9d73ed6f84bf3b2d80cf4f3d9549016.part /opt/stack/data/nova/instances/_base/571637caf9d73ed6f84bf3b2d80cf4f3d9549016.converted {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:56:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.006s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:56:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:56:42 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/571637caf9d73ed6f84bf3b2d80cf4f3d9549016.part /opt/stack/data/nova/instances/_base/571637caf9d73ed6f84bf3b2d80cf4f3d9549016.converted" returned: 0 in 0.426s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/571637caf9d73ed6f84bf3b2d80cf4f3d9549016.converted --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/571637caf9d73ed6f84bf3b2d80cf4f3d9549016.converted --force-share --output=json" returned: 0 in 0.257s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "571637caf9d73ed6f84bf3b2d80cf4f3d9549016" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.436s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/571637caf9d73ed6f84bf3b2d80cf4f3d9549016 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG nova.network.neutron [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Successfully created port: 9094cae8-f197-47d4-8ba3-8a1e274c3f04 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/571637caf9d73ed6f84bf3b2d80cf4f3d9549016 --force-share --output=json" returned: 0 in 0.241s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Acquiring lock "571637caf9d73ed6f84bf3b2d80cf4f3d9549016" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "571637caf9d73ed6f84bf3b2d80cf4f3d9549016" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/571637caf9d73ed6f84bf3b2d80cf4f3d9549016 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/571637caf9d73ed6f84bf3b2d80cf4f3d9549016 --force-share --output=json" returned: 0 in 0.183s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/571637caf9d73ed6f84bf3b2d80cf4f3d9549016,backing_fmt=raw /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/571637caf9d73ed6f84bf3b2d80cf4f3d9549016,backing_fmt=raw /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk 1073741824" returned: 0 in 0.065s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "571637caf9d73ed6f84bf3b2d80cf4f3d9549016" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:56:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/571637caf9d73ed6f84bf3b2d80cf4f3d9549016 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/571637caf9d73ed6f84bf3b2d80cf4f3d9549016 --force-share --output=json" returned: 0 in 0.219s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG nova.network.neutron [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Successfully updated port: 9094cae8-f197-47d4-8ba3-8a1e274c3f04 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Acquiring lock "refresh_cache-1b9ad090-c7bb-4a11-a056-19902844dbf0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Acquired lock "refresh_cache-1b9ad090-c7bb-4a11-a056-19902844dbf0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG nova.network.neutron [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Cannot resize image /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Ensure instance console log exists: /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG nova.network.neutron [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-a3c133d1-76ad-411e-aa31-cdab318af6a6 req-765ad89d-69e9-4cfb-9d31-010c3c5cdb35 service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Received event network-changed-9094cae8-f197-47d4-8ba3-8a1e274c3f04 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-a3c133d1-76ad-411e-aa31-cdab318af6a6 req-765ad89d-69e9-4cfb-9d31-010c3c5cdb35 service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Refreshing instance network info cache due to event network-changed-9094cae8-f197-47d4-8ba3-8a1e274c3f04. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a3c133d1-76ad-411e-aa31-cdab318af6a6 req-765ad89d-69e9-4cfb-9d31-010c3c5cdb35 service nova] Acquiring lock "refresh_cache-1b9ad090-c7bb-4a11-a056-19902844dbf0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG nova.network.neutron [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Updating instance_info_cache with network_info: [{"id": "9094cae8-f197-47d4-8ba3-8a1e274c3f04", "address": "fa:16:3e:a1:4d:7a", "network": {"id": "3e057921-3f7f-4344-bd63-e80de5bbe2be", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1558760908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ba6ed05fa648a6ab7618d83d11a4a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9094cae8-f1", "ovs_interfaceid": "9094cae8-f197-47d4-8ba3-8a1e274c3f04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Releasing lock "refresh_cache-1b9ad090-c7bb-4a11-a056-19902844dbf0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG nova.compute.manager [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Instance network_info: |[{"id": "9094cae8-f197-47d4-8ba3-8a1e274c3f04", "address": "fa:16:3e:a1:4d:7a", "network": {"id": "3e057921-3f7f-4344-bd63-e80de5bbe2be", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1558760908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ba6ed05fa648a6ab7618d83d11a4a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9094cae8-f1", "ovs_interfaceid": "9094cae8-f197-47d4-8ba3-8a1e274c3f04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a3c133d1-76ad-411e-aa31-cdab318af6a6 req-765ad89d-69e9-4cfb-9d31-010c3c5cdb35 service nova] Acquired lock "refresh_cache-1b9ad090-c7bb-4a11-a056-19902844dbf0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG nova.network.neutron [req-a3c133d1-76ad-411e-aa31-cdab318af6a6 req-765ad89d-69e9-4cfb-9d31-010c3c5cdb35 service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Refreshing network info cache for port 9094cae8-f197-47d4-8ba3-8a1e274c3f04 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Start _get_guest_xml network_info=[{"id": "9094cae8-f197-47d4-8ba3-8a1e274c3f04", "address": "fa:16:3e:a1:4d:7a", "network": {"id": "3e057921-3f7f-4344-bd63-e80de5bbe2be", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1558760908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ba6ed05fa648a6ab7618d83d11a4a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9094cae8-f1", "ovs_interfaceid": "9094cae8-f197-47d4-8ba3-8a1e274c3f04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:56:35Z,direct_url=<?>,disk_format='qcow2',id=d713d2a4-1cef-4336-9ea3-593965526391,min_disk=0,min_ram=0,name='',owner='8de6740886de4b6ab4cd35cc34e232c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/sda', 'image_id': 'd713d2a4-1cef-4336-9ea3-593965526391'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:56:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:44 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:56:44 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:56:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:56:35Z,direct_url=<?>,disk_format='qcow2',id=d713d2a4-1cef-4336-9ea3-593965526391,min_disk=0,min_ram=0,name='',owner='8de6740886de4b6ab4cd35cc34e232c2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:56:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-571001023',display_name='tempest-AttachSCSIVolumeTestJSON-server-571001023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-571001023',id=13,image_ref='d713d2a4-1cef-4336-9ea3-593965526391',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkMDs8xzTKElrywZZWnz+Un1FN54LpSvfh6mK613vOoyk7B/n3R8l4bdaNR0SPEv9kG+kXnfBuDIdEivU/h7d4Z1xPXevLXMGuaXsr3BQsOH68OU1MHNVCNCWwynt0/AA==',key_name='tempest-keypair-1924695154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51ba6ed05fa648a6ab7618d83d11a4a6',ramdisk_id='',reservation_id='r-68w76pon',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d713d2a4-1cef-4336-9ea3-593965526391',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-219670464',owner_user_name='tempest-AttachSCSIVolumeTestJSON-219670464-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:56:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd4e7c5cf7424df0a0b8f684284eae8c',uuid=1b9ad090-c7bb-4a11-a056-19902844dbf0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9094cae8-f197-47d4-8ba3-8a1e274c3f04", "address": "fa:16:3e:a1:4d:7a", "network": {"id": "3e057921-3f7f-4344-bd63-e80de5bbe2be", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1558760908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ba6ed05fa648a6ab7618d83d11a4a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9094cae8-f1", "ovs_interfaceid": "9094cae8-f197-47d4-8ba3-8a1e274c3f04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Converting VIF {"id": "9094cae8-f197-47d4-8ba3-8a1e274c3f04", "address": "fa:16:3e:a1:4d:7a", "network": {"id": "3e057921-3f7f-4344-bd63-e80de5bbe2be", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1558760908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ba6ed05fa648a6ab7618d83d11a4a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9094cae8-f1", "ovs_interfaceid": "9094cae8-f197-47d4-8ba3-8a1e274c3f04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:4d:7a,bridge_name='br-int',has_traffic_filtering=True,id=9094cae8-f197-47d4-8ba3-8a1e274c3f04,network=Network(3e057921-3f7f-4344-bd63-e80de5bbe2be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9094cae8-f1') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.objects.instance [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b9ad090-c7bb-4a11-a056-19902844dbf0 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:56:45 user nova-compute[74669]:   <uuid>1b9ad090-c7bb-4a11-a056-19902844dbf0</uuid>
Nov 08 16:56:45 user nova-compute[74669]:   <name>instance-0000000d</name>
Nov 08 16:56:45 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:56:45 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:56:45 user nova-compute[74669]:   <metadata>
Nov 08 16:56:45 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:56:45 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:56:45 user nova-compute[74669]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-571001023</nova:name>
Nov 08 16:56:45 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:56:44</nova:creationTime>
Nov 08 16:56:45 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:56:45 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:56:45 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:56:45 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:56:45 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:56:45 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:56:45 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:56:45 user nova-compute[74669]:       <nova:owner>
Nov 08 16:56:45 user nova-compute[74669]:         <nova:user uuid="dd4e7c5cf7424df0a0b8f684284eae8c">tempest-AttachSCSIVolumeTestJSON-219670464-project-member</nova:user>
Nov 08 16:56:45 user nova-compute[74669]:         <nova:project uuid="51ba6ed05fa648a6ab7618d83d11a4a6">tempest-AttachSCSIVolumeTestJSON-219670464</nova:project>
Nov 08 16:56:45 user nova-compute[74669]:       </nova:owner>
Nov 08 16:56:45 user nova-compute[74669]:       <nova:root type="image" uuid="d713d2a4-1cef-4336-9ea3-593965526391"/>
Nov 08 16:56:45 user nova-compute[74669]:       <nova:ports>
Nov 08 16:56:45 user nova-compute[74669]:         <nova:port uuid="9094cae8-f197-47d4-8ba3-8a1e274c3f04">
Nov 08 16:56:45 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 16:56:45 user nova-compute[74669]:         </nova:port>
Nov 08 16:56:45 user nova-compute[74669]:       </nova:ports>
Nov 08 16:56:45 user nova-compute[74669]:     </nova:instance>
Nov 08 16:56:45 user nova-compute[74669]:   </metadata>
Nov 08 16:56:45 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:56:45 user nova-compute[74669]:     <system>
Nov 08 16:56:45 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:56:45 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:56:45 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:56:45 user nova-compute[74669]:       <entry name="serial">1b9ad090-c7bb-4a11-a056-19902844dbf0</entry>
Nov 08 16:56:45 user nova-compute[74669]:       <entry name="uuid">1b9ad090-c7bb-4a11-a056-19902844dbf0</entry>
Nov 08 16:56:45 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:56:45 user nova-compute[74669]:     </system>
Nov 08 16:56:45 user nova-compute[74669]:   </sysinfo>
Nov 08 16:56:45 user nova-compute[74669]:   <os>
Nov 08 16:56:45 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:56:45 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 16:56:45 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:56:45 user nova-compute[74669]:   </os>
Nov 08 16:56:45 user nova-compute[74669]:   <features>
Nov 08 16:56:45 user nova-compute[74669]:     <acpi/>
Nov 08 16:56:45 user nova-compute[74669]:     <apic/>
Nov 08 16:56:45 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:56:45 user nova-compute[74669]:   </features>
Nov 08 16:56:45 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:56:45 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:56:45 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:56:45 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:56:45 user nova-compute[74669]:   </clock>
Nov 08 16:56:45 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:56:45 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:56:45 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:56:45 user nova-compute[74669]:   </cpu>
Nov 08 16:56:45 user nova-compute[74669]:   <devices>
Nov 08 16:56:45 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:56:45 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:56:45 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk"/>
Nov 08 16:56:45 user nova-compute[74669]:       <target dev="sda" bus="scsi"/>
Nov 08 16:56:45 user nova-compute[74669]:       <address type="drive" controller="0" unit="0"/>
Nov 08 16:56:45 user nova-compute[74669]:     </disk>
Nov 08 16:56:45 user nova-compute[74669]:     <disk type="file" device="cdrom">
Nov 08 16:56:45 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 16:56:45 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk.config"/>
Nov 08 16:56:45 user nova-compute[74669]:       <target dev="sdb" bus="scsi"/>
Nov 08 16:56:45 user nova-compute[74669]:       <address type="drive" controller="0" unit="1"/>
Nov 08 16:56:45 user nova-compute[74669]:     </disk>
Nov 08 16:56:45 user nova-compute[74669]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 08 16:56:45 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:56:45 user nova-compute[74669]:       <mac address="fa:16:3e:a1:4d:7a"/>
Nov 08 16:56:45 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:56:45 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:56:45 user nova-compute[74669]:       <target dev="tap9094cae8-f1"/>
Nov 08 16:56:45 user nova-compute[74669]:     </interface>
Nov 08 16:56:45 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:56:45 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/console.log" append="off"/>
Nov 08 16:56:45 user nova-compute[74669]:     </serial>
Nov 08 16:56:45 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:56:45 user nova-compute[74669]:     <video>
Nov 08 16:56:45 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:56:45 user nova-compute[74669]:     </video>
Nov 08 16:56:45 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:56:45 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:56:45 user nova-compute[74669]:     </rng>
Nov 08 16:56:45 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:56:45 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:56:45 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:56:45 user nova-compute[74669]:     </memballoon>
Nov 08 16:56:45 user nova-compute[74669]:   </devices>
Nov 08 16:56:45 user nova-compute[74669]: </domain>
Nov 08 16:56:45 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:56:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-571001023',display_name='tempest-AttachSCSIVolumeTestJSON-server-571001023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-571001023',id=13,image_ref='d713d2a4-1cef-4336-9ea3-593965526391',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkMDs8xzTKElrywZZWnz+Un1FN54LpSvfh6mK613vOoyk7B/n3R8l4bdaNR0SPEv9kG+kXnfBuDIdEivU/h7d4Z1xPXevLXMGuaXsr3BQsOH68OU1MHNVCNCWwynt0/AA==',key_name='tempest-keypair-1924695154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51ba6ed05fa648a6ab7618d83d11a4a6',ramdisk_id='',reservation_id='r-68w76pon',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d713d2a4-1cef-4336-9ea3-593965526391',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-219670464',owner_user_name='tempest-AttachSCSIVolumeTestJSON-219670464-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:56:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd4e7c5cf7424df0a0b8f684284eae8c',uuid=1b9ad090-c7bb-4a11-a056-19902844dbf0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9094cae8-f197-47d4-8ba3-8a1e274c3f04", "address": "fa:16:3e:a1:4d:7a", "network": {"id": "3e057921-3f7f-4344-bd63-e80de5bbe2be", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1558760908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ba6ed05fa648a6ab7618d83d11a4a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9094cae8-f1", "ovs_interfaceid": "9094cae8-f197-47d4-8ba3-8a1e274c3f04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Converting VIF {"id": "9094cae8-f197-47d4-8ba3-8a1e274c3f04", "address": "fa:16:3e:a1:4d:7a", "network": {"id": "3e057921-3f7f-4344-bd63-e80de5bbe2be", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1558760908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ba6ed05fa648a6ab7618d83d11a4a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9094cae8-f1", "ovs_interfaceid": "9094cae8-f197-47d4-8ba3-8a1e274c3f04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:4d:7a,bridge_name='br-int',has_traffic_filtering=True,id=9094cae8-f197-47d4-8ba3-8a1e274c3f04,network=Network(3e057921-3f7f-4344-bd63-e80de5bbe2be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9094cae8-f1') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG os_vif [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:4d:7a,bridge_name='br-int',has_traffic_filtering=True,id=9094cae8-f197-47d4-8ba3-8a1e274c3f04,network=Network(3e057921-3f7f-4344-bd63-e80de5bbe2be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9094cae8-f1') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5844794-b3b0-5b83-884c-124ca1ca6d67', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9094cae8-f1, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9094cae8-f1, col_values=(('qos', UUID('1c82a753-125b-44d1-b9ae-dc547e4ed7fa')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9094cae8-f1, col_values=(('external_ids', {'iface-id': '9094cae8-f197-47d4-8ba3-8a1e274c3f04', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:4d:7a', 'vm-uuid': '1b9ad090-c7bb-4a11-a056-19902844dbf0'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:45 user nova-compute[74669]: INFO os_vif [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:4d:7a,bridge_name='br-int',has_traffic_filtering=True,id=9094cae8-f197-47d4-8ba3-8a1e274c3f04,network=Network(3e057921-3f7f-4344-bd63-e80de5bbe2be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9094cae8-f1')
Nov 08 16:56:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] No BDM found with device name sda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] No VIF found with MAC fa:16:3e:a1:4d:7a, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:56:45 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Using config drive
Nov 08 16:56:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad6890a-b71d-472b-a435-0fea19ae012a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:45 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Creating config drive at /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk.config
Nov 08 16:56:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpr5byl_93 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.network.neutron [req-a3c133d1-76ad-411e-aa31-cdab318af6a6 req-765ad89d-69e9-4cfb-9d31-010c3c5cdb35 service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Updated VIF entry in instance network info cache for port 9094cae8-f197-47d4-8ba3-8a1e274c3f04. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG nova.network.neutron [req-a3c133d1-76ad-411e-aa31-cdab318af6a6 req-765ad89d-69e9-4cfb-9d31-010c3c5cdb35 service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Updating instance_info_cache with network_info: [{"id": "9094cae8-f197-47d4-8ba3-8a1e274c3f04", "address": "fa:16:3e:a1:4d:7a", "network": {"id": "3e057921-3f7f-4344-bd63-e80de5bbe2be", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1558760908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ba6ed05fa648a6ab7618d83d11a4a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9094cae8-f1", "ovs_interfaceid": "9094cae8-f197-47d4-8ba3-8a1e274c3f04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpr5byl_93" returned: 0 in 0.056s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a3c133d1-76ad-411e-aa31-cdab318af6a6 req-765ad89d-69e9-4cfb-9d31-010c3c5cdb35 service nova] Releasing lock "refresh_cache-1b9ad090-c7bb-4a11-a056-19902844dbf0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad6890a-b71d-472b-a435-0fea19ae012a/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad6890a-b71d-472b-a435-0fea19ae012a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad6890a-b71d-472b-a435-0fea19ae012a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk.rescue --force-share --output=json" returned: 0 in 0.266s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk.rescue --force-share --output=json" returned: 0 in 0.262s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 16:56:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-3e1e3022-6992-46ab-8726-673695e947da req-022c4825-f2c4-4860-8f9b-00e9978b6077 service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Received event network-vif-plugged-9094cae8-f197-47d4-8ba3-8a1e274c3f04 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:56:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3e1e3022-6992-46ab-8726-673695e947da req-022c4825-f2c4-4860-8f9b-00e9978b6077 service nova] Acquiring lock "1b9ad090-c7bb-4a11-a056-19902844dbf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:56:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3e1e3022-6992-46ab-8726-673695e947da req-022c4825-f2c4-4860-8f9b-00e9978b6077 service nova] Lock "1b9ad090-c7bb-4a11-a056-19902844dbf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:56:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3e1e3022-6992-46ab-8726-673695e947da req-022c4825-f2c4-4860-8f9b-00e9978b6077 service nova] Lock "1b9ad090-c7bb-4a11-a056-19902844dbf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:56:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-3e1e3022-6992-46ab-8726-673695e947da req-022c4825-f2c4-4860-8f9b-00e9978b6077 service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] No waiting events found dispatching network-vif-plugged-9094cae8-f197-47d4-8ba3-8a1e274c3f04 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:56:47 user nova-compute[74669]: WARNING nova.compute.manager [req-3e1e3022-6992-46ab-8726-673695e947da req-022c4825-f2c4-4860-8f9b-00e9978b6077 service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Received unexpected event network-vif-plugged-9094cae8-f197-47d4-8ba3-8a1e274c3f04 for instance with vm_state building and task_state spawning.
Nov 08 16:56:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:48 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:56:48 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:56:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=7942MB free_disk=25.42885971069336GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:56:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:56:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:56:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Applying migration context for instance b26dbeeb-b629-414d-bcca-cdde6c207789 as it has an incoming, in-progress migration c2bca562-a8f7-4f0c-99ad-9347ae824001. Migration status is post-migrating {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 16:56:48 user nova-compute[74669]: INFO nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Updating resource usage from migration c2bca562-a8f7-4f0c-99ad-9347ae824001
Nov 08 16:56:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:56:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:56:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:56:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2d42d5ce-db73-40e6-9b35-f662a3cf0091 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:56:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0829b734-daec-4dc6-b24b-cbe89000160c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:56:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0ad6890a-b71d-472b-a435-0fea19ae012a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:56:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Migration c2bca562-a8f7-4f0c-99ad-9347ae824001 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 16:56:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b26dbeeb-b629-414d-bcca-cdde6c207789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:56:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 1b9ad090-c7bb-4a11-a056-19902844dbf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:56:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:56:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:56:48 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing inventories for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 16:56:48 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Updating ProviderTree inventory for provider ce26964b-e55b-43d2-801a-7221ff1fe64b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 16:56:48 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Updating inventory in ProviderTree for provider ce26964b-e55b-43d2-801a-7221ff1fe64b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 16:56:48 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing aggregate associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, aggregates: None {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 16:56:48 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing trait associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, traits: HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 16:56:49 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:56:49 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:56:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:56:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.980s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:56:49 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:56:49 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74669) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 16:56:49 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:56:49 user nova-compute[74669]: DEBUG nova.compute.manager [req-81f0982d-2aea-44cb-b25c-4c9547addec3 req-b8d5e54f-1341-492f-9474-f48103ba00cb service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Received event network-vif-plugged-9094cae8-f197-47d4-8ba3-8a1e274c3f04 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:56:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-81f0982d-2aea-44cb-b25c-4c9547addec3 req-b8d5e54f-1341-492f-9474-f48103ba00cb service nova] Acquiring lock "1b9ad090-c7bb-4a11-a056-19902844dbf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:56:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-81f0982d-2aea-44cb-b25c-4c9547addec3 req-b8d5e54f-1341-492f-9474-f48103ba00cb service nova] Lock "1b9ad090-c7bb-4a11-a056-19902844dbf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:56:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-81f0982d-2aea-44cb-b25c-4c9547addec3 req-b8d5e54f-1341-492f-9474-f48103ba00cb service nova] Lock "1b9ad090-c7bb-4a11-a056-19902844dbf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:56:49 user nova-compute[74669]: DEBUG nova.compute.manager [req-81f0982d-2aea-44cb-b25c-4c9547addec3 req-b8d5e54f-1341-492f-9474-f48103ba00cb service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] No waiting events found dispatching network-vif-plugged-9094cae8-f197-47d4-8ba3-8a1e274c3f04 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:56:49 user nova-compute[74669]: WARNING nova.compute.manager [req-81f0982d-2aea-44cb-b25c-4c9547addec3 req-b8d5e54f-1341-492f-9474-f48103ba00cb service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Received unexpected event network-vif-plugged-9094cae8-f197-47d4-8ba3-8a1e274c3f04 for instance with vm_state building and task_state spawning.
Nov 08 16:56:49 user nova-compute[74669]: DEBUG nova.compute.manager [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 16:56:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 16:56:49 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Instance spawned successfully.
Nov 08 16:56:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 16:56:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:56:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:56:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:56:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:56:49 user nova-compute[74669]: INFO nova.compute.manager [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Took 7.94 seconds to spawn the instance on the hypervisor.
Nov 08 16:56:49 user nova-compute[74669]: DEBUG nova.compute.manager [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:56:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:50 user nova-compute[74669]: INFO nova.compute.manager [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Took 9.10 seconds to build instance.
Nov 08 16:56:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6ffb76bd-2aaf-4598-8d98-7c08fac11ce4 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "1b9ad090-c7bb-4a11-a056-19902844dbf0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.244s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:56:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:56:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:56:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:56:51 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:56:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-2d42d5ce-db73-40e6-9b35-f662a3cf0091" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:56:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-2d42d5ce-db73-40e6-9b35-f662a3cf0091" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:56:51 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 16:56:52 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Updating instance_info_cache with network_info: [{"id": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "address": "fa:16:3e:53:bc:e0", "network": {"id": "387522d7-947f-4a57-b80b-cefb0257df3e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-177095636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6f55d1187334b6b9099a9fd647aa721", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23885293-c9", "ovs_interfaceid": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:56:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-2d42d5ce-db73-40e6-9b35-f662a3cf0091" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:56:52 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 16:56:52 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:56:52 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:56:52 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:56:52 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:56:52 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:56:52 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:56:52 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:56:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:53 user nova-compute[74669]: INFO nova.compute.manager [None req-03505325-0d1c-4a5a-a086-a9617e80ba26 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Unrescuing
Nov 08 16:56:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-03505325-0d1c-4a5a-a086-a9617e80ba26 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:56:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-03505325-0d1c-4a5a-a086-a9617e80ba26 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquired lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:56:53 user nova-compute[74669]: DEBUG nova.network.neutron [None req-03505325-0d1c-4a5a-a086-a9617e80ba26 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:56:54 user nova-compute[74669]: DEBUG nova.network.neutron [None req-03505325-0d1c-4a5a-a086-a9617e80ba26 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Updating instance_info_cache with network_info: [{"id": "18b88bab-9376-440a-94f0-478d193b35f5", "address": "fa:16:3e:e0:5c:ca", "network": {"id": "7548ddaf-d550-41df-8f64-fc740e56fcd2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-954808146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa6ad206b6fa4cc099c08a01b051312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b88bab-93", "ovs_interfaceid": "18b88bab-9376-440a-94f0-478d193b35f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:56:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-03505325-0d1c-4a5a-a086-a9617e80ba26 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Releasing lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:56:54 user nova-compute[74669]: DEBUG nova.objects.instance [None req-03505325-0d1c-4a5a-a086-a9617e80ba26 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lazy-loading 'flavor' on Instance uuid 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:56:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:55 user nova-compute[74669]: DEBUG nova.compute.manager [req-1f305179-759f-46d2-b006-e94aea4de533 req-3e22090a-283f-4a48-bc77-f6d51222e905 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received event network-vif-unplugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:56:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1f305179-759f-46d2-b006-e94aea4de533 req-3e22090a-283f-4a48-bc77-f6d51222e905 service nova] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:56:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1f305179-759f-46d2-b006-e94aea4de533 req-3e22090a-283f-4a48-bc77-f6d51222e905 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:56:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1f305179-759f-46d2-b006-e94aea4de533 req-3e22090a-283f-4a48-bc77-f6d51222e905 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:56:55 user nova-compute[74669]: DEBUG nova.compute.manager [req-1f305179-759f-46d2-b006-e94aea4de533 req-3e22090a-283f-4a48-bc77-f6d51222e905 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] No waiting events found dispatching network-vif-unplugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:56:55 user nova-compute[74669]: WARNING nova.compute.manager [req-1f305179-759f-46d2-b006-e94aea4de533 req-3e22090a-283f-4a48-bc77-f6d51222e905 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received unexpected event network-vif-unplugged-18b88bab-9376-440a-94f0-478d193b35f5 for instance with vm_state rescued and task_state unrescuing.
Nov 08 16:56:55 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Instance destroyed successfully.
Nov 08 16:56:56 user nova-compute[74669]: DEBUG nova.compute.manager [req-341522d7-8d57-4cab-acf8-f10b47abf785 req-e88b7864-0265-4e6c-92cc-a811091e0626 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received event network-changed-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:56:56 user nova-compute[74669]: DEBUG nova.compute.manager [req-341522d7-8d57-4cab-acf8-f10b47abf785 req-e88b7864-0265-4e6c-92cc-a811091e0626 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Refreshing instance network info cache due to event network-changed-18b88bab-9376-440a-94f0-478d193b35f5. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:56:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-341522d7-8d57-4cab-acf8-f10b47abf785 req-e88b7864-0265-4e6c-92cc-a811091e0626 service nova] Acquiring lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:56:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-341522d7-8d57-4cab-acf8-f10b47abf785 req-e88b7864-0265-4e6c-92cc-a811091e0626 service nova] Acquired lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:56:56 user nova-compute[74669]: DEBUG nova.network.neutron [req-341522d7-8d57-4cab-acf8-f10b47abf785 req-e88b7864-0265-4e6c-92cc-a811091e0626 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Refreshing network info cache for port 18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.network.neutron [req-341522d7-8d57-4cab-acf8-f10b47abf785 req-e88b7864-0265-4e6c-92cc-a811091e0626 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Updated VIF entry in instance network info cache for port 18b88bab-9376-440a-94f0-478d193b35f5. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.network.neutron [req-341522d7-8d57-4cab-acf8-f10b47abf785 req-e88b7864-0265-4e6c-92cc-a811091e0626 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Updating instance_info_cache with network_info: [{"id": "18b88bab-9376-440a-94f0-478d193b35f5", "address": "fa:16:3e:e0:5c:ca", "network": {"id": "7548ddaf-d550-41df-8f64-fc740e56fcd2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-954808146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa6ad206b6fa4cc099c08a01b051312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b88bab-93", "ovs_interfaceid": "18b88bab-9376-440a-94f0-478d193b35f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-341522d7-8d57-4cab-acf8-f10b47abf785 req-e88b7864-0265-4e6c-92cc-a811091e0626 service nova] Releasing lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Starting finish_migration {{(pid=74669) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Instance directory exists: not creating {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 16:56:57 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Creating image(s)
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.238s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk. size=21474836480 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-443c4c41-cde7-412a-b06d-6fb3b9d7be61 req-dba7e200-5d9c-4fac-8ce9-6a9d8f9625f5 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-443c4c41-cde7-412a-b06d-6fb3b9d7be61 req-dba7e200-5d9c-4fac-8ce9-6a9d8f9625f5 service nova] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-443c4c41-cde7-412a-b06d-6fb3b9d7be61 req-dba7e200-5d9c-4fac-8ce9-6a9d8f9625f5 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-443c4c41-cde7-412a-b06d-6fb3b9d7be61 req-dba7e200-5d9c-4fac-8ce9-6a9d8f9625f5 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-443c4c41-cde7-412a-b06d-6fb3b9d7be61 req-dba7e200-5d9c-4fac-8ce9-6a9d8f9625f5 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] No waiting events found dispatching network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:56:57 user nova-compute[74669]: WARNING nova.compute.manager [req-443c4c41-cde7-412a-b06d-6fb3b9d7be61 req-dba7e200-5d9c-4fac-8ce9-6a9d8f9625f5 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received unexpected event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 for instance with vm_state rescued and task_state unrescuing.
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk 21474836480 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk 21474836480" returned: 0 in 0.062s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Did not create local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Ensure instance console log exists: /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Start _get_guest_xml network_info=[{"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1823624814-network", "vif_mac": "fa:16:3e:33:33:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'd0410494-1829-4310-9175-90addcc6b956', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygTldqYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b26dbeeb-b629-414d-bcca-cdde6c207789', 'attached_at': '2023-11-08T16:56:57.000000', 'detached_at': '', 'volume_id': 'f1176f50-24fe-4e13-aa36-02955f521263', 'serial': 'f1176f50-24fe-4e13-aa36-02955f521263'}, 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:56:57 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:56:57 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygTldqYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:56:57 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:56:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:56:57 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:56:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:56:57 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d14ec2-e974-4921-ac67-12453bb14b78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 16:56:57 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f66f96e-4a36-4833-a0e8-ed2f3e15ebb9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263] added
Nov 08 16:56:57 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a993fa13-0b33-4981-aca1-28ae3dcdf07b]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:56:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6c0b93-5997-4cb3-9992-6b13373fddff]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ygTldqYN {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ygTldqYN" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2855da7-bcbb-4642-b382-7ef28e88d6fc]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ygTldqYN'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG nova.compute.manager [req-d5eeba63-ef9d-4a51-8c3a-ca0b04fc6f2e req-630ed8d4-2486-4f94-98f4-5dd8bde9341a service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received event network-changed-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG nova.compute.manager [req-d5eeba63-ef9d-4a51-8c3a-ca0b04fc6f2e req-630ed8d4-2486-4f94-98f4-5dd8bde9341a service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Refreshing instance network info cache due to event network-changed-18b88bab-9376-440a-94f0-478d193b35f5. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d5eeba63-ef9d-4a51-8c3a-ca0b04fc6f2e req-630ed8d4-2486-4f94-98f4-5dd8bde9341a service nova] Acquiring lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d5eeba63-ef9d-4a51-8c3a-ca0b04fc6f2e req-630ed8d4-2486-4f94-98f4-5dd8bde9341a service nova] Acquired lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG nova.network.neutron [req-d5eeba63-ef9d-4a51-8c3a-ca0b04fc6f2e req-630ed8d4-2486-4f94-98f4-5dd8bde9341a service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Refreshing network info cache for port 18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97f06cb-82a7-447c-a6e7-e37a54d80342]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff571c7d-859f-4f42-94a8-9d67f98b29f3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:56:58 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:56:58 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:56:58 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:56:58 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f88005-c917-4237-b7ca-aecf29dd4e2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260]
Nov 08 16:56:58 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260] successful.
Nov 08 16:56:58 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fe9e8a-0cc4-4ad1-9c94-f8e6d8f864f0]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bb1585-06d1-4f61-9e68-291542451ab0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:56:58 user nova-compute[74669]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:56:58 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:56:58 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:56:58 user nova-compute[74669]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:56:58 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:56:58 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[64365442-b571-4f6d-bf31-e51239cb0656]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: None {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG nova.network.neutron [req-d5eeba63-ef9d-4a51-8c3a-ca0b04fc6f2e req-630ed8d4-2486-4f94-98f4-5dd8bde9341a service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Updated VIF entry in instance network info cache for port 18b88bab-9376-440a-94f0-478d193b35f5. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG nova.network.neutron [req-d5eeba63-ef9d-4a51-8c3a-ca0b04fc6f2e req-630ed8d4-2486-4f94-98f4-5dd8bde9341a service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Updating instance_info_cache with network_info: [{"id": "18b88bab-9376-440a-94f0-478d193b35f5", "address": "fa:16:3e:e0:5c:ca", "network": {"id": "7548ddaf-d550-41df-8f64-fc740e56fcd2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-954808146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa6ad206b6fa4cc099c08a01b051312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b88bab-93", "ovs_interfaceid": "18b88bab-9376-440a-94f0-478d193b35f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d5eeba63-ef9d-4a51-8c3a-ca0b04fc6f2e req-630ed8d4-2486-4f94-98f4-5dd8bde9341a service nova] Releasing lock "refresh_cache-45d48da2-85b1-4b7f-9661-8fe4e8346ca6" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygTldqYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '23333376538313966', 'path': '/dev/sdd'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333376538313966', 'path': '/dev/sdd'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-82074997',display_name='tempest-ServerActionsTestOtherB-server-82074997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-82074997',id=5,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVVAiZ/J+loI4/5CGCEcHyBdao/VDdeBeozCcJvl0eh7qycgoJCVfo066fltlkQiowyw4815L1dFrqeYMGOPhwhd9fpfcyVQWgEILP3lJeo6lsJtZZ3WMWpczoYeL0t+w==',key_name='tempest-keypair-1692388907',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:51:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9bc128b2ae524ce0aff2afb7301888bf',ramdisk_id='',reservation_id='r-fjmhrntp',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-839528249',owner_user_name='tempest-ServerActionsTestOtherB-839528249-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:56:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acb95477d6ba46d4be3b34280c5892e5',uuid=b26dbeeb-b629-414d-bcca-cdde6c207789,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1823624814-network", "vif_mac": "fa:16:3e:33:33:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Converting VIF {"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1823624814-network", "vif_mac": "fa:16:3e:33:33:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:33:ae,bridge_name='br-int',has_traffic_filtering=True,id=47c9314f-4ea9-49c3-9b34-2fb94cc1eac4,network=Network(35a879d8-439e-4ac4-a8ae-292e3b9a1966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9314f-4e') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:56:59 user nova-compute[74669]:   <uuid>b26dbeeb-b629-414d-bcca-cdde6c207789</uuid>
Nov 08 16:56:59 user nova-compute[74669]:   <name>instance-00000005</name>
Nov 08 16:56:59 user nova-compute[74669]:   <memory>2097152</memory>
Nov 08 16:56:59 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:56:59 user nova-compute[74669]:   <metadata>
Nov 08 16:56:59 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:56:59 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:56:59 user nova-compute[74669]:       <nova:name>tempest-ServerActionsTestOtherB-server-82074997</nova:name>
Nov 08 16:56:59 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:56:57</nova:creationTime>
Nov 08 16:56:59 user nova-compute[74669]:       <nova:flavor name="m1.small">
Nov 08 16:56:59 user nova-compute[74669]:         <nova:memory>2048</nova:memory>
Nov 08 16:56:59 user nova-compute[74669]:         <nova:disk>20</nova:disk>
Nov 08 16:56:59 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:56:59 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:56:59 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:56:59 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:56:59 user nova-compute[74669]:       <nova:owner>
Nov 08 16:56:59 user nova-compute[74669]:         <nova:user uuid="acb95477d6ba46d4be3b34280c5892e5">tempest-ServerActionsTestOtherB-839528249-project-member</nova:user>
Nov 08 16:56:59 user nova-compute[74669]:         <nova:project uuid="9bc128b2ae524ce0aff2afb7301888bf">tempest-ServerActionsTestOtherB-839528249</nova:project>
Nov 08 16:56:59 user nova-compute[74669]:       </nova:owner>
Nov 08 16:56:59 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:56:59 user nova-compute[74669]:       <nova:ports>
Nov 08 16:56:59 user nova-compute[74669]:         <nova:port uuid="47c9314f-4ea9-49c3-9b34-2fb94cc1eac4">
Nov 08 16:56:59 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 16:56:59 user nova-compute[74669]:         </nova:port>
Nov 08 16:56:59 user nova-compute[74669]:       </nova:ports>
Nov 08 16:56:59 user nova-compute[74669]:     </nova:instance>
Nov 08 16:56:59 user nova-compute[74669]:   </metadata>
Nov 08 16:56:59 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:56:59 user nova-compute[74669]:     <system>
Nov 08 16:56:59 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:56:59 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:56:59 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:56:59 user nova-compute[74669]:       <entry name="serial">b26dbeeb-b629-414d-bcca-cdde6c207789</entry>
Nov 08 16:56:59 user nova-compute[74669]:       <entry name="uuid">b26dbeeb-b629-414d-bcca-cdde6c207789</entry>
Nov 08 16:56:59 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:56:59 user nova-compute[74669]:     </system>
Nov 08 16:56:59 user nova-compute[74669]:   </sysinfo>
Nov 08 16:56:59 user nova-compute[74669]:   <os>
Nov 08 16:56:59 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:56:59 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 16:56:59 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:56:59 user nova-compute[74669]:   </os>
Nov 08 16:56:59 user nova-compute[74669]:   <features>
Nov 08 16:56:59 user nova-compute[74669]:     <acpi/>
Nov 08 16:56:59 user nova-compute[74669]:     <apic/>
Nov 08 16:56:59 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:56:59 user nova-compute[74669]:   </features>
Nov 08 16:56:59 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:56:59 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:56:59 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:56:59 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:56:59 user nova-compute[74669]:   </clock>
Nov 08 16:56:59 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:56:59 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:56:59 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:56:59 user nova-compute[74669]:   </cpu>
Nov 08 16:56:59 user nova-compute[74669]:   <devices>
Nov 08 16:56:59 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:56:59 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:56:59 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk"/>
Nov 08 16:56:59 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:56:59 user nova-compute[74669]:     </disk>
Nov 08 16:56:59 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 16:56:59 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:56:59 user nova-compute[74669]:       <source dev="/dev/sdd"/>
Nov 08 16:56:59 user nova-compute[74669]:       <target dev="vdb" bus="virtio"/>
Nov 08 16:56:59 user nova-compute[74669]:       <serial>f1176f50-24fe-4e13-aa36-02955f521263</serial>
Nov 08 16:56:59 user nova-compute[74669]:     </disk>
Nov 08 16:56:59 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:56:59 user nova-compute[74669]:       <mac address="fa:16:3e:33:33:ae"/>
Nov 08 16:56:59 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:56:59 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:56:59 user nova-compute[74669]:       <target dev="tap47c9314f-4e"/>
Nov 08 16:56:59 user nova-compute[74669]:     </interface>
Nov 08 16:56:59 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:56:59 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/console.log" append="off"/>
Nov 08 16:56:59 user nova-compute[74669]:     </serial>
Nov 08 16:56:59 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:56:59 user nova-compute[74669]:     <video>
Nov 08 16:56:59 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:56:59 user nova-compute[74669]:     </video>
Nov 08 16:56:59 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:56:59 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:56:59 user nova-compute[74669]:     </rng>
Nov 08 16:56:59 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:56:59 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:56:59 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:56:59 user nova-compute[74669]:     </memballoon>
Nov 08 16:56:59 user nova-compute[74669]:   </devices>
Nov 08 16:56:59 user nova-compute[74669]: </domain>
Nov 08 16:56:59 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-82074997',display_name='tempest-ServerActionsTestOtherB-server-82074997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-82074997',id=5,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVVAiZ/J+loI4/5CGCEcHyBdao/VDdeBeozCcJvl0eh7qycgoJCVfo066fltlkQiowyw4815L1dFrqeYMGOPhwhd9fpfcyVQWgEILP3lJeo6lsJtZZ3WMWpczoYeL0t+w==',key_name='tempest-keypair-1692388907',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:51:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9bc128b2ae524ce0aff2afb7301888bf',ramdisk_id='',reservation_id='r-fjmhrntp',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-839528249',owner_user_name='tempest-ServerActionsTestOtherB-839528249-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:56:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acb95477d6ba46d4be3b34280c5892e5',uuid=b26dbeeb-b629-414d-bcca-cdde6c207789,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1823624814-network", "vif_mac": "fa:16:3e:33:33:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Converting VIF {"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1823624814-network", "vif_mac": "fa:16:3e:33:33:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:33:ae,bridge_name='br-int',has_traffic_filtering=True,id=47c9314f-4ea9-49c3-9b34-2fb94cc1eac4,network=Network(35a879d8-439e-4ac4-a8ae-292e3b9a1966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9314f-4e') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG os_vif [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:33:ae,bridge_name='br-int',has_traffic_filtering=True,id=47c9314f-4ea9-49c3-9b34-2fb94cc1eac4,network=Network(35a879d8-439e-4ac4-a8ae-292e3b9a1966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9314f-4e') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af7b870c-ed84-5da9-bbc3-4b1f6e3df14b', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47c9314f-4e, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47c9314f-4e, col_values=(('qos', UUID('45323e96-15bd-4269-ae65-e29b4956eea8')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47c9314f-4e, col_values=(('external_ids', {'iface-id': '47c9314f-4ea9-49c3-9b34-2fb94cc1eac4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:33:ae', 'vm-uuid': 'b26dbeeb-b629-414d-bcca-cdde6c207789'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:56:59 user nova-compute[74669]: INFO os_vif [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:33:ae,bridge_name='br-int',has_traffic_filtering=True,id=47c9314f-4ea9-49c3-9b34-2fb94cc1eac4,network=Network(35a879d8-439e-4ac4-a8ae-292e3b9a1966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9314f-4e')
Nov 08 16:56:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] No VIF found with MAC fa:16:3e:33:33:ae, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-1a3d9c86-56e4-4890-9d4a-b60861de10f9 req-753500bb-ee8d-4dce-85de-33883d872d96 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1a3d9c86-56e4-4890-9d4a-b60861de10f9 req-753500bb-ee8d-4dce-85de-33883d872d96 service nova] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1a3d9c86-56e4-4890-9d4a-b60861de10f9 req-753500bb-ee8d-4dce-85de-33883d872d96 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1a3d9c86-56e4-4890-9d4a-b60861de10f9 req-753500bb-ee8d-4dce-85de-33883d872d96 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-1a3d9c86-56e4-4890-9d4a-b60861de10f9 req-753500bb-ee8d-4dce-85de-33883d872d96 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] No waiting events found dispatching network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:56:59 user nova-compute[74669]: WARNING nova.compute.manager [req-1a3d9c86-56e4-4890-9d4a-b60861de10f9 req-753500bb-ee8d-4dce-85de-33883d872d96 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received unexpected event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 for instance with vm_state rescued and task_state unrescuing.
Nov 08 16:56:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-1a3d9c86-56e4-4890-9d4a-b60861de10f9 req-753500bb-ee8d-4dce-85de-33883d872d96 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1a3d9c86-56e4-4890-9d4a-b60861de10f9 req-753500bb-ee8d-4dce-85de-33883d872d96 service nova] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1a3d9c86-56e4-4890-9d4a-b60861de10f9 req-753500bb-ee8d-4dce-85de-33883d872d96 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1a3d9c86-56e4-4890-9d4a-b60861de10f9 req-753500bb-ee8d-4dce-85de-33883d872d96 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:56:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-1a3d9c86-56e4-4890-9d4a-b60861de10f9 req-753500bb-ee8d-4dce-85de-33883d872d96 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] No waiting events found dispatching network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:56:59 user nova-compute[74669]: WARNING nova.compute.manager [req-1a3d9c86-56e4-4890-9d4a-b60861de10f9 req-753500bb-ee8d-4dce-85de-33883d872d96 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received unexpected event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 for instance with vm_state rescued and task_state unrescuing.
Nov 08 16:56:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:00 user nova-compute[74669]: DEBUG nova.compute.manager [None req-03505325-0d1c-4a5a-a086-a9617e80ba26 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:57:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-3babc9af-880a-4e71-ab46-21548194c50a req-fc14be0b-bdc2-40f7-9caa-db622a722912 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received event network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:57:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3babc9af-880a-4e71-ab46-21548194c50a req-fc14be0b-bdc2-40f7-9caa-db622a722912 service nova] Acquiring lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3babc9af-880a-4e71-ab46-21548194c50a req-fc14be0b-bdc2-40f7-9caa-db622a722912 service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3babc9af-880a-4e71-ab46-21548194c50a req-fc14be0b-bdc2-40f7-9caa-db622a722912 service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:57:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-3babc9af-880a-4e71-ab46-21548194c50a req-fc14be0b-bdc2-40f7-9caa-db622a722912 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] No waiting events found dispatching network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:57:01 user nova-compute[74669]: WARNING nova.compute.manager [req-3babc9af-880a-4e71-ab46-21548194c50a req-fc14be0b-bdc2-40f7-9caa-db622a722912 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received unexpected event network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 for instance with vm_state active and task_state resize_finish.
Nov 08 16:57:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:03 user nova-compute[74669]: DEBUG nova.compute.manager [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 16:57:03 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Instance running successfully.
Nov 08 16:57:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Failed to set time: agent not configured {{(pid=74669) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 08 16:57:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-640145d3-cf44-43de-9f60-515090d461f1 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] finish_migration finished successfully. {{(pid=74669) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 08 16:57:03 user nova-compute[74669]: DEBUG nova.compute.manager [req-8a80bb45-3602-4c46-99f1-ef82c847d68f req-62f5c9ad-14cd-42a7-aefa-342d4a9a26bb service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received event network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:57:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8a80bb45-3602-4c46-99f1-ef82c847d68f req-62f5c9ad-14cd-42a7-aefa-342d4a9a26bb service nova] Acquiring lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8a80bb45-3602-4c46-99f1-ef82c847d68f req-62f5c9ad-14cd-42a7-aefa-342d4a9a26bb service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8a80bb45-3602-4c46-99f1-ef82c847d68f req-62f5c9ad-14cd-42a7-aefa-342d4a9a26bb service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:57:03 user nova-compute[74669]: DEBUG nova.compute.manager [req-8a80bb45-3602-4c46-99f1-ef82c847d68f req-62f5c9ad-14cd-42a7-aefa-342d4a9a26bb service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] No waiting events found dispatching network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:57:03 user nova-compute[74669]: WARNING nova.compute.manager [req-8a80bb45-3602-4c46-99f1-ef82c847d68f req-62f5c9ad-14cd-42a7-aefa-342d4a9a26bb service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received unexpected event network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 for instance with vm_state active and task_state resize_finish.
Nov 08 16:57:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "0ad6890a-b71d-472b-a435-0fea19ae012a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "0ad6890a-b71d-472b-a435-0fea19ae012a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "0ad6890a-b71d-472b-a435-0fea19ae012a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "0ad6890a-b71d-472b-a435-0fea19ae012a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "0ad6890a-b71d-472b-a435-0fea19ae012a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:57:13 user nova-compute[74669]: INFO nova.compute.manager [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Terminating instance
Nov 08 16:57:13 user nova-compute[74669]: DEBUG nova.compute.manager [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 16:57:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG nova.compute.manager [req-4e8c506e-439c-44d9-9236-ae88e8950331 req-08b185ed-620a-45e6-99af-d0a7fef623ff service nova] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Received event network-vif-unplugged-78599e43-1d46-4e63-ae30-2cd109f8ea05 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4e8c506e-439c-44d9-9236-ae88e8950331 req-08b185ed-620a-45e6-99af-d0a7fef623ff service nova] Acquiring lock "0ad6890a-b71d-472b-a435-0fea19ae012a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4e8c506e-439c-44d9-9236-ae88e8950331 req-08b185ed-620a-45e6-99af-d0a7fef623ff service nova] Lock "0ad6890a-b71d-472b-a435-0fea19ae012a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4e8c506e-439c-44d9-9236-ae88e8950331 req-08b185ed-620a-45e6-99af-d0a7fef623ff service nova] Lock "0ad6890a-b71d-472b-a435-0fea19ae012a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG nova.compute.manager [req-4e8c506e-439c-44d9-9236-ae88e8950331 req-08b185ed-620a-45e6-99af-d0a7fef623ff service nova] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] No waiting events found dispatching network-vif-unplugged-78599e43-1d46-4e63-ae30-2cd109f8ea05 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG nova.compute.manager [req-4e8c506e-439c-44d9-9236-ae88e8950331 req-08b185ed-620a-45e6-99af-d0a7fef623ff service nova] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Received event network-vif-unplugged-78599e43-1d46-4e63-ae30-2cd109f8ea05 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:14 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Instance destroyed successfully.
Nov 08 16:57:14 user nova-compute[74669]: DEBUG nova.objects.instance [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lazy-loading 'resources' on Instance uuid 0ad6890a-b71d-472b-a435-0fea19ae012a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:55:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1882583335',display_name='tempest-VolumesAdminNegativeTest-server-1882583335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1882583335',id=12,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:55:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6f55d1187334b6b9099a9fd647aa721',ramdisk_id='',reservation_id='r-hmvgr0oi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1861077985',owner_user_name='tempest-VolumesAdminNegativeTest-1861077985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:55:09Z,user_data=None,user_id='420018de00394687bba8a1ca64ea51f3',uuid=0ad6890a-b71d-472b-a435-0fea19ae012a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78599e43-1d46-4e63-ae30-2cd109f8ea05", "address": "fa:16:3e:e0:c8:8b", "network": {"id": "387522d7-947f-4a57-b80b-cefb0257df3e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-177095636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6f55d1187334b6b9099a9fd647aa721", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78599e43-1d", "ovs_interfaceid": "78599e43-1d46-4e63-ae30-2cd109f8ea05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Converting VIF {"id": "78599e43-1d46-4e63-ae30-2cd109f8ea05", "address": "fa:16:3e:e0:c8:8b", "network": {"id": "387522d7-947f-4a57-b80b-cefb0257df3e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-177095636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6f55d1187334b6b9099a9fd647aa721", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78599e43-1d", "ovs_interfaceid": "78599e43-1d46-4e63-ae30-2cd109f8ea05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c8:8b,bridge_name='br-int',has_traffic_filtering=True,id=78599e43-1d46-4e63-ae30-2cd109f8ea05,network=Network(387522d7-947f-4a57-b80b-cefb0257df3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78599e43-1d') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG os_vif [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c8:8b,bridge_name='br-int',has_traffic_filtering=True,id=78599e43-1d46-4e63-ae30-2cd109f8ea05,network=Network(387522d7-947f-4a57-b80b-cefb0257df3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78599e43-1d') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78599e43-1d, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5283c61-17d5-4ace-adec-9ec60d1a0cff) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:14 user nova-compute[74669]: INFO os_vif [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c8:8b,bridge_name='br-int',has_traffic_filtering=True,id=78599e43-1d46-4e63-ae30-2cd109f8ea05,network=Network(387522d7-947f-4a57-b80b-cefb0257df3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78599e43-1d')
Nov 08 16:57:14 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Deleting instance files /opt/stack/data/nova/instances/0ad6890a-b71d-472b-a435-0fea19ae012a_del
Nov 08 16:57:14 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Deletion of /opt/stack/data/nova/instances/0ad6890a-b71d-472b-a435-0fea19ae012a_del complete
Nov 08 16:57:14 user nova-compute[74669]: INFO nova.compute.manager [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 08 16:57:14 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 16:57:14 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 16:57:15 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:57:15 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Took 0.70 seconds to deallocate network for instance.
Nov 08 16:57:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:15 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:57:15 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:57:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:57:15 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Deleted allocations for instance 0ad6890a-b71d-472b-a435-0fea19ae012a
Nov 08 16:57:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-21cf8f91-dcea-421e-a6b0-9c997f65af51 tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "0ad6890a-b71d-472b-a435-0fea19ae012a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.435s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:57:16 user nova-compute[74669]: DEBUG nova.compute.manager [req-9c6fef79-b54d-41bb-9268-7db7916a2a8d req-7f85f7d7-e583-4dab-a50b-a4e60cf04e45 service nova] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Received event network-vif-plugged-78599e43-1d46-4e63-ae30-2cd109f8ea05 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:57:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9c6fef79-b54d-41bb-9268-7db7916a2a8d req-7f85f7d7-e583-4dab-a50b-a4e60cf04e45 service nova] Acquiring lock "0ad6890a-b71d-472b-a435-0fea19ae012a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9c6fef79-b54d-41bb-9268-7db7916a2a8d req-7f85f7d7-e583-4dab-a50b-a4e60cf04e45 service nova] Lock "0ad6890a-b71d-472b-a435-0fea19ae012a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9c6fef79-b54d-41bb-9268-7db7916a2a8d req-7f85f7d7-e583-4dab-a50b-a4e60cf04e45 service nova] Lock "0ad6890a-b71d-472b-a435-0fea19ae012a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:57:16 user nova-compute[74669]: DEBUG nova.compute.manager [req-9c6fef79-b54d-41bb-9268-7db7916a2a8d req-7f85f7d7-e583-4dab-a50b-a4e60cf04e45 service nova] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] No waiting events found dispatching network-vif-plugged-78599e43-1d46-4e63-ae30-2cd109f8ea05 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:57:16 user nova-compute[74669]: WARNING nova.compute.manager [req-9c6fef79-b54d-41bb-9268-7db7916a2a8d req-7f85f7d7-e583-4dab-a50b-a4e60cf04e45 service nova] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Received unexpected event network-vif-plugged-78599e43-1d46-4e63-ae30-2cd109f8ea05 for instance with vm_state deleted and task_state None.
Nov 08 16:57:16 user nova-compute[74669]: DEBUG nova.compute.manager [req-9c6fef79-b54d-41bb-9268-7db7916a2a8d req-7f85f7d7-e583-4dab-a50b-a4e60cf04e45 service nova] [instance: 0ad6890a-b71d-472b-a435-0fea19ae012a] Received event network-vif-deleted-78599e43-1d46-4e63-ae30-2cd109f8ea05 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:57:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:27 user nova-compute[74669]: INFO nova.compute.manager [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Detaching volume 3991b324-673d-4a72-97b0-e1e7c10a2cb6
Nov 08 16:57:27 user nova-compute[74669]: INFO nova.virt.block_device [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Attempting to driver detach volume 3991b324-673d-4a72-97b0-e1e7c10a2cb6 from mountpoint /dev/vdb
Nov 08 16:57:27 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Attempting to detach device vdb from instance 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 16:57:27 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 16:57:27 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:57:27 user nova-compute[74669]:   <source dev="/dev/sdb"/>
Nov 08 16:57:27 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:57:27 user nova-compute[74669]:   <serial>3991b324-673d-4a72-97b0-e1e7c10a2cb6</serial>
Nov 08 16:57:27 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 16:57:27 user nova-compute[74669]: </disk>
Nov 08 16:57:27 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 16:57:27 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Successfully detached device vdb from instance 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 from the persistent domain config.
Nov 08 16:57:27 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 16:57:27 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 16:57:27 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:57:27 user nova-compute[74669]:   <source dev="/dev/sdb"/>
Nov 08 16:57:27 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:57:27 user nova-compute[74669]:   <serial>3991b324-673d-4a72-97b0-e1e7c10a2cb6</serial>
Nov 08 16:57:27 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 16:57:27 user nova-compute[74669]: </disk>
Nov 08 16:57:27 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 16:57:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 16:57:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:31 user nova-compute[74669]: INFO nova.compute.manager [None req-5e602654-ba2d-4f4c-863a-7af1248d5862 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Unrescuing
Nov 08 16:57:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5e602654-ba2d-4f4c-863a-7af1248d5862 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "refresh_cache-e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:57:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5e602654-ba2d-4f4c-863a-7af1248d5862 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquired lock "refresh_cache-e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:57:31 user nova-compute[74669]: DEBUG nova.network.neutron [None req-5e602654-ba2d-4f4c-863a-7af1248d5862 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:57:31 user nova-compute[74669]: DEBUG nova.network.neutron [None req-5e602654-ba2d-4f4c-863a-7af1248d5862 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Updating instance_info_cache with network_info: [{"id": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "address": "fa:16:3e:8f:9e:16", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b48f6d-e0", "ovs_interfaceid": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:57:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5e602654-ba2d-4f4c-863a-7af1248d5862 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Releasing lock "refresh_cache-e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:57:31 user nova-compute[74669]: DEBUG nova.objects.instance [None req-5e602654-ba2d-4f4c-863a-7af1248d5862 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'flavor' on Instance uuid e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:57:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:32 user nova-compute[74669]: DEBUG nova.compute.manager [req-568b4843-c9a7-4a02-a38f-f5018e6290fe req-5680512c-2981-44c6-aa12-1fb5fb412c8a service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received event network-vif-unplugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:57:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-568b4843-c9a7-4a02-a38f-f5018e6290fe req-5680512c-2981-44c6-aa12-1fb5fb412c8a service nova] Acquiring lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-568b4843-c9a7-4a02-a38f-f5018e6290fe req-5680512c-2981-44c6-aa12-1fb5fb412c8a service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-568b4843-c9a7-4a02-a38f-f5018e6290fe req-5680512c-2981-44c6-aa12-1fb5fb412c8a service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:57:32 user nova-compute[74669]: DEBUG nova.compute.manager [req-568b4843-c9a7-4a02-a38f-f5018e6290fe req-5680512c-2981-44c6-aa12-1fb5fb412c8a service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] No waiting events found dispatching network-vif-unplugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:57:32 user nova-compute[74669]: WARNING nova.compute.manager [req-568b4843-c9a7-4a02-a38f-f5018e6290fe req-5680512c-2981-44c6-aa12-1fb5fb412c8a service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received unexpected event network-vif-unplugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e for instance with vm_state rescued and task_state unrescuing.
Nov 08 16:57:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:32 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Instance destroyed successfully.
Nov 08 16:57:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-be67eb73-215a-42cf-8d68-449389a2b086 req-0babbd48-4fd9-41d1-b2b2-316b0c0effb9 service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received event network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:57:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-be67eb73-215a-42cf-8d68-449389a2b086 req-0babbd48-4fd9-41d1-b2b2-316b0c0effb9 service nova] Acquiring lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-be67eb73-215a-42cf-8d68-449389a2b086 req-0babbd48-4fd9-41d1-b2b2-316b0c0effb9 service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-be67eb73-215a-42cf-8d68-449389a2b086 req-0babbd48-4fd9-41d1-b2b2-316b0c0effb9 service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:57:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-be67eb73-215a-42cf-8d68-449389a2b086 req-0babbd48-4fd9-41d1-b2b2-316b0c0effb9 service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] No waiting events found dispatching network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:57:34 user nova-compute[74669]: WARNING nova.compute.manager [req-be67eb73-215a-42cf-8d68-449389a2b086 req-0babbd48-4fd9-41d1-b2b2-316b0c0effb9 service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received unexpected event network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e for instance with vm_state rescued and task_state unrescuing.
Nov 08 16:57:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-be67eb73-215a-42cf-8d68-449389a2b086 req-0babbd48-4fd9-41d1-b2b2-316b0c0effb9 service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received event network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:57:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-be67eb73-215a-42cf-8d68-449389a2b086 req-0babbd48-4fd9-41d1-b2b2-316b0c0effb9 service nova] Acquiring lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-be67eb73-215a-42cf-8d68-449389a2b086 req-0babbd48-4fd9-41d1-b2b2-316b0c0effb9 service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-be67eb73-215a-42cf-8d68-449389a2b086 req-0babbd48-4fd9-41d1-b2b2-316b0c0effb9 service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:57:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-be67eb73-215a-42cf-8d68-449389a2b086 req-0babbd48-4fd9-41d1-b2b2-316b0c0effb9 service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] No waiting events found dispatching network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:57:34 user nova-compute[74669]: WARNING nova.compute.manager [req-be67eb73-215a-42cf-8d68-449389a2b086 req-0babbd48-4fd9-41d1-b2b2-316b0c0effb9 service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received unexpected event network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e for instance with vm_state rescued and task_state unrescuing.
Nov 08 16:57:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid b26dbeeb-b629-414d-bcca-cdde6c207789 {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid 2d42d5ce-db73-40e6-9b35-f662a3cf0091 {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid 0829b734-daec-4dc6-b24b-cbe89000160c {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid 1b9ad090-c7bb-4a11-a056-19902844dbf0 {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:36 user nova-compute[74669]: INFO nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "b26dbeeb-b629-414d-bcca-cdde6c207789" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "0829b734-daec-4dc6-b24b-cbe89000160c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "0829b734-daec-4dc6-b24b-cbe89000160c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "1b9ad090-c7bb-4a11-a056-19902844dbf0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "1b9ad090-c7bb-4a11-a056-19902844dbf0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "0829b734-daec-4dc6-b24b-cbe89000160c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5e602654-ba2d-4f4c-863a-7af1248d5862 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "1b9ad090-c7bb-4a11-a056-19902844dbf0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG nova.compute.manager [req-0937e4ce-22db-4c23-815d-c7b39b44b5f0 req-3cb57060-a976-4ae0-a6c9-e1308bd91ee8 service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received event network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0937e4ce-22db-4c23-815d-c7b39b44b5f0 req-3cb57060-a976-4ae0-a6c9-e1308bd91ee8 service nova] Acquiring lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0937e4ce-22db-4c23-815d-c7b39b44b5f0 req-3cb57060-a976-4ae0-a6c9-e1308bd91ee8 service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0937e4ce-22db-4c23-815d-c7b39b44b5f0 req-3cb57060-a976-4ae0-a6c9-e1308bd91ee8 service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:57:36 user nova-compute[74669]: DEBUG nova.compute.manager [req-0937e4ce-22db-4c23-815d-c7b39b44b5f0 req-3cb57060-a976-4ae0-a6c9-e1308bd91ee8 service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] No waiting events found dispatching network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:57:36 user nova-compute[74669]: WARNING nova.compute.manager [req-0937e4ce-22db-4c23-815d-c7b39b44b5f0 req-3cb57060-a976-4ae0-a6c9-e1308bd91ee8 service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received unexpected event network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e for instance with vm_state active and task_state None.
Nov 08 16:57:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:57:44 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:57:44 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:57:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:57:44 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:57:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 16:57:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 16:57:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:48 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 is timed out.
Nov 08 16:57:48 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Successfully detached device vdb from instance 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 from the live domain config.
Nov 08 16:57:48 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:57:48 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:57:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=7731MB free_disk=25.412517547607422GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'izyeXpVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:57:48 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:57:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[752e8f9c-6c8a-4eae-8d35-05f484df7d27]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 16:57:48 user nova-compute[74669]: No targets found.
Nov 08 16:57:48 user nova-compute[74669]: iSNS:
Nov 08 16:57:48 user nova-compute[74669]: No targets found.
Nov 08 16:57:48 user nova-compute[74669]: STATIC:
Nov 08 16:57:48 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263
Nov 08 16:57:48 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:57:48 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:57:48 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6
Nov 08 16:57:48 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:57:48 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:57:48 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630
Nov 08 16:57:48 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:57:48 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:57:48 user nova-compute[74669]: FIRMWARE:
Nov 08 16:57:48 user nova-compute[74669]: No targets found.
Nov 08 16:57:48 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 16:57:48 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 16:57:48 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07fd7dd-fe7a-4c9d-8787-a4f4a1517a83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffeceb5-d515-4262-9167-cd88c1745d17]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:57:48 user nova-compute[74669]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:57:48 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:57:48 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:57:48 user nova-compute[74669]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:57:48 user nova-compute[74669]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 (non-flash)
Nov 08 16:57:48 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9846e5090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6'): ({'sdb'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Removing single pathed devices sdb {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e8a183-632b-4c68-b36f-d4cfaa05e57c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:57:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Applying migration context for instance b26dbeeb-b629-414d-bcca-cdde6c207789 as it has an incoming, in-progress migration c2bca562-a8f7-4f0c-99ad-9347ae824001. Migration status is finished {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 16:57:48 user nova-compute[74669]: INFO nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Updating resource usage from migration c2bca562-a8f7-4f0c-99ad-9347ae824001
Nov 08 16:57:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa5e39d-fd38-4cf8-83d6-37ad63627f94]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Flushing IO for device /dev/sdb {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2d42d5ce-db73-40e6-9b35-f662a3cf0091 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0829b734-daec-4dc6-b24b-cbe89000160c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Migration c2bca562-a8f7-4f0c-99ad-9347ae824001 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b26dbeeb-b629-414d-bcca-cdde6c207789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 1b9ad090-c7bb-4a11-a056-19902844dbf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d267bd23-a10d-4eb9-8784-6eb100de0d29]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c45641-2351-49fc-9689-0e5c45e0644d]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbed6957-8ba8-4bf5-b565-6771cb4f6c9e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[33666038-d502-44d0-8c47-f137390469e9]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6, portal: 172.16.0.220,3260]
Nov 08 16:57:49 user nova-compute[74669]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6, portal: 172.16.0.220,3260] successful.
Nov 08 16:57:49 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3991b324-673d-4a72-97b0-e1e7c10a2cb6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25857ab-6009-4636-b4dc-fa0ee3f7fb3e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] <== disconnect_volume: return (367ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.577s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:49 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 16:57:49 user nova-compute[74669]: INFO nova.compute.claims [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Claim successful on node user
Nov 08 16:57:50 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 16:57:50 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 16:57:50 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG nova.objects.instance [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lazy-loading 'flavor' on Instance uuid 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:57:50 user nova-compute[74669]: INFO nova.virt.block_device [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Booting with volume 393d7383-44a3-4a2f-87f2-b2eb33f3acf5 at /dev/vda
Nov 08 16:57:50 user nova-compute[74669]: DEBUG nova.policy [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '756930c1b18340a9a0cfe3f95d9b89c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e866b4d7344b81b53cf1e4484faf29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a6bc5eb5-5e63-42a1-9e2c-32c86903ea57 tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.644s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 14.435s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG os_brick.utils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2af5824-0652-499b-ac32-1b11bfa86cd4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29fd47e-962c-4937-8518-8ccd1991efec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3c0335-fc3f-4b99-9f8a-3d8653ef6865]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa26c01-b375-4cef-bc5b-7022da134802]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:57:50 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 16:57:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed918a4c-0cf5-43fc-acf0-1397a6e612cd]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG os_brick.utils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:57:50 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Updating existing volume attachment record: c0d61309-30f4-43fb-9703-0a4a4290c6a0 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 16:57:51 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Successfully created port: 314df0da-c133-46af-bdc1-a317e71ca069 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:57:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:57:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:57:51 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:57:51 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Didn't find any instances for network info cache update. {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 16:57:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:57:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:57:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:57:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:57:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:57:51 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:57:51 user nova-compute[74669]: DEBUG nova.compute.manager [req-22ab7980-a72e-4017-b52f-f8c5244ed4ca req-edc8fc8b-9270-4eee-9baf-6660aa25842a service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received event network-changed-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:57:51 user nova-compute[74669]: DEBUG nova.compute.manager [req-22ab7980-a72e-4017-b52f-f8c5244ed4ca req-edc8fc8b-9270-4eee-9baf-6660aa25842a service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Refreshing instance network info cache due to event network-changed-bf29f8cc-1793-457b-a4a6-8158d048eac9. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:57:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-22ab7980-a72e-4017-b52f-f8c5244ed4ca req-edc8fc8b-9270-4eee-9baf-6660aa25842a service nova] Acquiring lock "refresh_cache-0829b734-daec-4dc6-b24b-cbe89000160c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:57:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-22ab7980-a72e-4017-b52f-f8c5244ed4ca req-edc8fc8b-9270-4eee-9baf-6660aa25842a service nova] Acquired lock "refresh_cache-0829b734-daec-4dc6-b24b-cbe89000160c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:57:51 user nova-compute[74669]: DEBUG nova.network.neutron [req-22ab7980-a72e-4017-b52f-f8c5244ed4ca req-edc8fc8b-9270-4eee-9baf-6660aa25842a service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Refreshing network info cache for port bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:57:51 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Successfully created port: 82aa3c9f-7823-4948-9496-449cb8e12f0b {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:57:52 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Successfully created port: f1dac6ca-fd45-42d7-9f01-32891331b7ba {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:57:52 user nova-compute[74669]: DEBUG nova.network.neutron [req-22ab7980-a72e-4017-b52f-f8c5244ed4ca req-edc8fc8b-9270-4eee-9baf-6660aa25842a service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Updated VIF entry in instance network info cache for port bf29f8cc-1793-457b-a4a6-8158d048eac9. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:57:52 user nova-compute[74669]: DEBUG nova.network.neutron [req-22ab7980-a72e-4017-b52f-f8c5244ed4ca req-edc8fc8b-9270-4eee-9baf-6660aa25842a service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Updating instance_info_cache with network_info: [{"id": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "address": "fa:16:3e:36:41:2f", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29f8cc-17", "ovs_interfaceid": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:57:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-22ab7980-a72e-4017-b52f-f8c5244ed4ca req-edc8fc8b-9270-4eee-9baf-6660aa25842a service nova] Releasing lock "refresh_cache-0829b734-daec-4dc6-b24b-cbe89000160c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:57:53 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Successfully created port: 1e4adfe0-b13d-49ae-8766-5e4dfe754427 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:57:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "0829b734-daec-4dc6-b24b-cbe89000160c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:57:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "0829b734-daec-4dc6-b24b-cbe89000160c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:57:53 user nova-compute[74669]: INFO nova.compute.manager [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Detaching volume 081598cb-5af2-45bf-b15f-cfc2ff95f630
Nov 08 16:57:53 user nova-compute[74669]: INFO nova.virt.block_device [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Attempting to driver detach volume 081598cb-5af2-45bf-b15f-cfc2ff95f630 from mountpoint /dev/vdb
Nov 08 16:57:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Attempting to detach device vdb from instance 0829b734-daec-4dc6-b24b-cbe89000160c from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 16:57:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 16:57:53 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:57:53 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 16:57:53 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:57:53 user nova-compute[74669]:   <serial>081598cb-5af2-45bf-b15f-cfc2ff95f630</serial>
Nov 08 16:57:53 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 16:57:53 user nova-compute[74669]: </disk>
Nov 08 16:57:53 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 16:57:53 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Successfully detached device vdb from instance 0829b734-daec-4dc6-b24b-cbe89000160c from the persistent domain config.
Nov 08 16:57:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0829b734-daec-4dc6-b24b-cbe89000160c from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 16:57:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 16:57:53 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:57:53 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 16:57:53 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 16:57:53 user nova-compute[74669]:   <serial>081598cb-5af2-45bf-b15f-cfc2ff95f630</serial>
Nov 08 16:57:53 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 16:57:53 user nova-compute[74669]: </disk>
Nov 08 16:57:53 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 16:57:53 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Successfully created port: 898bcd3e-b90e-493b-904a-5f533757c60e {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:57:53 user nova-compute[74669]: DEBUG nova.compute.manager [req-8ff1773c-97d0-4c95-8078-8c8af859c31a req-22678d2a-ea00-4bff-a84e-299bdf31efe1 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received event network-changed-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:57:53 user nova-compute[74669]: DEBUG nova.compute.manager [req-8ff1773c-97d0-4c95-8078-8c8af859c31a req-22678d2a-ea00-4bff-a84e-299bdf31efe1 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Refreshing instance network info cache due to event network-changed-bf29f8cc-1793-457b-a4a6-8158d048eac9. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:57:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8ff1773c-97d0-4c95-8078-8c8af859c31a req-22678d2a-ea00-4bff-a84e-299bdf31efe1 service nova] Acquiring lock "refresh_cache-0829b734-daec-4dc6-b24b-cbe89000160c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:57:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8ff1773c-97d0-4c95-8078-8c8af859c31a req-22678d2a-ea00-4bff-a84e-299bdf31efe1 service nova] Acquired lock "refresh_cache-0829b734-daec-4dc6-b24b-cbe89000160c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:57:53 user nova-compute[74669]: DEBUG nova.network.neutron [req-8ff1773c-97d0-4c95-8078-8c8af859c31a req-22678d2a-ea00-4bff-a84e-299bdf31efe1 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Refreshing network info cache for port bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:57:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0829b734-daec-4dc6-b24b-cbe89000160c {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 16:57:54 user nova-compute[74669]: DEBUG nova.network.neutron [req-8ff1773c-97d0-4c95-8078-8c8af859c31a req-22678d2a-ea00-4bff-a84e-299bdf31efe1 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Updated VIF entry in instance network info cache for port bf29f8cc-1793-457b-a4a6-8158d048eac9. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:57:54 user nova-compute[74669]: DEBUG nova.network.neutron [req-8ff1773c-97d0-4c95-8078-8c8af859c31a req-22678d2a-ea00-4bff-a84e-299bdf31efe1 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Updating instance_info_cache with network_info: [{"id": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "address": "fa:16:3e:36:41:2f", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29f8cc-17", "ovs_interfaceid": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:57:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8ff1773c-97d0-4c95-8078-8c8af859c31a req-22678d2a-ea00-4bff-a84e-299bdf31efe1 service nova] Releasing lock "refresh_cache-0829b734-daec-4dc6-b24b-cbe89000160c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:57:54 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Successfully updated port: 314df0da-c133-46af-bdc1-a317e71ca069 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:57:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-87d85781-a278-4509-9359-0058ba465dd3 req-b7359787-2727-429c-b61c-5501314e4fac service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-changed-314df0da-c133-46af-bdc1-a317e71ca069 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:57:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-87d85781-a278-4509-9359-0058ba465dd3 req-b7359787-2727-429c-b61c-5501314e4fac service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Refreshing instance network info cache due to event network-changed-314df0da-c133-46af-bdc1-a317e71ca069. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:57:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-87d85781-a278-4509-9359-0058ba465dd3 req-b7359787-2727-429c-b61c-5501314e4fac service nova] Acquiring lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:57:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-87d85781-a278-4509-9359-0058ba465dd3 req-b7359787-2727-429c-b61c-5501314e4fac service nova] Acquired lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:57:54 user nova-compute[74669]: DEBUG nova.network.neutron [req-87d85781-a278-4509-9359-0058ba465dd3 req-b7359787-2727-429c-b61c-5501314e4fac service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Refreshing network info cache for port 314df0da-c133-46af-bdc1-a317e71ca069 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:57:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:54 user nova-compute[74669]: DEBUG nova.network.neutron [req-87d85781-a278-4509-9359-0058ba465dd3 req-b7359787-2727-429c-b61c-5501314e4fac service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:57:54 user nova-compute[74669]: DEBUG nova.network.neutron [req-87d85781-a278-4509-9359-0058ba465dd3 req-b7359787-2727-429c-b61c-5501314e4fac service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:57:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-87d85781-a278-4509-9359-0058ba465dd3 req-b7359787-2727-429c-b61c-5501314e4fac service nova] Releasing lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:57:55 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Successfully updated port: 98dcc41a-801d-4934-8069-75d814493170 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:57:56 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Successfully updated port: 3416a767-03a6-4f75-8b8b-979eed5ddabe {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:57:56 user nova-compute[74669]: DEBUG nova.compute.manager [req-ab2a7040-9a41-40a0-86b0-caa8e952e0c8 req-818df6b4-2da2-4f1d-b71e-4f6f87c01427 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-changed-98dcc41a-801d-4934-8069-75d814493170 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:57:56 user nova-compute[74669]: DEBUG nova.compute.manager [req-ab2a7040-9a41-40a0-86b0-caa8e952e0c8 req-818df6b4-2da2-4f1d-b71e-4f6f87c01427 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Refreshing instance network info cache due to event network-changed-98dcc41a-801d-4934-8069-75d814493170. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:57:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ab2a7040-9a41-40a0-86b0-caa8e952e0c8 req-818df6b4-2da2-4f1d-b71e-4f6f87c01427 service nova] Acquiring lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:57:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ab2a7040-9a41-40a0-86b0-caa8e952e0c8 req-818df6b4-2da2-4f1d-b71e-4f6f87c01427 service nova] Acquired lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:57:56 user nova-compute[74669]: DEBUG nova.network.neutron [req-ab2a7040-9a41-40a0-86b0-caa8e952e0c8 req-818df6b4-2da2-4f1d-b71e-4f6f87c01427 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Refreshing network info cache for port 98dcc41a-801d-4934-8069-75d814493170 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:57:56 user nova-compute[74669]: DEBUG nova.network.neutron [req-ab2a7040-9a41-40a0-86b0-caa8e952e0c8 req-818df6b4-2da2-4f1d-b71e-4f6f87c01427 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:57:57 user nova-compute[74669]: DEBUG nova.network.neutron [req-ab2a7040-9a41-40a0-86b0-caa8e952e0c8 req-818df6b4-2da2-4f1d-b71e-4f6f87c01427 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:57:57 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Successfully updated port: 82aa3c9f-7823-4948-9496-449cb8e12f0b {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:57:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ab2a7040-9a41-40a0-86b0-caa8e952e0c8 req-818df6b4-2da2-4f1d-b71e-4f6f87c01427 service nova] Releasing lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:57:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-ab2a7040-9a41-40a0-86b0-caa8e952e0c8 req-818df6b4-2da2-4f1d-b71e-4f6f87c01427 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-changed-3416a767-03a6-4f75-8b8b-979eed5ddabe {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:57:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-ab2a7040-9a41-40a0-86b0-caa8e952e0c8 req-818df6b4-2da2-4f1d-b71e-4f6f87c01427 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Refreshing instance network info cache due to event network-changed-3416a767-03a6-4f75-8b8b-979eed5ddabe. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:57:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ab2a7040-9a41-40a0-86b0-caa8e952e0c8 req-818df6b4-2da2-4f1d-b71e-4f6f87c01427 service nova] Acquiring lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:57:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ab2a7040-9a41-40a0-86b0-caa8e952e0c8 req-818df6b4-2da2-4f1d-b71e-4f6f87c01427 service nova] Acquired lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:57:57 user nova-compute[74669]: DEBUG nova.network.neutron [req-ab2a7040-9a41-40a0-86b0-caa8e952e0c8 req-818df6b4-2da2-4f1d-b71e-4f6f87c01427 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Refreshing network info cache for port 3416a767-03a6-4f75-8b8b-979eed5ddabe {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:57:57 user nova-compute[74669]: DEBUG nova.network.neutron [req-ab2a7040-9a41-40a0-86b0-caa8e952e0c8 req-818df6b4-2da2-4f1d-b71e-4f6f87c01427 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:57:57 user nova-compute[74669]: DEBUG nova.network.neutron [req-ab2a7040-9a41-40a0-86b0-caa8e952e0c8 req-818df6b4-2da2-4f1d-b71e-4f6f87c01427 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:57:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ab2a7040-9a41-40a0-86b0-caa8e952e0c8 req-818df6b4-2da2-4f1d-b71e-4f6f87c01427 service nova] Releasing lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:57:57 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Successfully updated port: f1dac6ca-fd45-42d7-9f01-32891331b7ba {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:57:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:58 user nova-compute[74669]: DEBUG nova.compute.manager [req-dc38bc12-49ae-4014-9ff5-dc6dbf2ff4bd req-9f3f0f3c-eff4-473e-90b2-9d07c8748da4 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-changed-82aa3c9f-7823-4948-9496-449cb8e12f0b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:57:58 user nova-compute[74669]: DEBUG nova.compute.manager [req-dc38bc12-49ae-4014-9ff5-dc6dbf2ff4bd req-9f3f0f3c-eff4-473e-90b2-9d07c8748da4 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Refreshing instance network info cache due to event network-changed-82aa3c9f-7823-4948-9496-449cb8e12f0b. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:57:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-dc38bc12-49ae-4014-9ff5-dc6dbf2ff4bd req-9f3f0f3c-eff4-473e-90b2-9d07c8748da4 service nova] Acquiring lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:57:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-dc38bc12-49ae-4014-9ff5-dc6dbf2ff4bd req-9f3f0f3c-eff4-473e-90b2-9d07c8748da4 service nova] Acquired lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:57:58 user nova-compute[74669]: DEBUG nova.network.neutron [req-dc38bc12-49ae-4014-9ff5-dc6dbf2ff4bd req-9f3f0f3c-eff4-473e-90b2-9d07c8748da4 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Refreshing network info cache for port 82aa3c9f-7823-4948-9496-449cb8e12f0b {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:57:58 user nova-compute[74669]: DEBUG nova.network.neutron [req-dc38bc12-49ae-4014-9ff5-dc6dbf2ff4bd req-9f3f0f3c-eff4-473e-90b2-9d07c8748da4 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:57:59 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Successfully updated port: 1e4adfe0-b13d-49ae-8766-5e4dfe754427 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:57:59 user nova-compute[74669]: DEBUG nova.network.neutron [req-dc38bc12-49ae-4014-9ff5-dc6dbf2ff4bd req-9f3f0f3c-eff4-473e-90b2-9d07c8748da4 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:57:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-dc38bc12-49ae-4014-9ff5-dc6dbf2ff4bd req-9f3f0f3c-eff4-473e-90b2-9d07c8748da4 service nova] Releasing lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:57:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-dc38bc12-49ae-4014-9ff5-dc6dbf2ff4bd req-9f3f0f3c-eff4-473e-90b2-9d07c8748da4 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-changed-f1dac6ca-fd45-42d7-9f01-32891331b7ba {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:57:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-dc38bc12-49ae-4014-9ff5-dc6dbf2ff4bd req-9f3f0f3c-eff4-473e-90b2-9d07c8748da4 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Refreshing instance network info cache due to event network-changed-f1dac6ca-fd45-42d7-9f01-32891331b7ba. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:57:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-dc38bc12-49ae-4014-9ff5-dc6dbf2ff4bd req-9f3f0f3c-eff4-473e-90b2-9d07c8748da4 service nova] Acquiring lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:57:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-dc38bc12-49ae-4014-9ff5-dc6dbf2ff4bd req-9f3f0f3c-eff4-473e-90b2-9d07c8748da4 service nova] Acquired lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:57:59 user nova-compute[74669]: DEBUG nova.network.neutron [req-dc38bc12-49ae-4014-9ff5-dc6dbf2ff4bd req-9f3f0f3c-eff4-473e-90b2-9d07c8748da4 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Refreshing network info cache for port f1dac6ca-fd45-42d7-9f01-32891331b7ba {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:57:59 user nova-compute[74669]: DEBUG nova.network.neutron [req-dc38bc12-49ae-4014-9ff5-dc6dbf2ff4bd req-9f3f0f3c-eff4-473e-90b2-9d07c8748da4 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:57:59 user nova-compute[74669]: DEBUG nova.network.neutron [req-dc38bc12-49ae-4014-9ff5-dc6dbf2ff4bd req-9f3f0f3c-eff4-473e-90b2-9d07c8748da4 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:57:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-dc38bc12-49ae-4014-9ff5-dc6dbf2ff4bd req-9f3f0f3c-eff4-473e-90b2-9d07c8748da4 service nova] Releasing lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:57:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:57:59 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Successfully updated port: 898bcd3e-b90e-493b-904a-5f533757c60e {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:57:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Acquiring lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:57:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Acquired lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:57:59 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:57:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-ac9cd3d0-30a0-44aa-bce3-9212987bbcc5 req-3f893fe9-4493-4582-8ffc-b2602a8facc1 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-changed-898bcd3e-b90e-493b-904a-5f533757c60e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:57:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-ac9cd3d0-30a0-44aa-bce3-9212987bbcc5 req-3f893fe9-4493-4582-8ffc-b2602a8facc1 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Refreshing instance network info cache due to event network-changed-898bcd3e-b90e-493b-904a-5f533757c60e. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:57:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ac9cd3d0-30a0-44aa-bce3-9212987bbcc5 req-3f893fe9-4493-4582-8ffc-b2602a8facc1 service nova] Acquiring lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:58:00 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:58:00 user nova-compute[74669]: DEBUG nova.compute.manager [req-10cdf150-45d4-47d6-9d38-77aa96a858b5 req-d78f9040-9f64-4cfb-a650-e5eac1a151ce service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-changed-1e4adfe0-b13d-49ae-8766-5e4dfe754427 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:58:00 user nova-compute[74669]: DEBUG nova.compute.manager [req-10cdf150-45d4-47d6-9d38-77aa96a858b5 req-d78f9040-9f64-4cfb-a650-e5eac1a151ce service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Refreshing instance network info cache due to event network-changed-1e4adfe0-b13d-49ae-8766-5e4dfe754427. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:58:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-10cdf150-45d4-47d6-9d38-77aa96a858b5 req-d78f9040-9f64-4cfb-a650-e5eac1a151ce service nova] Acquiring lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:58:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Updating instance_info_cache with network_info: [{"id": "314df0da-c133-46af-bdc1-a317e71ca069", "address": "fa:16:3e:c4:c1:5b", "network": {"id": "ee33eeed-0f37-4f56-aa18-e6c986e10eb7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-786579928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314df0da-c1", "ovs_interfaceid": "314df0da-c133-46af-bdc1-a317e71ca069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98dcc41a-801d-4934-8069-75d814493170", "address": "fa:16:3e:4a:0a:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98dcc41a-80", "ovs_interfaceid": "98dcc41a-801d-4934-8069-75d814493170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "address": "fa:16:3e:9d:06:2c", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3416a767-03", "ovs_interfaceid": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "address": "fa:16:3e:a4:bd:59", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82aa3c9f-78", "ovs_interfaceid": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "address": "fa:16:3e:c3:25:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dac6ca-fd", "ovs_interfaceid": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "address": "fa:16:3e:6a:5e:82", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4adfe0-b1", "ovs_interfaceid": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "898bcd3e-b90e-493b-904a-5f533757c60e", "address": "fa:16:3e:b3:e6:5a", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898bcd3e-b9", "ovs_interfaceid": "898bcd3e-b90e-493b-904a-5f533757c60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:58:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Releasing lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:58:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Instance network_info: |[{"id": "314df0da-c133-46af-bdc1-a317e71ca069", "address": "fa:16:3e:c4:c1:5b", "network": {"id": "ee33eeed-0f37-4f56-aa18-e6c986e10eb7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-786579928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314df0da-c1", "ovs_interfaceid": "314df0da-c133-46af-bdc1-a317e71ca069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98dcc41a-801d-4934-8069-75d814493170", "address": "fa:16:3e:4a:0a:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98dcc41a-80", "ovs_interfaceid": "98dcc41a-801d-4934-8069-75d814493170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "address": "fa:16:3e:9d:06:2c", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3416a767-03", "ovs_interfaceid": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "address": "fa:16:3e:a4:bd:59", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82aa3c9f-78", "ovs_interfaceid": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "address": "fa:16:3e:c3:25:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dac6ca-fd", "ovs_interfaceid": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "address": "fa:16:3e:6a:5e:82", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4adfe0-b1", "ovs_interfaceid": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "898bcd3e-b90e-493b-904a-5f533757c60e", "address": "fa:16:3e:b3:e6:5a", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898bcd3e-b9", "ovs_interfaceid": "898bcd3e-b90e-493b-904a-5f533757c60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 16:58:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ac9cd3d0-30a0-44aa-bce3-9212987bbcc5 req-3f893fe9-4493-4582-8ffc-b2602a8facc1 service nova] Acquired lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:58:01 user nova-compute[74669]: DEBUG nova.network.neutron [req-ac9cd3d0-30a0-44aa-bce3-9212987bbcc5 req-3f893fe9-4493-4582-8ffc-b2602a8facc1 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Refreshing network info cache for port 898bcd3e-b90e-493b-904a-5f533757c60e {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:58:02 user nova-compute[74669]: DEBUG nova.network.neutron [req-ac9cd3d0-30a0-44aa-bce3-9212987bbcc5 req-3f893fe9-4493-4582-8ffc-b2602a8facc1 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Updated VIF entry in instance network info cache for port 898bcd3e-b90e-493b-904a-5f533757c60e. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:58:02 user nova-compute[74669]: DEBUG nova.network.neutron [req-ac9cd3d0-30a0-44aa-bce3-9212987bbcc5 req-3f893fe9-4493-4582-8ffc-b2602a8facc1 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Updating instance_info_cache with network_info: [{"id": "314df0da-c133-46af-bdc1-a317e71ca069", "address": "fa:16:3e:c4:c1:5b", "network": {"id": "ee33eeed-0f37-4f56-aa18-e6c986e10eb7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-786579928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314df0da-c1", "ovs_interfaceid": "314df0da-c133-46af-bdc1-a317e71ca069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98dcc41a-801d-4934-8069-75d814493170", "address": "fa:16:3e:4a:0a:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98dcc41a-80", "ovs_interfaceid": "98dcc41a-801d-4934-8069-75d814493170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "address": "fa:16:3e:9d:06:2c", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3416a767-03", "ovs_interfaceid": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "address": "fa:16:3e:a4:bd:59", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82aa3c9f-78", "ovs_interfaceid": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "address": "fa:16:3e:c3:25:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dac6ca-fd", "ovs_interfaceid": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "address": "fa:16:3e:6a:5e:82", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4adfe0-b1", "ovs_interfaceid": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "898bcd3e-b90e-493b-904a-5f533757c60e", "address": "fa:16:3e:b3:e6:5a", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898bcd3e-b9", "ovs_interfaceid": "898bcd3e-b90e-493b-904a-5f533757c60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:58:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ac9cd3d0-30a0-44aa-bce3-9212987bbcc5 req-3f893fe9-4493-4582-8ffc-b2602a8facc1 service nova] Releasing lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:58:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-10cdf150-45d4-47d6-9d38-77aa96a858b5 req-d78f9040-9f64-4cfb-a650-e5eac1a151ce service nova] Acquired lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:58:02 user nova-compute[74669]: DEBUG nova.network.neutron [req-10cdf150-45d4-47d6-9d38-77aa96a858b5 req-d78f9040-9f64-4cfb-a650-e5eac1a151ce service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Refreshing network info cache for port 1e4adfe0-b13d-49ae-8766-5e4dfe754427 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:58:02 user nova-compute[74669]: DEBUG nova.network.neutron [req-10cdf150-45d4-47d6-9d38-77aa96a858b5 req-d78f9040-9f64-4cfb-a650-e5eac1a151ce service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Updated VIF entry in instance network info cache for port 1e4adfe0-b13d-49ae-8766-5e4dfe754427. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:58:02 user nova-compute[74669]: DEBUG nova.network.neutron [req-10cdf150-45d4-47d6-9d38-77aa96a858b5 req-d78f9040-9f64-4cfb-a650-e5eac1a151ce service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Updating instance_info_cache with network_info: [{"id": "314df0da-c133-46af-bdc1-a317e71ca069", "address": "fa:16:3e:c4:c1:5b", "network": {"id": "ee33eeed-0f37-4f56-aa18-e6c986e10eb7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-786579928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314df0da-c1", "ovs_interfaceid": "314df0da-c133-46af-bdc1-a317e71ca069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98dcc41a-801d-4934-8069-75d814493170", "address": "fa:16:3e:4a:0a:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98dcc41a-80", "ovs_interfaceid": "98dcc41a-801d-4934-8069-75d814493170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "address": "fa:16:3e:9d:06:2c", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3416a767-03", "ovs_interfaceid": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "address": "fa:16:3e:a4:bd:59", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82aa3c9f-78", "ovs_interfaceid": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "address": "fa:16:3e:c3:25:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dac6ca-fd", "ovs_interfaceid": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "address": "fa:16:3e:6a:5e:82", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4adfe0-b1", "ovs_interfaceid": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "898bcd3e-b90e-493b-904a-5f533757c60e", "address": "fa:16:3e:b3:e6:5a", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898bcd3e-b9", "ovs_interfaceid": "898bcd3e-b90e-493b-904a-5f533757c60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:58:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-10cdf150-45d4-47d6-9d38-77aa96a858b5 req-d78f9040-9f64-4cfb-a650-e5eac1a151ce service nova] Releasing lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:58:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:14 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0829b734-daec-4dc6-b24b-cbe89000160c is timed out.
Nov 08 16:58:14 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Successfully detached device vdb from instance 0829b734-daec-4dc6-b24b-cbe89000160c from the live domain config.
Nov 08 16:58:14 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rQHpYXey', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:58:14 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:58:14 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[da13b4e9-f68d-4da0-aa89-19f933f4b883]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 16:58:14 user nova-compute[74669]: No targets found.
Nov 08 16:58:14 user nova-compute[74669]: iSNS:
Nov 08 16:58:14 user nova-compute[74669]: No targets found.
Nov 08 16:58:14 user nova-compute[74669]: STATIC:
Nov 08 16:58:14 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263
Nov 08 16:58:14 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:58:14 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:58:14 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630
Nov 08 16:58:14 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:58:14 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:58:14 user nova-compute[74669]: FIRMWARE:
Nov 08 16:58:14 user nova-compute[74669]: No targets found.
Nov 08 16:58:14 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 16:58:14 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 16:58:14 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc13625e-a693-4504-a901-564d16f9372e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88ce94c-4713-415f-b33c-aecc228ed88d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:58:14 user nova-compute[74669]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:58:14 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 (non-flash)
Nov 08 16:58:14 user nova-compute[74669]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:58:14 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd984531ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630'): ({'sdc'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Removing single pathed devices sdc {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbb2055-dc0a-47a8-be67-59287772bfc5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4dd64e-44f1-4d63-ae21-359208010a76]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Flushing IO for device /dev/sdc {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9347fa65-8f63-4c5b-b247-fd1adf0b999b]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d5403e-bc59-404a-a0bc-5665e80f16b7]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7133901-08c8-4f49-8872-4c024f9d6d53]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58511aa-e95c-4abd-a728-1890d0448a30]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630, portal: 172.16.0.220,3260]
Nov 08 16:58:14 user nova-compute[74669]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630, portal: 172.16.0.220,3260] successful.
Nov 08 16:58:14 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081598cb-5af2-45bf-b15f-cfc2ff95f630 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c2217c-1922-471b-92e5-c0aa7ea566f7]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] <== disconnect_volume: return (305ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 16:58:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:58:15 user nova-compute[74669]: DEBUG nova.objects.instance [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lazy-loading 'flavor' on Instance uuid 0829b734-daec-4dc6-b24b-cbe89000160c {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:58:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b6b734df-f4ab-47cf-8289-f27fa60aa323 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "0829b734-daec-4dc6-b24b-cbe89000160c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.064s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:16 user nova-compute[74669]: INFO nova.compute.manager [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Terminating instance
Nov 08 16:58:16 user nova-compute[74669]: DEBUG nova.compute.manager [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG nova.compute.manager [req-f5324150-21c2-4614-8bb0-80873bdb54eb req-f5a41ade-6059-47c3-afeb-bc99c9a881e3 service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Received event network-vif-unplugged-23885293-c9aa-41f9-a4b3-1d2fe6a5819e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f5324150-21c2-4614-8bb0-80873bdb54eb req-f5a41ade-6059-47c3-afeb-bc99c9a881e3 service nova] Acquiring lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f5324150-21c2-4614-8bb0-80873bdb54eb req-f5a41ade-6059-47c3-afeb-bc99c9a881e3 service nova] Lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f5324150-21c2-4614-8bb0-80873bdb54eb req-f5a41ade-6059-47c3-afeb-bc99c9a881e3 service nova] Lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG nova.compute.manager [req-f5324150-21c2-4614-8bb0-80873bdb54eb req-f5a41ade-6059-47c3-afeb-bc99c9a881e3 service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] No waiting events found dispatching network-vif-unplugged-23885293-c9aa-41f9-a4b3-1d2fe6a5819e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG nova.compute.manager [req-f5324150-21c2-4614-8bb0-80873bdb54eb req-f5a41ade-6059-47c3-afeb-bc99c9a881e3 service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Received event network-vif-unplugged-23885293-c9aa-41f9-a4b3-1d2fe6a5819e for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 16:58:16 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Instance destroyed successfully.
Nov 08 16:58:16 user nova-compute[74669]: DEBUG nova.objects.instance [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lazy-loading 'resources' on Instance uuid 2d42d5ce-db73-40e6-9b35-f662a3cf0091 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:51:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-57229404',display_name='tempest-VolumesAdminNegativeTest-server-57229404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-57229404',id=7,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3YJ5XuS1oUI5EPebNprylxsR9cbC3Q6iKMmc2IZ/6rbdt4c08IqjeUv+zoFgHpOhiltXfKjCmH2W9xYkvpnx+EAI8SEMuzsEXdl8lkDTY80GuG2JB4GHJBIFItq78LJg==',key_name='tempest-keypair-491670234',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:51:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6f55d1187334b6b9099a9fd647aa721',ramdisk_id='',reservation_id='r-c8e7k00d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1861077985',owner_user_name='tempest-VolumesAdminNegativeTest-1861077985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:51:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='420018de00394687bba8a1ca64ea51f3',uuid=2d42d5ce-db73-40e6-9b35-f662a3cf0091,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "address": "fa:16:3e:53:bc:e0", "network": {"id": "387522d7-947f-4a57-b80b-cefb0257df3e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-177095636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6f55d1187334b6b9099a9fd647aa721", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23885293-c9", "ovs_interfaceid": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Converting VIF {"id": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "address": "fa:16:3e:53:bc:e0", "network": {"id": "387522d7-947f-4a57-b80b-cefb0257df3e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-177095636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6f55d1187334b6b9099a9fd647aa721", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23885293-c9", "ovs_interfaceid": "23885293-c9aa-41f9-a4b3-1d2fe6a5819e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:bc:e0,bridge_name='br-int',has_traffic_filtering=True,id=23885293-c9aa-41f9-a4b3-1d2fe6a5819e,network=Network(387522d7-947f-4a57-b80b-cefb0257df3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23885293-c9') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG os_vif [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:bc:e0,bridge_name='br-int',has_traffic_filtering=True,id=23885293-c9aa-41f9-a4b3-1d2fe6a5819e,network=Network(387522d7-947f-4a57-b80b-cefb0257df3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23885293-c9') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23885293-c9, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c6e9478-faf0-4f72-9f3c-3eccd294c183) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:58:16 user nova-compute[74669]: INFO os_vif [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:bc:e0,bridge_name='br-int',has_traffic_filtering=True,id=23885293-c9aa-41f9-a4b3-1d2fe6a5819e,network=Network(387522d7-947f-4a57-b80b-cefb0257df3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23885293-c9')
Nov 08 16:58:16 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Deleting instance files /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091_del
Nov 08 16:58:16 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Deletion of /opt/stack/data/nova/instances/2d42d5ce-db73-40e6-9b35-f662a3cf0091_del complete
Nov 08 16:58:17 user nova-compute[74669]: INFO nova.virt.block_device [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Booting with volume 3270c5a2-1029-4533-9b41-5c9fb2b0ba55 at /dev/vdb
Nov 08 16:58:17 user nova-compute[74669]: INFO nova.compute.manager [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 08 16:58:17 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG os_brick.utils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8389ef-8f70-4607-9b1b-eb66d9d18d75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c83cab-98f6-4a7e-9bdb-6d9adbb62ac0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c2528c-8070-473d-842e-091412fb734d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[af34ad28-b538-4be2-992c-b509b070afe4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:58:17 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 16:58:17 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[497d770f-9596-4ec3-9567-1adeb3644db1]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG os_brick.utils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Updating existing volume attachment record: 5de4d1e8-6de1-4f32-bbbb-a4c05bf7dd1f {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:58:17 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Took 0.80 seconds to deallocate network for instance.
Nov 08 16:58:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-f4948a67-db73-4abe-ad50-20d109837257 req-aae98af3-c5ae-40dd-876d-207924fa911d service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Received event network-vif-deleted-23885293-c9aa-41f9-a4b3-1d2fe6a5819e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:58:17 user nova-compute[74669]: INFO nova.compute.manager [req-f4948a67-db73-4abe-ad50-20d109837257 req-aae98af3-c5ae-40dd-876d-207924fa911d service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Neutron deleted interface 23885293-c9aa-41f9-a4b3-1d2fe6a5819e; detaching it from the instance and deleting it from the info cache
Nov 08 16:58:17 user nova-compute[74669]: DEBUG nova.network.neutron [req-f4948a67-db73-4abe-ad50-20d109837257 req-aae98af3-c5ae-40dd-876d-207924fa911d service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-f4948a67-db73-4abe-ad50-20d109837257 req-aae98af3-c5ae-40dd-876d-207924fa911d service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Detach interface failed, port_id=23885293-c9aa-41f9-a4b3-1d2fe6a5819e, reason: Instance 2d42d5ce-db73-40e6-9b35-f662a3cf0091 could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:18 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:58:18 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:58:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:18 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Deleted allocations for instance 2d42d5ce-db73-40e6-9b35-f662a3cf0091
Nov 08 16:58:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-537fa15a-44ac-45ff-8471-84b987063ddb tempest-VolumesAdminNegativeTest-1861077985 tempest-VolumesAdminNegativeTest-1861077985-project-member] Lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.372s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:18 user nova-compute[74669]: DEBUG nova.compute.manager [req-4517ad3c-5e9b-4f9b-bef3-92b691ea3bd4 req-e05d8787-94cc-4567-9201-04c2c86c09eb service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Received event network-vif-plugged-23885293-c9aa-41f9-a4b3-1d2fe6a5819e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:58:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4517ad3c-5e9b-4f9b-bef3-92b691ea3bd4 req-e05d8787-94cc-4567-9201-04c2c86c09eb service nova] Acquiring lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4517ad3c-5e9b-4f9b-bef3-92b691ea3bd4 req-e05d8787-94cc-4567-9201-04c2c86c09eb service nova] Lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4517ad3c-5e9b-4f9b-bef3-92b691ea3bd4 req-e05d8787-94cc-4567-9201-04c2c86c09eb service nova] Lock "2d42d5ce-db73-40e6-9b35-f662a3cf0091-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:18 user nova-compute[74669]: DEBUG nova.compute.manager [req-4517ad3c-5e9b-4f9b-bef3-92b691ea3bd4 req-e05d8787-94cc-4567-9201-04c2c86c09eb service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] No waiting events found dispatching network-vif-plugged-23885293-c9aa-41f9-a4b3-1d2fe6a5819e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:58:18 user nova-compute[74669]: WARNING nova.compute.manager [req-4517ad3c-5e9b-4f9b-bef3-92b691ea3bd4 req-e05d8787-94cc-4567-9201-04c2c86c09eb service nova] [instance: 2d42d5ce-db73-40e6-9b35-f662a3cf0091] Received unexpected event network-vif-plugged-23885293-c9aa-41f9-a4b3-1d2fe6a5819e for instance with vm_state deleted and task_state None.
Nov 08 16:58:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:18 user nova-compute[74669]: INFO nova.compute.manager [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Terminating instance
Nov 08 16:58:18 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 16:58:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG nova.compute.manager [req-0c671a24-1d4e-4aa3-a498-6dcda4035469 req-e2ccac7f-a84c-42df-8547-be9b41fe77e4 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received event network-vif-unplugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0c671a24-1d4e-4aa3-a498-6dcda4035469 req-e2ccac7f-a84c-42df-8547-be9b41fe77e4 service nova] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0c671a24-1d4e-4aa3-a498-6dcda4035469 req-e2ccac7f-a84c-42df-8547-be9b41fe77e4 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0c671a24-1d4e-4aa3-a498-6dcda4035469 req-e2ccac7f-a84c-42df-8547-be9b41fe77e4 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG nova.compute.manager [req-0c671a24-1d4e-4aa3-a498-6dcda4035469 req-e2ccac7f-a84c-42df-8547-be9b41fe77e4 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] No waiting events found dispatching network-vif-unplugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG nova.compute.manager [req-0c671a24-1d4e-4aa3-a498-6dcda4035469 req-e2ccac7f-a84c-42df-8547-be9b41fe77e4 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received event network-vif-unplugged-18b88bab-9376-440a-94f0-478d193b35f5 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:19 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Instance destroyed successfully.
Nov 08 16:58:19 user nova-compute[74669]: DEBUG nova.objects.instance [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lazy-loading 'resources' on Instance uuid 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-293486561',display_name='tempest-ServerStableDeviceRescueTest-server-293486561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-293486561',id=1,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmu3Qb3c9l4i23U9c4l4qVC6jnYjQ9lJDCwk1SO6vmxzEZ5k3Eq2G3HcNjyCsmyUNDyUDS4LqNxryD+xx2cfvcvkOePH5phGWrbgtkBx3y3xYxDeeeP0zACi3EXNGPKUw==',key_name='tempest-keypair-1527492350',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:55:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa6ad206b6fa4cc099c08a01b051312c',ramdisk_id='',reservation_id='r-sr1uui35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2011852447',owner_user_name='tempest-ServerStableDeviceRescueTest-2011852447-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:57:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bce0d71611084f1694789c5f5cd695cf',uuid=45d48da2-85b1-4b7f-9661-8fe4e8346ca6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18b88bab-9376-440a-94f0-478d193b35f5", "address": "fa:16:3e:e0:5c:ca", "network": {"id": "7548ddaf-d550-41df-8f64-fc740e56fcd2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-954808146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa6ad206b6fa4cc099c08a01b051312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b88bab-93", "ovs_interfaceid": "18b88bab-9376-440a-94f0-478d193b35f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Converting VIF {"id": "18b88bab-9376-440a-94f0-478d193b35f5", "address": "fa:16:3e:e0:5c:ca", "network": {"id": "7548ddaf-d550-41df-8f64-fc740e56fcd2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-954808146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa6ad206b6fa4cc099c08a01b051312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18b88bab-93", "ovs_interfaceid": "18b88bab-9376-440a-94f0-478d193b35f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:5c:ca,bridge_name='br-int',has_traffic_filtering=True,id=18b88bab-9376-440a-94f0-478d193b35f5,network=Network(7548ddaf-d550-41df-8f64-fc740e56fcd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18b88bab-93') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG os_vif [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:5c:ca,bridge_name='br-int',has_traffic_filtering=True,id=18b88bab-9376-440a-94f0-478d193b35f5,network=Network(7548ddaf-d550-41df-8f64-fc740e56fcd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18b88bab-93') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18b88bab-93, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48f54c6a-4f05-46a4-a914-d5c23ec38f65) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:58:19 user nova-compute[74669]: INFO os_vif [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:5c:ca,bridge_name='br-int',has_traffic_filtering=True,id=18b88bab-9376-440a-94f0-478d193b35f5,network=Network(7548ddaf-d550-41df-8f64-fc740e56fcd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18b88bab-93')
Nov 08 16:58:19 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Deleting instance files /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6_del
Nov 08 16:58:19 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Deletion of /opt/stack/data/nova/instances/45d48da2-85b1-4b7f-9661-8fe4e8346ca6_del complete
Nov 08 16:58:19 user nova-compute[74669]: INFO nova.compute.manager [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 08 16:58:19 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 16:58:19 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 16:58:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG nova.compute.manager [req-155c3d99-5386-4d06-a4de-7fc2e071c9a2 req-bafa88df-d34a-41ef-bdd7-51bda7118793 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received event network-vif-deleted-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:58:21 user nova-compute[74669]: INFO nova.compute.manager [req-155c3d99-5386-4d06-a4de-7fc2e071c9a2 req-bafa88df-d34a-41ef-bdd7-51bda7118793 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Neutron deleted interface 18b88bab-9376-440a-94f0-478d193b35f5; detaching it from the instance and deleting it from the info cache
Nov 08 16:58:21 user nova-compute[74669]: DEBUG nova.network.neutron [req-155c3d99-5386-4d06-a4de-7fc2e071c9a2 req-bafa88df-d34a-41ef-bdd7-51bda7118793 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:58:21 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Took 1.22 seconds to deallocate network for instance.
Nov 08 16:58:21 user nova-compute[74669]: DEBUG nova.compute.manager [req-155c3d99-5386-4d06-a4de-7fc2e071c9a2 req-bafa88df-d34a-41ef-bdd7-51bda7118793 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Detach interface failed, port_id=18b88bab-9376-440a-94f0-478d193b35f5, reason: Instance 45d48da2-85b1-4b7f-9661-8fe4e8346ca6 could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG nova.compute.manager [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG nova.compute.manager [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] No waiting events found dispatching network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:58:21 user nova-compute[74669]: WARNING nova.compute.manager [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received unexpected event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 for instance with vm_state deleted and task_state None.
Nov 08 16:58:21 user nova-compute[74669]: DEBUG nova.compute.manager [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG nova.compute.manager [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] No waiting events found dispatching network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:58:21 user nova-compute[74669]: WARNING nova.compute.manager [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received unexpected event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 for instance with vm_state deleted and task_state None.
Nov 08 16:58:21 user nova-compute[74669]: DEBUG nova.compute.manager [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG nova.compute.manager [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] No waiting events found dispatching network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:58:21 user nova-compute[74669]: WARNING nova.compute.manager [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received unexpected event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 for instance with vm_state deleted and task_state None.
Nov 08 16:58:21 user nova-compute[74669]: DEBUG nova.compute.manager [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received event network-vif-unplugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG nova.compute.manager [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] No waiting events found dispatching network-vif-unplugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:58:21 user nova-compute[74669]: WARNING nova.compute.manager [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received unexpected event network-vif-unplugged-18b88bab-9376-440a-94f0-478d193b35f5 for instance with vm_state deleted and task_state None.
Nov 08 16:58:21 user nova-compute[74669]: DEBUG nova.compute.manager [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] Acquiring lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG nova.compute.manager [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] No waiting events found dispatching network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:58:21 user nova-compute[74669]: WARNING nova.compute.manager [req-3fe93052-98d2-41f2-aae9-0fe5c4fef6f6 req-7df3ca00-79bf-47c3-a689-aaf5fded7b59 service nova] [instance: 45d48da2-85b1-4b7f-9661-8fe4e8346ca6] Received unexpected event network-vif-plugged-18b88bab-9376-440a-94f0-478d193b35f5 for instance with vm_state deleted and task_state None.
Nov 08 16:58:21 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:58:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:21 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Deleted allocations for instance 45d48da2-85b1-4b7f-9661-8fe4e8346ca6
Nov 08 16:58:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e2c644b7-b770-471f-a309-8318c934e4ea tempest-ServerStableDeviceRescueTest-2011852447 tempest-ServerStableDeviceRescueTest-2011852447-project-member] Lock "45d48da2-85b1-4b7f-9661-8fe4e8346ca6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.734s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:32 user nova-compute[74669]: DEBUG nova.compute.manager [req-f6ddd43d-57ee-47ec-abf3-bff62a535fea req-ac2ed5b1-f369-4994-9a53-bab9eb2d4db1 service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Received event network-changed-9094cae8-f197-47d4-8ba3-8a1e274c3f04 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:58:32 user nova-compute[74669]: DEBUG nova.compute.manager [req-f6ddd43d-57ee-47ec-abf3-bff62a535fea req-ac2ed5b1-f369-4994-9a53-bab9eb2d4db1 service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Refreshing instance network info cache due to event network-changed-9094cae8-f197-47d4-8ba3-8a1e274c3f04. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:58:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f6ddd43d-57ee-47ec-abf3-bff62a535fea req-ac2ed5b1-f369-4994-9a53-bab9eb2d4db1 service nova] Acquiring lock "refresh_cache-1b9ad090-c7bb-4a11-a056-19902844dbf0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:58:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f6ddd43d-57ee-47ec-abf3-bff62a535fea req-ac2ed5b1-f369-4994-9a53-bab9eb2d4db1 service nova] Acquired lock "refresh_cache-1b9ad090-c7bb-4a11-a056-19902844dbf0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:58:32 user nova-compute[74669]: DEBUG nova.network.neutron [req-f6ddd43d-57ee-47ec-abf3-bff62a535fea req-ac2ed5b1-f369-4994-9a53-bab9eb2d4db1 service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Refreshing network info cache for port 9094cae8-f197-47d4-8ba3-8a1e274c3f04 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:58:32 user nova-compute[74669]: DEBUG nova.network.neutron [req-f6ddd43d-57ee-47ec-abf3-bff62a535fea req-ac2ed5b1-f369-4994-9a53-bab9eb2d4db1 service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Updated VIF entry in instance network info cache for port 9094cae8-f197-47d4-8ba3-8a1e274c3f04. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:58:32 user nova-compute[74669]: DEBUG nova.network.neutron [req-f6ddd43d-57ee-47ec-abf3-bff62a535fea req-ac2ed5b1-f369-4994-9a53-bab9eb2d4db1 service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Updating instance_info_cache with network_info: [{"id": "9094cae8-f197-47d4-8ba3-8a1e274c3f04", "address": "fa:16:3e:a1:4d:7a", "network": {"id": "3e057921-3f7f-4344-bd63-e80de5bbe2be", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1558760908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ba6ed05fa648a6ab7618d83d11a4a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9094cae8-f1", "ovs_interfaceid": "9094cae8-f197-47d4-8ba3-8a1e274c3f04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:58:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f6ddd43d-57ee-47ec-abf3-bff62a535fea req-ac2ed5b1-f369-4994-9a53-bab9eb2d4db1 service nova] Releasing lock "refresh_cache-1b9ad090-c7bb-4a11-a056-19902844dbf0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:58:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:33 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Port 47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 binding to destination host user is already ACTIVE {{(pid=74669) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 16:58:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:58:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquired lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:58:33 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:58:33 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Updating instance_info_cache with network_info: [{"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:58:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Releasing lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:58:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Creating tmpfile /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/tmpmlkc9jx5 to verify with other compute node that the instance is on the same shared storage. {{(pid=74669) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 08 16:58:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-1e06d034-5659-418e-a5e8-458be09f6c63 req-7d395d0e-e68f-4987-83fe-fa250a15d185 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received event network-vif-unplugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1e06d034-5659-418e-a5e8-458be09f6c63 req-7d395d0e-e68f-4987-83fe-fa250a15d185 service nova] Acquiring lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1e06d034-5659-418e-a5e8-458be09f6c63 req-7d395d0e-e68f-4987-83fe-fa250a15d185 service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1e06d034-5659-418e-a5e8-458be09f6c63 req-7d395d0e-e68f-4987-83fe-fa250a15d185 service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-1e06d034-5659-418e-a5e8-458be09f6c63 req-7d395d0e-e68f-4987-83fe-fa250a15d185 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] No waiting events found dispatching network-vif-unplugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:58:34 user nova-compute[74669]: WARNING nova.compute.manager [req-1e06d034-5659-418e-a5e8-458be09f6c63 req-7d395d0e-e68f-4987-83fe-fa250a15d185 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received unexpected event network-vif-unplugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 for instance with vm_state resized and task_state resize_reverting.
Nov 08 16:58:34 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Instance destroyed successfully.
Nov 08 16:58:34 user nova-compute[74669]: DEBUG nova.objects.instance [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lazy-loading 'resources' on Instance uuid b26dbeeb-b629-414d-bcca-cdde6c207789 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-82074997',display_name='tempest-ServerActionsTestOtherB-server-82074997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-82074997',id=5,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVVAiZ/J+loI4/5CGCEcHyBdao/VDdeBeozCcJvl0eh7qycgoJCVfo066fltlkQiowyw4815L1dFrqeYMGOPhwhd9fpfcyVQWgEILP3lJeo6lsJtZZ3WMWpczoYeL0t+w==',key_name='tempest-keypair-1692388907',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:57:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bc128b2ae524ce0aff2afb7301888bf',ramdisk_id='',reservation_id='r-fjmhrntp',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-839528249',owner_user_name='tempest-ServerActionsTestOtherB-839528249-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:57:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acb95477d6ba46d4be3b34280c5892e5',uuid=b26dbeeb-b629-414d-bcca-cdde6c207789,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Converting VIF {"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:33:ae,bridge_name='br-int',has_traffic_filtering=True,id=47c9314f-4ea9-49c3-9b34-2fb94cc1eac4,network=Network(35a879d8-439e-4ac4-a8ae-292e3b9a1966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9314f-4e') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG os_vif [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:33:ae,bridge_name='br-int',has_traffic_filtering=True,id=47c9314f-4ea9-49c3-9b34-2fb94cc1eac4,network=Network(35a879d8-439e-4ac4-a8ae-292e3b9a1966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9314f-4e') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47c9314f-4e, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45323e96-15bd-4269-ae65-e29b4956eea8) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:58:34 user nova-compute[74669]: INFO os_vif [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:33:ae,bridge_name='br-int',has_traffic_filtering=True,id=47c9314f-4ea9-49c3-9b34-2fb94cc1eac4,network=Network(35a879d8-439e-4ac4-a8ae-292e3b9a1966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9314f-4e')
Nov 08 16:58:34 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygTldqYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:58:34 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:58:34 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42a3fdd-e8f2-4051-8084-ffcd432dff8b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 16:58:34 user nova-compute[74669]: No targets found.
Nov 08 16:58:34 user nova-compute[74669]: iSNS:
Nov 08 16:58:34 user nova-compute[74669]: No targets found.
Nov 08 16:58:34 user nova-compute[74669]: STATIC:
Nov 08 16:58:34 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263
Nov 08 16:58:34 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 16:58:34 user nova-compute[74669]:                 Iface Name: default
Nov 08 16:58:34 user nova-compute[74669]: FIRMWARE:
Nov 08 16:58:34 user nova-compute[74669]: No targets found.
Nov 08 16:58:34 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 16:58:34 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 16:58:34 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f0ccc8-4902-4e15-9fb1-c754f95c252c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf42543-d49c-4493-af5d-c3fe3822da21]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:58:34 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:58:34 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd984585bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263'): ({'sdd'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Removing single pathed devices sdd {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[975c35a3-10bd-4f2c-bc01-c057f982de42]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdeffd52-5872-4920-ad74-4e37b4fbe2cf]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Flushing IO for device /dev/sdd {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75bad91-3205-4b19-abde-fda6c0418c82]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5d3835-a97d-4871-8b8e-37824e1e2bc3]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] SCSI volumes sdd have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcfe83d-85cf-4642-a281-3802ab5bbe72]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cb1990-3366-40e5-86a8-fa5e148ff820]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260]
Nov 08 16:58:34 user nova-compute[74669]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260] successful.
Nov 08 16:58:34 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcd65a5-14c3-43eb-b9fb-de4d47bfdc92]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] <== disconnect_volume: return (317ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:58:34 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 16:58:36 user nova-compute[74669]: DEBUG nova.compute.manager [req-20693cab-6d10-441b-8400-07659511fa9e req-f3092032-f7f2-4773-ab8e-b61e6b65963d service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received event network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:58:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-20693cab-6d10-441b-8400-07659511fa9e req-f3092032-f7f2-4773-ab8e-b61e6b65963d service nova] Acquiring lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-20693cab-6d10-441b-8400-07659511fa9e req-f3092032-f7f2-4773-ab8e-b61e6b65963d service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-20693cab-6d10-441b-8400-07659511fa9e req-f3092032-f7f2-4773-ab8e-b61e6b65963d service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:36 user nova-compute[74669]: DEBUG nova.compute.manager [req-20693cab-6d10-441b-8400-07659511fa9e req-f3092032-f7f2-4773-ab8e-b61e6b65963d service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] No waiting events found dispatching network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:58:36 user nova-compute[74669]: WARNING nova.compute.manager [req-20693cab-6d10-441b-8400-07659511fa9e req-f3092032-f7f2-4773-ab8e-b61e6b65963d service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received unexpected event network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 for instance with vm_state resized and task_state resize_reverting.
Nov 08 16:58:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:36 user nova-compute[74669]: DEBUG nova.objects.instance [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lazy-loading 'migration_context' on Instance uuid b26dbeeb-b629-414d-bcca-cdde6c207789 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:58:36 user nova-compute[74669]: DEBUG nova.objects.base [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Object Instance<b26dbeeb-b629-414d-bcca-cdde6c207789> lazy-loaded attributes: resources,migration_context {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 16:58:36 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:58:36 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:58:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.397s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:36 user nova-compute[74669]: INFO nova.compute.manager [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Swapping old allocation on dict_keys(['ce26964b-e55b-43d2-801a-7221ff1fe64b']) held by migration c2bca562-a8f7-4f0c-99ad-9347ae824001 for instance
Nov 08 16:58:36 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Overwriting current allocation {'allocations': {'ce26964b-e55b-43d2-801a-7221ff1fe64b': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 18}}, 'project_id': '9bc128b2ae524ce0aff2afb7301888bf', 'user_id': 'acb95477d6ba46d4be3b34280c5892e5', 'consumer_generation': 1} on consumer b26dbeeb-b629-414d-bcca-cdde6c207789 {{(pid=74669) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquired lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Updating instance_info_cache with network_info: [{"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Releasing lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG os_brick.utils [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d5a639-c6a8-48b9-906d-92d4de594429]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d7e474-acfb-4cf3-b4cf-fb5dd01f3ef0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34a25fa-4ada-4172-b774-82a03f1f7660]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc00f0aa-766d-4141-aae1-93096a4e6e6e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:58:37 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 16:58:37 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce86360f-cb6d-49b3-9013-c405c1d578ac]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 16:58:37 user nova-compute[74669]: DEBUG os_brick.utils [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:58:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "7b335462-0d93-4899-a223-5c2e36932578" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "7b335462-0d93-4899-a223-5c2e36932578" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:41 user nova-compute[74669]: DEBUG nova.compute.manager [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 16:58:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:42 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 16:58:42 user nova-compute[74669]: INFO nova.compute.claims [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Claim successful on node user
Nov 08 16:58:42 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:58:42 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:58:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:42 user nova-compute[74669]: DEBUG nova.compute.manager [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 16:58:42 user nova-compute[74669]: DEBUG nova.compute.manager [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 16:58:42 user nova-compute[74669]: DEBUG nova.network.neutron [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 16:58:42 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 16:58:42 user nova-compute[74669]: DEBUG nova.compute.manager [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 16:58:42 user nova-compute[74669]: DEBUG nova.policy [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e118c178ece2492bb2d975643c405196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b82c0c2cd480f96d155adf4f6de4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 16:58:42 user nova-compute[74669]: DEBUG nova.compute.manager [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 16:58:42 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 16:58:42 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Creating image(s)
Nov 08 16:58:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "/opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "/opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.200s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.202s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk 1073741824" returned: 0 in 0.130s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.338s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.222s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:43 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 16:58:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:43 user nova-compute[74669]: DEBUG nova.network.neutron [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Successfully created port: 9bfc353f-1fb9-412e-80c7-64b5a2ecc32c {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:58:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:43 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Cannot resize image /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 16:58:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 16:58:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Ensure instance console log exists: /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 16:58:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:44 user nova-compute[74669]: DEBUG nova.network.neutron [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Successfully updated port: 9bfc353f-1fb9-412e-80c7-64b5a2ecc32c {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:58:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:58:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquired lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:58:44 user nova-compute[74669]: DEBUG nova.network.neutron [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:58:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-1ed3988e-57e2-4b9c-9c1d-2062416977e2 req-e747e73e-c76a-457f-b87a-01f3d417f352 service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Received event network-changed-9bfc353f-1fb9-412e-80c7-64b5a2ecc32c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:58:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-1ed3988e-57e2-4b9c-9c1d-2062416977e2 req-e747e73e-c76a-457f-b87a-01f3d417f352 service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Refreshing instance network info cache due to event network-changed-9bfc353f-1fb9-412e-80c7-64b5a2ecc32c. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:58:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1ed3988e-57e2-4b9c-9c1d-2062416977e2 req-e747e73e-c76a-457f-b87a-01f3d417f352 service nova] Acquiring lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:58:44 user nova-compute[74669]: DEBUG nova.network.neutron [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:58:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:44 user nova-compute[74669]: DEBUG nova.network.neutron [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Updating instance_info_cache with network_info: [{"id": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "address": "fa:16:3e:e6:99:99", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bfc353f-1f", "ovs_interfaceid": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Releasing lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.compute.manager [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Instance network_info: |[{"id": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "address": "fa:16:3e:e6:99:99", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bfc353f-1f", "ovs_interfaceid": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1ed3988e-57e2-4b9c-9c1d-2062416977e2 req-e747e73e-c76a-457f-b87a-01f3d417f352 service nova] Acquired lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.network.neutron [req-1ed3988e-57e2-4b9c-9c1d-2062416977e2 req-e747e73e-c76a-457f-b87a-01f3d417f352 service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Refreshing network info cache for port 9bfc353f-1fb9-412e-80c7-64b5a2ecc32c {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Start _get_guest_xml network_info=[{"id": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "address": "fa:16:3e:e6:99:99", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bfc353f-1f", "ovs_interfaceid": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:58:45 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:58:45 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:58:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1362223684',display_name='tempest-ServerActionsTestOtherA-server-1362223684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1362223684',id=15,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVa16AMO6wxCfNzgZtwDGNOHyvTHwI2kbeRR1JWZMRp/+84NydbzrImNzwJFwUc5Mt6eRV8qh3XhhGBx3qjvshZcC9T6FOe5uxOhgTpdbBqJBGj5+jnhuvk7Bsl6Ed/tQ==',key_name='tempest-keypair-2114035891',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='766b82c0c2cd480f96d155adf4f6de4c',ramdisk_id='',reservation_id='r-chwzzwj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-23582724',owner_user_name='tempest-ServerActionsTestOtherA-23582724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:58:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e118c178ece2492bb2d975643c405196',uuid=7b335462-0d93-4899-a223-5c2e36932578,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "address": "fa:16:3e:e6:99:99", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bfc353f-1f", "ovs_interfaceid": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converting VIF {"id": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "address": "fa:16:3e:e6:99:99", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bfc353f-1f", "ovs_interfaceid": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:99:99,bridge_name='br-int',has_traffic_filtering=True,id=9bfc353f-1fb9-412e-80c7-64b5a2ecc32c,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bfc353f-1f') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.objects.instance [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b335462-0d93-4899-a223-5c2e36932578 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:58:45 user nova-compute[74669]:   <uuid>7b335462-0d93-4899-a223-5c2e36932578</uuid>
Nov 08 16:58:45 user nova-compute[74669]:   <name>instance-0000000f</name>
Nov 08 16:58:45 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:58:45 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:58:45 user nova-compute[74669]:   <metadata>
Nov 08 16:58:45 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:58:45 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:58:45 user nova-compute[74669]:       <nova:name>tempest-ServerActionsTestOtherA-server-1362223684</nova:name>
Nov 08 16:58:45 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:58:45</nova:creationTime>
Nov 08 16:58:45 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:58:45 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:58:45 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:58:45 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:58:45 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:58:45 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:58:45 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:58:45 user nova-compute[74669]:       <nova:owner>
Nov 08 16:58:45 user nova-compute[74669]:         <nova:user uuid="e118c178ece2492bb2d975643c405196">tempest-ServerActionsTestOtherA-23582724-project-member</nova:user>
Nov 08 16:58:45 user nova-compute[74669]:         <nova:project uuid="766b82c0c2cd480f96d155adf4f6de4c">tempest-ServerActionsTestOtherA-23582724</nova:project>
Nov 08 16:58:45 user nova-compute[74669]:       </nova:owner>
Nov 08 16:58:45 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:58:45 user nova-compute[74669]:       <nova:ports>
Nov 08 16:58:45 user nova-compute[74669]:         <nova:port uuid="9bfc353f-1fb9-412e-80c7-64b5a2ecc32c">
Nov 08 16:58:45 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 16:58:45 user nova-compute[74669]:         </nova:port>
Nov 08 16:58:45 user nova-compute[74669]:       </nova:ports>
Nov 08 16:58:45 user nova-compute[74669]:     </nova:instance>
Nov 08 16:58:45 user nova-compute[74669]:   </metadata>
Nov 08 16:58:45 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:58:45 user nova-compute[74669]:     <system>
Nov 08 16:58:45 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:58:45 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:58:45 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:58:45 user nova-compute[74669]:       <entry name="serial">7b335462-0d93-4899-a223-5c2e36932578</entry>
Nov 08 16:58:45 user nova-compute[74669]:       <entry name="uuid">7b335462-0d93-4899-a223-5c2e36932578</entry>
Nov 08 16:58:45 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:58:45 user nova-compute[74669]:     </system>
Nov 08 16:58:45 user nova-compute[74669]:   </sysinfo>
Nov 08 16:58:45 user nova-compute[74669]:   <os>
Nov 08 16:58:45 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:58:45 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 16:58:45 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:58:45 user nova-compute[74669]:   </os>
Nov 08 16:58:45 user nova-compute[74669]:   <features>
Nov 08 16:58:45 user nova-compute[74669]:     <acpi/>
Nov 08 16:58:45 user nova-compute[74669]:     <apic/>
Nov 08 16:58:45 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:58:45 user nova-compute[74669]:   </features>
Nov 08 16:58:45 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:58:45 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:58:45 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:58:45 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:58:45 user nova-compute[74669]:   </clock>
Nov 08 16:58:45 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:58:45 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:58:45 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:58:45 user nova-compute[74669]:   </cpu>
Nov 08 16:58:45 user nova-compute[74669]:   <devices>
Nov 08 16:58:45 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:58:45 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:58:45 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk"/>
Nov 08 16:58:45 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:58:45 user nova-compute[74669]:     </disk>
Nov 08 16:58:45 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:58:45 user nova-compute[74669]:       <mac address="fa:16:3e:e6:99:99"/>
Nov 08 16:58:45 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:58:45 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:58:45 user nova-compute[74669]:       <target dev="tap9bfc353f-1f"/>
Nov 08 16:58:45 user nova-compute[74669]:     </interface>
Nov 08 16:58:45 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:58:45 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/console.log" append="off"/>
Nov 08 16:58:45 user nova-compute[74669]:     </serial>
Nov 08 16:58:45 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:58:45 user nova-compute[74669]:     <video>
Nov 08 16:58:45 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:58:45 user nova-compute[74669]:     </video>
Nov 08 16:58:45 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:58:45 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:58:45 user nova-compute[74669]:     </rng>
Nov 08 16:58:45 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:58:45 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:58:45 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:58:45 user nova-compute[74669]:     </memballoon>
Nov 08 16:58:45 user nova-compute[74669]:   </devices>
Nov 08 16:58:45 user nova-compute[74669]: </domain>
Nov 08 16:58:45 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:58:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1362223684',display_name='tempest-ServerActionsTestOtherA-server-1362223684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1362223684',id=15,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVa16AMO6wxCfNzgZtwDGNOHyvTHwI2kbeRR1JWZMRp/+84NydbzrImNzwJFwUc5Mt6eRV8qh3XhhGBx3qjvshZcC9T6FOe5uxOhgTpdbBqJBGj5+jnhuvk7Bsl6Ed/tQ==',key_name='tempest-keypair-2114035891',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='766b82c0c2cd480f96d155adf4f6de4c',ramdisk_id='',reservation_id='r-chwzzwj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-23582724',owner_user_name='tempest-ServerActionsTestOtherA-23582724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:58:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e118c178ece2492bb2d975643c405196',uuid=7b335462-0d93-4899-a223-5c2e36932578,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "address": "fa:16:3e:e6:99:99", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bfc353f-1f", "ovs_interfaceid": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converting VIF {"id": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "address": "fa:16:3e:e6:99:99", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bfc353f-1f", "ovs_interfaceid": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:99:99,bridge_name='br-int',has_traffic_filtering=True,id=9bfc353f-1fb9-412e-80c7-64b5a2ecc32c,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bfc353f-1f') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG os_vif [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:99:99,bridge_name='br-int',has_traffic_filtering=True,id=9bfc353f-1fb9-412e-80c7-64b5a2ecc32c,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bfc353f-1f') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96f15877-7682-5d92-b990-c4f9f90eacfe', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9bfc353f-1f, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9bfc353f-1f, col_values=(('qos', UUID('b0ac1d51-ec39-4cd4-9a5d-a26a652764af')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9bfc353f-1f, col_values=(('external_ids', {'iface-id': '9bfc353f-1fb9-412e-80c7-64b5a2ecc32c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:99:99', 'vm-uuid': '7b335462-0d93-4899-a223-5c2e36932578'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:45 user nova-compute[74669]: INFO os_vif [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:99:99,bridge_name='br-int',has_traffic_filtering=True,id=9bfc353f-1fb9-412e-80c7-64b5a2ecc32c,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bfc353f-1f')
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] No VIF found with MAC fa:16:3e:e6:99:99, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.network.neutron [req-1ed3988e-57e2-4b9c-9c1d-2062416977e2 req-e747e73e-c76a-457f-b87a-01f3d417f352 service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Updated VIF entry in instance network info cache for port 9bfc353f-1fb9-412e-80c7-64b5a2ecc32c. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG nova.network.neutron [req-1ed3988e-57e2-4b9c-9c1d-2062416977e2 req-e747e73e-c76a-457f-b87a-01f3d417f352 service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Updating instance_info_cache with network_info: [{"id": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "address": "fa:16:3e:e6:99:99", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bfc353f-1f", "ovs_interfaceid": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:58:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1ed3988e-57e2-4b9c-9c1d-2062416977e2 req-e747e73e-c76a-457f-b87a-01f3d417f352 service nova] Releasing lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:58:46 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:58:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:46 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:58:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-87153d37-c3f8-45fe-9f64-c969f92aa268 req-75a77e27-0442-47ad-ac4d-36a846dadeb9 service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Received event network-vif-plugged-9bfc353f-1fb9-412e-80c7-64b5a2ecc32c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:58:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-87153d37-c3f8-45fe-9f64-c969f92aa268 req-75a77e27-0442-47ad-ac4d-36a846dadeb9 service nova] Acquiring lock "7b335462-0d93-4899-a223-5c2e36932578-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-87153d37-c3f8-45fe-9f64-c969f92aa268 req-75a77e27-0442-47ad-ac4d-36a846dadeb9 service nova] Lock "7b335462-0d93-4899-a223-5c2e36932578-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-87153d37-c3f8-45fe-9f64-c969f92aa268 req-75a77e27-0442-47ad-ac4d-36a846dadeb9 service nova] Lock "7b335462-0d93-4899-a223-5c2e36932578-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-87153d37-c3f8-45fe-9f64-c969f92aa268 req-75a77e27-0442-47ad-ac4d-36a846dadeb9 service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] No waiting events found dispatching network-vif-plugged-9bfc353f-1fb9-412e-80c7-64b5a2ecc32c {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:58:47 user nova-compute[74669]: WARNING nova.compute.manager [req-87153d37-c3f8-45fe-9f64-c969f92aa268 req-75a77e27-0442-47ad-ac4d-36a846dadeb9 service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Received unexpected event network-vif-plugged-9bfc353f-1fb9-412e-80c7-64b5a2ecc32c for instance with vm_state building and task_state spawning.
Nov 08 16:58:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:48 user nova-compute[74669]: INFO nova.virt.block_device [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Booting with volume cf4034c4-569c-410c-b394-7d8196c17336 at /dev/vdc
Nov 08 16:58:48 user nova-compute[74669]: DEBUG os_brick.utils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:58:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Acquiring lock "1b9ad090-c7bb-4a11-a056-19902844dbf0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "1b9ad090-c7bb-4a11-a056-19902844dbf0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d6ba96-6290-473f-a7f1-f29b71fd97c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:48 user nova-compute[74669]: DEBUG nova.objects.instance [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lazy-loading 'flavor' on Instance uuid 1b9ad090-c7bb-4a11-a056-19902844dbf0 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:58:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fbc8dd-2048-4478-9e5f-9c9e79fad5e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6ef5d2-5406-4901-8eec-2aef15de5512]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[be46e28b-3f6c-4c5d-8209-3873c22e60a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:58:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 16:58:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "1b9ad090-c7bb-4a11-a056-19902844dbf0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.115s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:58:49 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2420017b-55f4-48a4-ac39-d147c3955a1b]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG os_brick.utils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Updating existing volume attachment record: c26f0bda-88ad-40fc-b0e9-c39653deac39 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Acquiring lock "1b9ad090-c7bb-4a11-a056-19902844dbf0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "1b9ad090-c7bb-4a11-a056-19902844dbf0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:49 user nova-compute[74669]: INFO nova.compute.manager [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Attaching volume e2e3eac5-f7ff-4c32-a62b-89c25af2100a to /dev/sdc
Nov 08 16:58:49 user nova-compute[74669]: DEBUG nova.compute.manager [req-68af8b7e-6da5-4ba5-82d2-e151aa17bf21 req-912f7b70-8c24-4ede-8f67-9c4aad3b583d service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Received event network-vif-plugged-9bfc353f-1fb9-412e-80c7-64b5a2ecc32c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-68af8b7e-6da5-4ba5-82d2-e151aa17bf21 req-912f7b70-8c24-4ede-8f67-9c4aad3b583d service nova] Acquiring lock "7b335462-0d93-4899-a223-5c2e36932578-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-68af8b7e-6da5-4ba5-82d2-e151aa17bf21 req-912f7b70-8c24-4ede-8f67-9c4aad3b583d service nova] Lock "7b335462-0d93-4899-a223-5c2e36932578-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-68af8b7e-6da5-4ba5-82d2-e151aa17bf21 req-912f7b70-8c24-4ede-8f67-9c4aad3b583d service nova] Lock "7b335462-0d93-4899-a223-5c2e36932578-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG nova.compute.manager [req-68af8b7e-6da5-4ba5-82d2-e151aa17bf21 req-912f7b70-8c24-4ede-8f67-9c4aad3b583d service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] No waiting events found dispatching network-vif-plugged-9bfc353f-1fb9-412e-80c7-64b5a2ecc32c {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:58:49 user nova-compute[74669]: WARNING nova.compute.manager [req-68af8b7e-6da5-4ba5-82d2-e151aa17bf21 req-912f7b70-8c24-4ede-8f67-9c4aad3b583d service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Received unexpected event network-vif-plugged-9bfc353f-1fb9-412e-80c7-64b5a2ecc32c for instance with vm_state building and task_state spawning.
Nov 08 16:58:49 user nova-compute[74669]: DEBUG nova.compute.manager [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 16:58:49 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Instance spawned successfully.
Nov 08 16:58:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG os_brick.utils [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ede4f8-cf8b-47ec-82c5-5e6693f9de6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[201f9211-451c-43db-9202-6004c9b44a9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9b3558-94c3-4f7b-bb57-c555a717091a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac6c641-2686-4452-b773-46ed8ba13021]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 16:58:49 user nova-compute[74669]: INFO nova.compute.manager [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Took 6.81 seconds to spawn the instance on the hypervisor.
Nov 08 16:58:49 user nova-compute[74669]: DEBUG nova.compute.manager [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 16:58:49 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[517add40-10a1-409d-8974-fe4c8ee4dbe1]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG os_brick.utils [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Updating existing volume attachment record: c4687ca8-e51d-4b49-9153-c34690d6b937 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:49 user nova-compute[74669]: INFO nova.compute.manager [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Took 7.80 seconds to build instance.
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1d06812a-40e9-4507-8ad7-635c25df8bd3 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "7b335462-0d93-4899-a223-5c2e36932578" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.935s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.262s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.238s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:58:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:58:52 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:58:52 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:58:52 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8238MB free_disk=25.543190002441406GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:58:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:58:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:58:53 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:58:53 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:58:53 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0829b734-daec-4dc6-b24b-cbe89000160c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:58:53 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b26dbeeb-b629-414d-bcca-cdde6c207789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:58:53 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 1b9ad090-c7bb-4a11-a056-19902844dbf0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:58:53 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0ce9072b-e003-4921-83bc-8f3449c09e14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:58:53 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7b335462-0d93-4899-a223-5c2e36932578 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:58:53 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:58:53 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:58:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:53 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:58:53 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:58:53 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:58:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:58:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:58:55 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:58:55 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:58:55 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:58:55 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:58:55 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 16:58:55 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Skipping network cache update for instance because it is Building. {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 08 16:58:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:58:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:58:55 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 16:58:55 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lazy-loading 'info_cache' on Instance uuid e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:58:56 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Updating instance_info_cache with network_info: [{"id": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "address": "fa:16:3e:8f:9e:16", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b48f6d-e0", "ovs_interfaceid": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:58:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:58:56 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 16:58:56 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:58:56 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:58:56 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:58:56 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:58:56 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:58:56 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:59:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Starting finish_revert_migration {{(pid=74669) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Start _get_guest_xml network_info=[{"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '43158be8-dd79-4fa4-acc3-dee5d683437d', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygTldqYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b26dbeeb-b629-414d-bcca-cdde6c207789', 'attached_at': '2023-11-08T16:59:04.000000', 'detached_at': '', 'volume_id': 'f1176f50-24fe-4e13-aa36-02955f521263', 'serial': 'f1176f50-24fe-4e13-aa36-02955f521263'}, 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:59:03 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:59:03 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:59:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG nova.objects.instance [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lazy-loading 'vcpu_model' on Instance uuid b26dbeeb-b629-414d-bcca-cdde6c207789 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygTldqYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:59:03 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:59:03 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:59:03 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:59:03 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:59:03 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 16:59:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05dabf0-6667-450b-994f-00ba2f0ae380]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 16:59:03 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9902832c-de28-48dc-851d-2e0a322d2824]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263] added
Nov 08 16:59:04 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a384e263-c3e2-41f3-8232-5638248db2bb]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e583aa-4678-4e5f-8b2a-aa986c4b6d44]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ygTldqYN {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ygTldqYN" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0405e1d8-4af0-413d-81bd-17e6ec890eae]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ygTldqYN'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e26841-88ea-4590-8e32-6633751c2475]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[026bac2f-3365-415d-9bd4-a1548633deef]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 16:59:04 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 16:59:04 user nova-compute[74669]:  {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:59:04 user nova-compute[74669]: WARNING os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 16:59:04 user nova-compute[74669]: 
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddbf5ac-f699-4aa5-9a28-aa779be6c2c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260]
Nov 08 16:59:04 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260] successful.
Nov 08 16:59:04 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b86f3c-39c2-4b45-b0f0-8328362e7d30]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fbf54d-7956-4ff1-b906-5fdb36886c5a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:59:04 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:59:04 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6765083-8da0-4c3e-93d3-3243257cf647]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:04 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygTldqYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23333376538313966', 'path': '/dev/sdb'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333376538313966', 'path': '/dev/sdb'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-82074997',display_name='tempest-ServerActionsTestOtherB-server-82074997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-82074997',id=5,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVVAiZ/J+loI4/5CGCEcHyBdao/VDdeBeozCcJvl0eh7qycgoJCVfo066fltlkQiowyw4815L1dFrqeYMGOPhwhd9fpfcyVQWgEILP3lJeo6lsJtZZ3WMWpczoYeL0t+w==',key_name='tempest-keypair-1692388907',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:57:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9bc128b2ae524ce0aff2afb7301888bf',ramdisk_id='',reservation_id='r-fjmhrntp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-839528249',owner_user_name='tempest-ServerActionsTestOtherB-839528249-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:58:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acb95477d6ba46d4be3b34280c5892e5',uuid=b26dbeeb-b629-414d-bcca-cdde6c207789,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Converting VIF {"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:33:ae,bridge_name='br-int',has_traffic_filtering=True,id=47c9314f-4ea9-49c3-9b34-2fb94cc1eac4,network=Network(35a879d8-439e-4ac4-a8ae-292e3b9a1966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9314f-4e') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:59:05 user nova-compute[74669]:   <uuid>b26dbeeb-b629-414d-bcca-cdde6c207789</uuid>
Nov 08 16:59:05 user nova-compute[74669]:   <name>instance-00000005</name>
Nov 08 16:59:05 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:59:05 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:59:05 user nova-compute[74669]:   <metadata>
Nov 08 16:59:05 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:59:05 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:59:05 user nova-compute[74669]:       <nova:name>tempest-ServerActionsTestOtherB-server-82074997</nova:name>
Nov 08 16:59:05 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:59:03</nova:creationTime>
Nov 08 16:59:05 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:59:05 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:59:05 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:59:05 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:59:05 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:59:05 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:59:05 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:59:05 user nova-compute[74669]:       <nova:owner>
Nov 08 16:59:05 user nova-compute[74669]:         <nova:user uuid="acb95477d6ba46d4be3b34280c5892e5">tempest-ServerActionsTestOtherB-839528249-project-member</nova:user>
Nov 08 16:59:05 user nova-compute[74669]:         <nova:project uuid="9bc128b2ae524ce0aff2afb7301888bf">tempest-ServerActionsTestOtherB-839528249</nova:project>
Nov 08 16:59:05 user nova-compute[74669]:       </nova:owner>
Nov 08 16:59:05 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:59:05 user nova-compute[74669]:       <nova:ports>
Nov 08 16:59:05 user nova-compute[74669]:         <nova:port uuid="47c9314f-4ea9-49c3-9b34-2fb94cc1eac4">
Nov 08 16:59:05 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 16:59:05 user nova-compute[74669]:         </nova:port>
Nov 08 16:59:05 user nova-compute[74669]:       </nova:ports>
Nov 08 16:59:05 user nova-compute[74669]:     </nova:instance>
Nov 08 16:59:05 user nova-compute[74669]:   </metadata>
Nov 08 16:59:05 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:59:05 user nova-compute[74669]:     <system>
Nov 08 16:59:05 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:59:05 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:59:05 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:59:05 user nova-compute[74669]:       <entry name="serial">b26dbeeb-b629-414d-bcca-cdde6c207789</entry>
Nov 08 16:59:05 user nova-compute[74669]:       <entry name="uuid">b26dbeeb-b629-414d-bcca-cdde6c207789</entry>
Nov 08 16:59:05 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:59:05 user nova-compute[74669]:     </system>
Nov 08 16:59:05 user nova-compute[74669]:   </sysinfo>
Nov 08 16:59:05 user nova-compute[74669]:   <os>
Nov 08 16:59:05 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:59:05 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 16:59:05 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:59:05 user nova-compute[74669]:   </os>
Nov 08 16:59:05 user nova-compute[74669]:   <features>
Nov 08 16:59:05 user nova-compute[74669]:     <acpi/>
Nov 08 16:59:05 user nova-compute[74669]:     <apic/>
Nov 08 16:59:05 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:59:05 user nova-compute[74669]:   </features>
Nov 08 16:59:05 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:59:05 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:59:05 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:59:05 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:59:05 user nova-compute[74669]:   </clock>
Nov 08 16:59:05 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:59:05 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:59:05 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:59:05 user nova-compute[74669]:   </cpu>
Nov 08 16:59:05 user nova-compute[74669]:   <devices>
Nov 08 16:59:05 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:59:05 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:59:05 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk"/>
Nov 08 16:59:05 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:59:05 user nova-compute[74669]:     </disk>
Nov 08 16:59:05 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 16:59:05 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:59:05 user nova-compute[74669]:       <source dev="/dev/sdb"/>
Nov 08 16:59:05 user nova-compute[74669]:       <target dev="vdb" bus="virtio"/>
Nov 08 16:59:05 user nova-compute[74669]:       <serial>f1176f50-24fe-4e13-aa36-02955f521263</serial>
Nov 08 16:59:05 user nova-compute[74669]:     </disk>
Nov 08 16:59:05 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:59:05 user nova-compute[74669]:       <mac address="fa:16:3e:33:33:ae"/>
Nov 08 16:59:05 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:59:05 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:59:05 user nova-compute[74669]:       <target dev="tap47c9314f-4e"/>
Nov 08 16:59:05 user nova-compute[74669]:     </interface>
Nov 08 16:59:05 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:59:05 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/console.log" append="off"/>
Nov 08 16:59:05 user nova-compute[74669]:     </serial>
Nov 08 16:59:05 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:59:05 user nova-compute[74669]:     <video>
Nov 08 16:59:05 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:59:05 user nova-compute[74669]:     </video>
Nov 08 16:59:05 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:59:05 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:59:05 user nova-compute[74669]:     </rng>
Nov 08 16:59:05 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:59:05 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:59:05 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:59:05 user nova-compute[74669]:     </memballoon>
Nov 08 16:59:05 user nova-compute[74669]:   </devices>
Nov 08 16:59:05 user nova-compute[74669]: </domain>
Nov 08 16:59:05 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-82074997',display_name='tempest-ServerActionsTestOtherB-server-82074997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-82074997',id=5,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVVAiZ/J+loI4/5CGCEcHyBdao/VDdeBeozCcJvl0eh7qycgoJCVfo066fltlkQiowyw4815L1dFrqeYMGOPhwhd9fpfcyVQWgEILP3lJeo6lsJtZZ3WMWpczoYeL0t+w==',key_name='tempest-keypair-1692388907',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:57:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9bc128b2ae524ce0aff2afb7301888bf',ramdisk_id='',reservation_id='r-fjmhrntp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-839528249',owner_user_name='tempest-ServerActionsTestOtherB-839528249-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:58:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acb95477d6ba46d4be3b34280c5892e5',uuid=b26dbeeb-b629-414d-bcca-cdde6c207789,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Converting VIF {"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:33:ae,bridge_name='br-int',has_traffic_filtering=True,id=47c9314f-4ea9-49c3-9b34-2fb94cc1eac4,network=Network(35a879d8-439e-4ac4-a8ae-292e3b9a1966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9314f-4e') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG os_vif [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:33:ae,bridge_name='br-int',has_traffic_filtering=True,id=47c9314f-4ea9-49c3-9b34-2fb94cc1eac4,network=Network(35a879d8-439e-4ac4-a8ae-292e3b9a1966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9314f-4e') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af7b870c-ed84-5da9-bbc3-4b1f6e3df14b', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47c9314f-4e, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47c9314f-4e, col_values=(('qos', UUID('e33ff415-b8f9-4bf8-8d8a-d86af86b258e')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47c9314f-4e, col_values=(('external_ids', {'iface-id': '47c9314f-4ea9-49c3-9b34-2fb94cc1eac4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:33:ae', 'vm-uuid': 'b26dbeeb-b629-414d-bcca-cdde6c207789'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:05 user nova-compute[74669]: INFO os_vif [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:33:ae,bridge_name='br-int',has_traffic_filtering=True,id=47c9314f-4ea9-49c3-9b34-2fb94cc1eac4,network=Network(35a879d8-439e-4ac4-a8ae-292e3b9a1966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9314f-4e')
Nov 08 16:59:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:07 user nova-compute[74669]: DEBUG nova.compute.manager [req-c24a5682-eaeb-4890-9be0-01e569881fa6 req-647cd3e4-b21c-4439-969c-def3610665d2 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received event network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c24a5682-eaeb-4890-9be0-01e569881fa6 req-647cd3e4-b21c-4439-969c-def3610665d2 service nova] Acquiring lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c24a5682-eaeb-4890-9be0-01e569881fa6 req-647cd3e4-b21c-4439-969c-def3610665d2 service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c24a5682-eaeb-4890-9be0-01e569881fa6 req-647cd3e4-b21c-4439-969c-def3610665d2 service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:07 user nova-compute[74669]: DEBUG nova.compute.manager [req-c24a5682-eaeb-4890-9be0-01e569881fa6 req-647cd3e4-b21c-4439-969c-def3610665d2 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] No waiting events found dispatching network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:07 user nova-compute[74669]: WARNING nova.compute.manager [req-c24a5682-eaeb-4890-9be0-01e569881fa6 req-647cd3e4-b21c-4439-969c-def3610665d2 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received unexpected event network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 for instance with vm_state resized and task_state resize_reverting.
Nov 08 16:59:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "0829b734-daec-4dc6-b24b-cbe89000160c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "0829b734-daec-4dc6-b24b-cbe89000160c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:07 user nova-compute[74669]: INFO nova.compute.manager [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Terminating instance
Nov 08 16:59:07 user nova-compute[74669]: DEBUG nova.compute.manager [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 16:59:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:08 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Instance destroyed successfully.
Nov 08 16:59:08 user nova-compute[74669]: DEBUG nova.objects.instance [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lazy-loading 'resources' on Instance uuid 0829b734-daec-4dc6-b24b-cbe89000160c {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:59:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2095546845',display_name='tempest-TestMinimumBasicScenario-server-2095546845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2095546845',id=10,image_ref='3366e51a-0116-435e-986c-98029c349c7c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDCQBYjn/Hods1dA/c0oPfDp3cwT4dyVCGcb0ID5M60Gd7dyV3FAvOuBsZNEfm3X2qGrL/Vod9cs6+bU5t30ezJJY5GG8nc+IhfueGtZ6S/Q4AyYX+J0/Eq1unC6wT6mw==',key_name='tempest-TestMinimumBasicScenario-1047548378',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:53:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39bcebfdde5c48dc8857824275b0082e',ramdisk_id='',reservation_id='r-qvrwnzz5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='3366e51a-0116-435e-986c-98029c349c7c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1167063302',owner_user_name='tempest-TestMinimumBasicScenario-1167063302-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:56:07Z,user_data=None,user_id='d6fd033f262943cdabb12db63b11eca8',uuid=0829b734-daec-4dc6-b24b-cbe89000160c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "address": "fa:16:3e:36:41:2f", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29f8cc-17", "ovs_interfaceid": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 16:59:08 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Converting VIF {"id": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "address": "fa:16:3e:36:41:2f", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf29f8cc-17", "ovs_interfaceid": "bf29f8cc-1793-457b-a4a6-8158d048eac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:08 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:41:2f,bridge_name='br-int',has_traffic_filtering=True,id=bf29f8cc-1793-457b-a4a6-8158d048eac9,network=Network(c618e3db-19f3-4b21-aa37-98985a7bf610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf29f8cc-17') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:08 user nova-compute[74669]: DEBUG os_vif [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:41:2f,bridge_name='br-int',has_traffic_filtering=True,id=bf29f8cc-1793-457b-a4a6-8158d048eac9,network=Network(c618e3db-19f3-4b21-aa37-98985a7bf610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf29f8cc-17') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 16:59:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf29f8cc-17, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=229d5b94-d4df-458c-b0fa-b99a51d0589b) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:08 user nova-compute[74669]: INFO os_vif [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:41:2f,bridge_name='br-int',has_traffic_filtering=True,id=bf29f8cc-1793-457b-a4a6-8158d048eac9,network=Network(c618e3db-19f3-4b21-aa37-98985a7bf610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf29f8cc-17')
Nov 08 16:59:08 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Deleting instance files /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c_del
Nov 08 16:59:08 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Deletion of /opt/stack/data/nova/instances/0829b734-daec-4dc6-b24b-cbe89000160c_del complete
Nov 08 16:59:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:08 user nova-compute[74669]: INFO nova.compute.manager [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 08 16:59:08 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 16:59:08 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 16:59:08 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 16:59:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received event network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] Acquiring lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] No waiting events found dispatching network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:09 user nova-compute[74669]: WARNING nova.compute.manager [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received unexpected event network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 for instance with vm_state resized and task_state resize_reverting.
Nov 08 16:59:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received event network-vif-unplugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] Acquiring lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] No waiting events found dispatching network-vif-unplugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received event network-vif-unplugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received event network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] Acquiring lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] No waiting events found dispatching network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:09 user nova-compute[74669]: WARNING nova.compute.manager [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received unexpected event network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 for instance with vm_state active and task_state deleting.
Nov 08 16:59:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received event network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] Acquiring lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] No waiting events found dispatching network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:09 user nova-compute[74669]: WARNING nova.compute.manager [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received unexpected event network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 for instance with vm_state active and task_state deleting.
Nov 08 16:59:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received event network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] Acquiring lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] No waiting events found dispatching network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:09 user nova-compute[74669]: WARNING nova.compute.manager [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received unexpected event network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 for instance with vm_state active and task_state deleting.
Nov 08 16:59:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received event network-vif-unplugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] Acquiring lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] No waiting events found dispatching network-vif-unplugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received event network-vif-unplugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received event network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] Acquiring lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] Lock "0829b734-daec-4dc6-b24b-cbe89000160c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] No waiting events found dispatching network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:09 user nova-compute[74669]: WARNING nova.compute.manager [req-e6a32d3e-9b1e-4eeb-96b1-37075ac6e73d req-7c146a6f-897a-4b09-ad74-83bfff36d334 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received unexpected event network-vif-plugged-bf29f8cc-1793-457b-a4a6-8158d048eac9 for instance with vm_state active and task_state deleting.
Nov 08 16:59:09 user nova-compute[74669]: DEBUG nova.compute.manager [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 16:59:09 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Instance running successfully.
Nov 08 16:59:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] finish_revert_migration finished successfully. {{(pid=74669) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 08 16:59:09 user nova-compute[74669]: INFO nova.compute.manager [None req-3f482a9d-c6ef-447d-995e-6058735e8328 tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Updating instance to original state: 'active'
Nov 08 16:59:09 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:59:09 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Took 1.66 seconds to deallocate network for instance.
Nov 08 16:59:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-4652eb54-9e59-4ab3-babb-8b6fc0c4c754 req-29939e08-1748-4cd9-beb3-db9986dff2b9 service nova] [instance: 0829b734-daec-4dc6-b24b-cbe89000160c] Received event network-vif-deleted-bf29f8cc-1793-457b-a4a6-8158d048eac9 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:10 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:59:10 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:59:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:10 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Deleted allocations for instance 0829b734-daec-4dc6-b24b-cbe89000160c
Nov 08 16:59:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9c670039-61f7-44b9-8e13-0b30bd8d0317 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "0829b734-daec-4dc6-b24b-cbe89000160c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.532s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "b663cd16-12b5-48fc-886d-0a7d160faea5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:32 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 16:59:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:32 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 16:59:32 user nova-compute[74669]: INFO nova.compute.claims [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Claim successful on node user
Nov 08 16:59:32 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:59:32 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:59:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:32 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 16:59:32 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 16:59:32 user nova-compute[74669]: DEBUG nova.network.neutron [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 16:59:32 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 16:59:32 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 16:59:32 user nova-compute[74669]: DEBUG nova.policy [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4836f11b0e8346a2a7e835a6012f53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '632d3acc026b4a869be4899a0ed2e2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 16:59:32 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 16:59:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 16:59:32 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Creating image(s)
Nov 08 16:59:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "/opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "/opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "/opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.258s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.200s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk 1073741824" returned: 0 in 0.065s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.218s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:33 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 16:59:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:33 user nova-compute[74669]: DEBUG nova.network.neutron [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Successfully created port: f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:59:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:33 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Cannot resize image /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 16:59:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 16:59:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Ensure instance console log exists: /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 16:59:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:34 user nova-compute[74669]: DEBUG nova.network.neutron [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Successfully updated port: f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:59:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-f551d19a-5505-45ac-80c9-26bb0026cec3 req-f633f9dd-327a-4125-b15c-362c71415f30 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received event network-changed-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-f551d19a-5505-45ac-80c9-26bb0026cec3 req-f633f9dd-327a-4125-b15c-362c71415f30 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Refreshing instance network info cache due to event network-changed-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:59:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f551d19a-5505-45ac-80c9-26bb0026cec3 req-f633f9dd-327a-4125-b15c-362c71415f30 service nova] Acquiring lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:59:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f551d19a-5505-45ac-80c9-26bb0026cec3 req-f633f9dd-327a-4125-b15c-362c71415f30 service nova] Acquired lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:59:34 user nova-compute[74669]: DEBUG nova.network.neutron [req-f551d19a-5505-45ac-80c9-26bb0026cec3 req-f633f9dd-327a-4125-b15c-362c71415f30 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Refreshing network info cache for port f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:59:34 user nova-compute[74669]: DEBUG nova.network.neutron [req-f551d19a-5505-45ac-80c9-26bb0026cec3 req-f633f9dd-327a-4125-b15c-362c71415f30 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:59:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.network.neutron [req-f551d19a-5505-45ac-80c9-26bb0026cec3 req-f633f9dd-327a-4125-b15c-362c71415f30 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f551d19a-5505-45ac-80c9-26bb0026cec3 req-f633f9dd-327a-4125-b15c-362c71415f30 service nova] Releasing lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquired lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.network.neutron [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.network.neutron [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.network.neutron [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Updating instance_info_cache with network_info: [{"id": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "address": "fa:16:3e:70:48:8f", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c0ff3a-f7", "ovs_interfaceid": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Releasing lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Instance network_info: |[{"id": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "address": "fa:16:3e:70:48:8f", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c0ff3a-f7", "ovs_interfaceid": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Start _get_guest_xml network_info=[{"id": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "address": "fa:16:3e:70:48:8f", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c0ff3a-f7", "ovs_interfaceid": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:59:35 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:59:35 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1617099866',display_name='tempest-ServerRescueNegativeTestJSON-server-1617099866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1617099866',id=16,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4Cgsm6cX2qyzx8rq6D9dugDe4RZp7Igjsfdo3CJijmqQ1dHOQM5HOFxPzKN86OgMWJ2HHhOKlvxf15iLNojfkf1D4DQ0XYMSMxUPTQJoEkRD6CCzrhdyhlfH+CXTjE8g==',key_name='tempest-keypair-1917158791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='632d3acc026b4a869be4899a0ed2e2e2',ramdisk_id='',reservation_id='r-kojzv90d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1743978403',owner_user_name='tempest-ServerRescueNegativeTestJSON-1743978403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4836f11b0e8346a2a7e835a6012f53fb',uuid=b663cd16-12b5-48fc-886d-0a7d160faea5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "address": "fa:16:3e:70:48:8f", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c0ff3a-f7", "ovs_interfaceid": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converting VIF {"id": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "address": "fa:16:3e:70:48:8f", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c0ff3a-f7", "ovs_interfaceid": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:48:8f,bridge_name='br-int',has_traffic_filtering=True,id=f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6c0ff3a-f7') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.objects.instance [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'pci_devices' on Instance uuid b663cd16-12b5-48fc-886d-0a7d160faea5 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:59:35 user nova-compute[74669]:   <uuid>b663cd16-12b5-48fc-886d-0a7d160faea5</uuid>
Nov 08 16:59:35 user nova-compute[74669]:   <name>instance-00000010</name>
Nov 08 16:59:35 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:59:35 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:59:35 user nova-compute[74669]:   <metadata>
Nov 08 16:59:35 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:59:35 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:59:35 user nova-compute[74669]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1617099866</nova:name>
Nov 08 16:59:35 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:59:35</nova:creationTime>
Nov 08 16:59:35 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:59:35 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:59:35 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:59:35 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:59:35 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:59:35 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:59:35 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:59:35 user nova-compute[74669]:       <nova:owner>
Nov 08 16:59:35 user nova-compute[74669]:         <nova:user uuid="4836f11b0e8346a2a7e835a6012f53fb">tempest-ServerRescueNegativeTestJSON-1743978403-project-member</nova:user>
Nov 08 16:59:35 user nova-compute[74669]:         <nova:project uuid="632d3acc026b4a869be4899a0ed2e2e2">tempest-ServerRescueNegativeTestJSON-1743978403</nova:project>
Nov 08 16:59:35 user nova-compute[74669]:       </nova:owner>
Nov 08 16:59:35 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:59:35 user nova-compute[74669]:       <nova:ports>
Nov 08 16:59:35 user nova-compute[74669]:         <nova:port uuid="f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791">
Nov 08 16:59:35 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 16:59:35 user nova-compute[74669]:         </nova:port>
Nov 08 16:59:35 user nova-compute[74669]:       </nova:ports>
Nov 08 16:59:35 user nova-compute[74669]:     </nova:instance>
Nov 08 16:59:35 user nova-compute[74669]:   </metadata>
Nov 08 16:59:35 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:59:35 user nova-compute[74669]:     <system>
Nov 08 16:59:35 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:59:35 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:59:35 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:59:35 user nova-compute[74669]:       <entry name="serial">b663cd16-12b5-48fc-886d-0a7d160faea5</entry>
Nov 08 16:59:35 user nova-compute[74669]:       <entry name="uuid">b663cd16-12b5-48fc-886d-0a7d160faea5</entry>
Nov 08 16:59:35 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:59:35 user nova-compute[74669]:     </system>
Nov 08 16:59:35 user nova-compute[74669]:   </sysinfo>
Nov 08 16:59:35 user nova-compute[74669]:   <os>
Nov 08 16:59:35 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:59:35 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 16:59:35 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:59:35 user nova-compute[74669]:   </os>
Nov 08 16:59:35 user nova-compute[74669]:   <features>
Nov 08 16:59:35 user nova-compute[74669]:     <acpi/>
Nov 08 16:59:35 user nova-compute[74669]:     <apic/>
Nov 08 16:59:35 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:59:35 user nova-compute[74669]:   </features>
Nov 08 16:59:35 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:59:35 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:59:35 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:59:35 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:59:35 user nova-compute[74669]:   </clock>
Nov 08 16:59:35 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:59:35 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:59:35 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:59:35 user nova-compute[74669]:   </cpu>
Nov 08 16:59:35 user nova-compute[74669]:   <devices>
Nov 08 16:59:35 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:59:35 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:59:35 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk"/>
Nov 08 16:59:35 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:59:35 user nova-compute[74669]:     </disk>
Nov 08 16:59:35 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:59:35 user nova-compute[74669]:       <mac address="fa:16:3e:70:48:8f"/>
Nov 08 16:59:35 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:59:35 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:59:35 user nova-compute[74669]:       <target dev="tapf6c0ff3a-f7"/>
Nov 08 16:59:35 user nova-compute[74669]:     </interface>
Nov 08 16:59:35 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:59:35 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/console.log" append="off"/>
Nov 08 16:59:35 user nova-compute[74669]:     </serial>
Nov 08 16:59:35 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:59:35 user nova-compute[74669]:     <video>
Nov 08 16:59:35 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:59:35 user nova-compute[74669]:     </video>
Nov 08 16:59:35 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:59:35 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:59:35 user nova-compute[74669]:     </rng>
Nov 08 16:59:35 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:59:35 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:59:35 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:59:35 user nova-compute[74669]:     </memballoon>
Nov 08 16:59:35 user nova-compute[74669]:   </devices>
Nov 08 16:59:35 user nova-compute[74669]: </domain>
Nov 08 16:59:35 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1617099866',display_name='tempest-ServerRescueNegativeTestJSON-server-1617099866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1617099866',id=16,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4Cgsm6cX2qyzx8rq6D9dugDe4RZp7Igjsfdo3CJijmqQ1dHOQM5HOFxPzKN86OgMWJ2HHhOKlvxf15iLNojfkf1D4DQ0XYMSMxUPTQJoEkRD6CCzrhdyhlfH+CXTjE8g==',key_name='tempest-keypair-1917158791',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='632d3acc026b4a869be4899a0ed2e2e2',ramdisk_id='',reservation_id='r-kojzv90d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1743978403',owner_user_name='tempest-ServerRescueNegativeTestJSON-1743978403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4836f11b0e8346a2a7e835a6012f53fb',uuid=b663cd16-12b5-48fc-886d-0a7d160faea5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "address": "fa:16:3e:70:48:8f", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c0ff3a-f7", "ovs_interfaceid": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converting VIF {"id": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "address": "fa:16:3e:70:48:8f", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c0ff3a-f7", "ovs_interfaceid": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:48:8f,bridge_name='br-int',has_traffic_filtering=True,id=f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6c0ff3a-f7') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG os_vif [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:48:8f,bridge_name='br-int',has_traffic_filtering=True,id=f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6c0ff3a-f7') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e212e4bf-79ee-5f92-899c-2d410a0ee8fa', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6c0ff3a-f7, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6c0ff3a-f7, col_values=(('qos', UUID('9736dd4b-7a43-46ba-be8d-ce41d5b9c678')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6c0ff3a-f7, col_values=(('external_ids', {'iface-id': 'f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:48:8f', 'vm-uuid': 'b663cd16-12b5-48fc-886d-0a7d160faea5'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:35 user nova-compute[74669]: INFO os_vif [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:48:8f,bridge_name='br-int',has_traffic_filtering=True,id=f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6c0ff3a-f7')
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:59:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] No VIF found with MAC fa:16:3e:70:48:8f, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:59:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:37 user nova-compute[74669]: DEBUG nova.compute.manager [req-cdc69df9-c1b3-4944-a85e-c21ff1c1ca0e req-72c26869-6dc5-4b3f-bffd-5a4823ac8dbc service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-cdc69df9-c1b3-4944-a85e-c21ff1c1ca0e req-72c26869-6dc5-4b3f-bffd-5a4823ac8dbc service nova] Acquiring lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-cdc69df9-c1b3-4944-a85e-c21ff1c1ca0e req-72c26869-6dc5-4b3f-bffd-5a4823ac8dbc service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-cdc69df9-c1b3-4944-a85e-c21ff1c1ca0e req-72c26869-6dc5-4b3f-bffd-5a4823ac8dbc service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:37 user nova-compute[74669]: DEBUG nova.compute.manager [req-cdc69df9-c1b3-4944-a85e-c21ff1c1ca0e req-72c26869-6dc5-4b3f-bffd-5a4823ac8dbc service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] No waiting events found dispatching network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:37 user nova-compute[74669]: WARNING nova.compute.manager [req-cdc69df9-c1b3-4944-a85e-c21ff1c1ca0e req-72c26869-6dc5-4b3f-bffd-5a4823ac8dbc service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received unexpected event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 for instance with vm_state building and task_state spawning.
Nov 08 16:59:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 16:59:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 16:59:39 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Instance spawned successfully.
Nov 08 16:59:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 16:59:39 user nova-compute[74669]: DEBUG nova.compute.manager [req-5af90ce9-1400-4577-a49a-8789180231b2 req-ae33be53-35f9-4aa1-895a-2a7211651c63 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5af90ce9-1400-4577-a49a-8789180231b2 req-ae33be53-35f9-4aa1-895a-2a7211651c63 service nova] Acquiring lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5af90ce9-1400-4577-a49a-8789180231b2 req-ae33be53-35f9-4aa1-895a-2a7211651c63 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5af90ce9-1400-4577-a49a-8789180231b2 req-ae33be53-35f9-4aa1-895a-2a7211651c63 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:39 user nova-compute[74669]: DEBUG nova.compute.manager [req-5af90ce9-1400-4577-a49a-8789180231b2 req-ae33be53-35f9-4aa1-895a-2a7211651c63 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] No waiting events found dispatching network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:39 user nova-compute[74669]: WARNING nova.compute.manager [req-5af90ce9-1400-4577-a49a-8789180231b2 req-ae33be53-35f9-4aa1-895a-2a7211651c63 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received unexpected event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 for instance with vm_state building and task_state spawning.
Nov 08 16:59:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:59:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:59:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:59:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:59:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:59:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:59:40 user nova-compute[74669]: INFO nova.compute.manager [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Took 7.11 seconds to spawn the instance on the hypervisor.
Nov 08 16:59:40 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:59:40 user nova-compute[74669]: INFO nova.compute.manager [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Took 7.90 seconds to build instance.
Nov 08 16:59:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0203180a-45da-47a4-b637-6cfe9db8b3aa tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.037s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VLCzUpxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:59:43 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:59:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:59:43 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:59:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:59:43 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bc9ffc-2d3f-43d4-8164-3c9915510197]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 16:59:43 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[50daf81d-2acb-49bb-9155-238192f315f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a] added
Nov 08 16:59:43 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 16:59:43 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Creating image(s)
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Did not create local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Ensure instance console log exists: /opt/stack/data/nova/instances/0ce9072b-e003-4921-83bc-8f3449c09e14/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Start _get_guest_xml network_info=[{"id": "314df0da-c133-46af-bdc1-a317e71ca069", "address": "fa:16:3e:c4:c1:5b", "network": {"id": "ee33eeed-0f37-4f56-aa18-e6c986e10eb7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-786579928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314df0da-c1", "ovs_interfaceid": "314df0da-c133-46af-bdc1-a317e71ca069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98dcc41a-801d-4934-8069-75d814493170", "address": "fa:16:3e:4a:0a:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98dcc41a-80", "ovs_interfaceid": "98dcc41a-801d-4934-8069-75d814493170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "address": "fa:16:3e:9d:06:2c", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3416a767-03", "ovs_interfaceid": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "address": "fa:16:3e:a4:bd:59", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82aa3c9f-78", "ovs_interfaceid": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "address": "fa:16:3e:c3:25:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dac6ca-fd", "ovs_interfaceid": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "address": "fa:16:3e:6a:5e:82", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4adfe0-b1", "ovs_interfaceid": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "898bcd3e-b90e-493b-904a-5f533757c60e", "address": "fa:16:3e:b3:e6:5a", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898bcd3e-b9", "ovs_interfaceid": "898bcd3e-b90e-493b-904a-5f533757c60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'c0d61309-30f4-43fb-9703-0a4a4290c6a0', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WuEbvZjM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0ce9072b-e003-4921-83bc-8f3449c09e14', 'attached_at': '', 'detached_at': '', 'volume_id': '393d7383-44a3-4a2f-87f2-b2eb33f3acf5', 'serial': '393d7383-44a3-4a2f-87f2-b2eb33f3acf5'}, 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '5de4d1e8-6de1-4f32-bbbb-a4c05bf7dd1f', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fLXFRugl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0ce9072b-e003-4921-83bc-8f3449c09e14', 'attached_at': '', 'detached_at': '', 'volume_id': '3270c5a2-1029-4533-9b41-5c9fb2b0ba55', 'serial': '3270c5a2-1029-4533-9b41-5c9fb2b0ba55'}, 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'c26f0bda-88ad-40fc-b0e9-c39653deac39', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLREoOtM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0ce9072b-e003-4921-83bc-8f3449c09e14', 'attached_at': '', 'detached_at': '', 'volume_id': 'cf4034c4-569c-410c-b394-7d8196c17336', 'serial': 'cf4034c4-569c-410c-b394-7d8196c17336'}, 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a02ea63-97ba-4bc7-a3e0-69f4529c9724]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:43 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:59:43 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WuEbvZjM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:59:43 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:59:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1776cb0d-ab6d-4bd0-aae8-e9085bf59e66]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VLCzUpxc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VLCzUpxc" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cab844-020d-4beb-acb2-c27182bc794c]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VLCzUpxc'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3601f15-bf90-4cb3-8c6f-13d4c6193d1d]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4437ec9-4a7d-4414-845f-27ccfe443f79]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:59:43 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:59:43 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:59:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[952b61e4-2c93-49fb-b975-29911cb38c58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a, portal: 172.16.0.220,3260]
Nov 08 16:59:44 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a, portal: 172.16.0.220,3260] successful.
Nov 08 16:59:44 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9756fcf-065e-4a05-81c7-cd98a7d0e4c8]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c674b5-369b-4d07-874f-f84d113a1a3a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:59:44 user nova-compute[74669]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)
Nov 08 16:59:44 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:59:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:59:44 user nova-compute[74669]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)
Nov 08 16:59:44 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:59:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:59:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 16:59:44 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 16:59:44 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 16:59:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5e0764-b9de-4e85-ac1c-b1d7f99fefe0]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:44 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: None {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VLCzUpxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23666663730323361', 'path': '/dev/sdc'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666663730323361', 'path': '/dev/sdc'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.257s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:59:45 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:59:45 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG nova.objects.instance [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lazy-loading 'flavor' on Instance uuid 1b9ad090-c7bb-4a11-a056-19902844dbf0 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e2cf6d-94ad-4b2f-b7d4-da11e454f3ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 16:59:45 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 16:59:45 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:59:45 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 16:59:45 user nova-compute[74669]:   <target dev="sdc" bus="scsi"/>
Nov 08 16:59:45 user nova-compute[74669]:   <serial>e2e3eac5-f7ff-4c32-a62b-89c25af2100a</serial>
Nov 08 16:59:45 user nova-compute[74669]:   <address type="drive" controller="0" unit="2"/>
Nov 08 16:59:45 user nova-compute[74669]: </disk>
Nov 08 16:59:45 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9280a629-46b9-4007-b555-83ef4a10d0f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5] added
Nov 08 16:59:45 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f6f1c6-f5ab-498a-81ed-4c91098bfeba]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc3f59e-8e8c-452f-816e-5f65e982a965]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WuEbvZjM {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WuEbvZjM" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee965fc-6a54-45d0-a383-a79ff6546a25]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WuEbvZjM'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[241aa2ad-bb66-452b-bdec-4a65e074de20]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb4a0b4-bc59-493b-a793-77e13ec224ba]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:59:45 user nova-compute[74669]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)
Nov 08 16:59:45 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:59:45 user nova-compute[74669]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)
Nov 08 16:59:45 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[10417221-02fa-4104-a625-1a8804e681bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5, portal: 172.16.0.220,3260]
Nov 08 16:59:45 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5, portal: 172.16.0.220,3260] successful.
Nov 08 16:59:45 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87de21c-94df-4711-95fb-e6ac1ad229a9]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[728174c8-896b-4801-8041-e3f8d5cc1510]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:59:45 user nova-compute[74669]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)
Nov 08 16:59:45 user nova-compute[74669]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)
Nov 08 16:59:45 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:59:45 user nova-compute[74669]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)
Nov 08 16:59:45 user nova-compute[74669]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)
Nov 08 16:59:45 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[91353581-3968-4658-96e3-d03440b408bd]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WuEbvZjM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] No BDM found with device name sda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] No VIF found with MAC fa:16:3e:a1:4d:7a, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:59:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-74cf6624-7cae-48e8-b4ae-b6c979aabc78 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "1b9ad090-c7bb-4a11-a056-19902844dbf0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 56.698s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] <== connect_volume: return (2662ms) {'type': 'block', 'scsi_wwn': '23438346164346163', 'path': '/dev/sdd'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438346164346163', 'path': '/dev/sdd'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fLXFRugl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:59:46 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:59:46 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:59:46 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[646a5af9-d895-44d6-b4e8-9872e215572a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 16:59:46 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb9bdb6-2c07-42cc-9123-16009aa8f1e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55] added
Nov 08 16:59:46 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e6d41c-eb69-40cb-adf7-2562f1074dbc]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c04dad-acf4-494a-a101-0c8c2c8e2613]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fLXFRugl {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fLXFRugl" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ce1496-0d1d-46d3-8dca-f69e694bfb94]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fLXFRugl'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa1cb06-ac01-4d42-871f-87d355db6b1d]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[37824065-5eb6-4cbd-a341-2f06fa590f2d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:59:46 user nova-compute[74669]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)
Nov 08 16:59:46 user nova-compute[74669]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)
Nov 08 16:59:46 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:59:46 user nova-compute[74669]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)
Nov 08 16:59:46 user nova-compute[74669]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)
Nov 08 16:59:46 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4484590-43b1-40b6-b97a-b8b83662f85e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55, portal: 172.16.0.220,3260]
Nov 08 16:59:46 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55, portal: 172.16.0.220,3260] successful.
Nov 08 16:59:46 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d92f53-7e77-476a-9c1c-f9a213af8927]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ea6b82-7935-4b13-bb4b-5415f09b27bf]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:59:46 user nova-compute[74669]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)
Nov 08 16:59:46 user nova-compute[74669]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)
Nov 08 16:59:46 user nova-compute[74669]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 (non-flash)
Nov 08 16:59:46 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:59:46 user nova-compute[74669]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)
Nov 08 16:59:46 user nova-compute[74669]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)
Nov 08 16:59:46 user nova-compute[74669]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 (non-flash)
Nov 08 16:59:46 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e32b63-a43c-47d0-afef-4e695b0a6f60]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: None {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:59:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Acquiring lock "1b9ad090-c7bb-4a11-a056-19902844dbf0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "1b9ad090-c7bb-4a11-a056-19902844dbf0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:47 user nova-compute[74669]: INFO nova.compute.manager [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Detaching volume e2e3eac5-f7ff-4c32-a62b-89c25af2100a
Nov 08 16:59:47 user nova-compute[74669]: INFO nova.virt.block_device [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Attempting to driver detach volume e2e3eac5-f7ff-4c32-a62b-89c25af2100a from mountpoint /dev/sdc
Nov 08 16:59:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Attempting to detach device sdc from instance 1b9ad090-c7bb-4a11-a056-19902844dbf0 from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 16:59:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 16:59:47 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:59:47 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 16:59:47 user nova-compute[74669]:   <target dev="sdc" bus="scsi"/>
Nov 08 16:59:47 user nova-compute[74669]:   <serial>e2e3eac5-f7ff-4c32-a62b-89c25af2100a</serial>
Nov 08 16:59:47 user nova-compute[74669]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 08 16:59:47 user nova-compute[74669]: </disk>
Nov 08 16:59:47 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 16:59:47 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Successfully detached device sdc from instance 1b9ad090-c7bb-4a11-a056-19902844dbf0 from the persistent domain config.
Nov 08 16:59:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 1b9ad090-c7bb-4a11-a056-19902844dbf0 from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 16:59:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 16:59:47 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:59:47 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 16:59:47 user nova-compute[74669]:   <target dev="sdc" bus="scsi"/>
Nov 08 16:59:47 user nova-compute[74669]:   <serial>e2e3eac5-f7ff-4c32-a62b-89c25af2100a</serial>
Nov 08 16:59:47 user nova-compute[74669]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 08 16:59:47 user nova-compute[74669]: </disk>
Nov 08 16:59:47 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 16:59:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 1b9ad090-c7bb-4a11-a056-19902844dbf0 {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 16:59:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:47 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:59:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fLXFRugl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 16:59:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:59:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23562336236633662', 'path': '/dev/sde'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:59:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562336236633662', 'path': '/dev/sde'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLREoOtM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 16:59:48 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:59:48 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 16:59:48 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68cf92e-715a-4fbc-8c34-a2a101c57cfb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 16:59:48 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c6edde-26fa-4878-8869-79e34b8df490]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336] added
Nov 08 16:59:48 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3fe5f0-27e3-40a4-b7e2-f022c8c20eee]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8b3266-af1a-4323-816d-308a6460386a]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PLREoOtM {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PLREoOtM" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8985906-27c9-4f47-a718-7bd8c007f0da]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PLREoOtM'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f668331-f3bb-4b9f-98d7-4b958c8f9a09]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8fca67-c0ac-414a-a9f7-29f9b09c6aa9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:59:48 user nova-compute[74669]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)
Nov 08 16:59:48 user nova-compute[74669]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)
Nov 08 16:59:48 user nova-compute[74669]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 (non-flash)
Nov 08 16:59:48 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:59:48 user nova-compute[74669]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)
Nov 08 16:59:48 user nova-compute[74669]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)
Nov 08 16:59:48 user nova-compute[74669]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 (non-flash)
Nov 08 16:59:48 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcb2515-89c5-4142-9bbd-fb92b9f30d50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336, portal: 172.16.0.220,3260]
Nov 08 16:59:48 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336, portal: 172.16.0.220,3260] successful.
Nov 08 16:59:48 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[afde4da3-1046-430e-9780-5372c939c6da]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88ef614-9e45-414e-9f2d-0ff82ebb33da]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:59:48 user nova-compute[74669]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)
Nov 08 16:59:48 user nova-compute[74669]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)
Nov 08 16:59:48 user nova-compute[74669]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 (non-flash)
Nov 08 16:59:48 user nova-compute[74669]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 (non-flash)
Nov 08 16:59:48 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 16:59:48 user nova-compute[74669]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)
Nov 08 16:59:48 user nova-compute[74669]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)
Nov 08 16:59:48 user nova-compute[74669]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 (non-flash)
Nov 08 16:59:48 user nova-compute[74669]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 (non-flash)
Nov 08 16:59:48 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.417s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.027s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cc64d4-3c4b-40dc-8dd6-490011978adf]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLREoOtM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.476s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] <== connect_volume: return (1479ms) {'type': 'block', 'scsi_wwn': '23435643062353864', 'path': '/dev/sdf'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435643062353864', 'path': '/dev/sdf'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1773552603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1773552603',id=14,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoDrsOl1L2B2ygRhUPagQG+XN+24BbCzGghObLHCJCNkchqh4x0gnszO53qEkfFR5YFjsCnFLWZGnFmn91XOUwSylaYJe/NOr19YHyyPXKCT8yLEBwZOglZlBB1tEulww==',key_name='tempest-keypair-277180508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44e866b4d7344b81b53cf1e4484faf29',ramdisk_id='',reservation_id='r-xogjbe7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1066904042',owner_user_name='tempest-TaggedBootDevicesTest-1066904042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='756930c1b18340a9a0cfe3f95d9b89c6',uuid=0ce9072b-e003-4921-83bc-8f3449c09e14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "314df0da-c133-46af-bdc1-a317e71ca069", "address": "fa:16:3e:c4:c1:5b", "network": {"id": "ee33eeed-0f37-4f56-aa18-e6c986e10eb7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-786579928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314df0da-c1", "ovs_interfaceid": "314df0da-c133-46af-bdc1-a317e71ca069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converting VIF {"id": "314df0da-c133-46af-bdc1-a317e71ca069", "address": "fa:16:3e:c4:c1:5b", "network": {"id": "ee33eeed-0f37-4f56-aa18-e6c986e10eb7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-786579928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314df0da-c1", "ovs_interfaceid": "314df0da-c133-46af-bdc1-a317e71ca069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:c1:5b,bridge_name='br-int',has_traffic_filtering=True,id=314df0da-c133-46af-bdc1-a317e71ca069,network=Network(ee33eeed-0f37-4f56-aa18-e6c986e10eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap314df0da-c1') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1773552603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1773552603',id=14,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoDrsOl1L2B2ygRhUPagQG+XN+24BbCzGghObLHCJCNkchqh4x0gnszO53qEkfFR5YFjsCnFLWZGnFmn91XOUwSylaYJe/NOr19YHyyPXKCT8yLEBwZOglZlBB1tEulww==',key_name='tempest-keypair-277180508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44e866b4d7344b81b53cf1e4484faf29',ramdisk_id='',reservation_id='r-xogjbe7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1066904042',owner_user_name='tempest-TaggedBootDevicesTest-1066904042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='756930c1b18340a9a0cfe3f95d9b89c6',uuid=0ce9072b-e003-4921-83bc-8f3449c09e14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98dcc41a-801d-4934-8069-75d814493170", "address": "fa:16:3e:4a:0a:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98dcc41a-80", "ovs_interfaceid": "98dcc41a-801d-4934-8069-75d814493170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converting VIF {"id": "98dcc41a-801d-4934-8069-75d814493170", "address": "fa:16:3e:4a:0a:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98dcc41a-80", "ovs_interfaceid": "98dcc41a-801d-4934-8069-75d814493170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:0a:4b,bridge_name='br-int',has_traffic_filtering=True,id=98dcc41a-801d-4934-8069-75d814493170,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98dcc41a-80') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1773552603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1773552603',id=14,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoDrsOl1L2B2ygRhUPagQG+XN+24BbCzGghObLHCJCNkchqh4x0gnszO53qEkfFR5YFjsCnFLWZGnFmn91XOUwSylaYJe/NOr19YHyyPXKCT8yLEBwZOglZlBB1tEulww==',key_name='tempest-keypair-277180508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44e866b4d7344b81b53cf1e4484faf29',ramdisk_id='',reservation_id='r-xogjbe7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1066904042',owner_user_name='tempest-TaggedBootDevicesTest-1066904042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='756930c1b18340a9a0cfe3f95d9b89c6',uuid=0ce9072b-e003-4921-83bc-8f3449c09e14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "address": "fa:16:3e:9d:06:2c", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3416a767-03", "ovs_interfaceid": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converting VIF {"id": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "address": "fa:16:3e:9d:06:2c", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3416a767-03", "ovs_interfaceid": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:06:2c,bridge_name='br-int',has_traffic_filtering=True,id=3416a767-03a6-4f75-8b8b-979eed5ddabe,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3416a767-03') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1773552603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1773552603',id=14,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoDrsOl1L2B2ygRhUPagQG+XN+24BbCzGghObLHCJCNkchqh4x0gnszO53qEkfFR5YFjsCnFLWZGnFmn91XOUwSylaYJe/NOr19YHyyPXKCT8yLEBwZOglZlBB1tEulww==',key_name='tempest-keypair-277180508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44e866b4d7344b81b53cf1e4484faf29',ramdisk_id='',reservation_id='r-xogjbe7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1066904042',owner_user_name='tempest-TaggedBootDevicesTest-1066904042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='756930c1b18340a9a0cfe3f95d9b89c6',uuid=0ce9072b-e003-4921-83bc-8f3449c09e14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "address": "fa:16:3e:a4:bd:59", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82aa3c9f-78", "ovs_interfaceid": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converting VIF {"id": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "address": "fa:16:3e:a4:bd:59", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82aa3c9f-78", "ovs_interfaceid": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:bd:59,bridge_name='br-int',has_traffic_filtering=True,id=82aa3c9f-7823-4948-9496-449cb8e12f0b,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82aa3c9f-78') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1773552603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1773552603',id=14,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoDrsOl1L2B2ygRhUPagQG+XN+24BbCzGghObLHCJCNkchqh4x0gnszO53qEkfFR5YFjsCnFLWZGnFmn91XOUwSylaYJe/NOr19YHyyPXKCT8yLEBwZOglZlBB1tEulww==',key_name='tempest-keypair-277180508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44e866b4d7344b81b53cf1e4484faf29',ramdisk_id='',reservation_id='r-xogjbe7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1066904042',owner_user_name='tempest-TaggedBootDevicesTest-1066904042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='756930c1b18340a9a0cfe3f95d9b89c6',uuid=0ce9072b-e003-4921-83bc-8f3449c09e14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "address": "fa:16:3e:c3:25:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dac6ca-fd", "ovs_interfaceid": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converting VIF {"id": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "address": "fa:16:3e:c3:25:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dac6ca-fd", "ovs_interfaceid": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:25:4b,bridge_name='br-int',has_traffic_filtering=True,id=f1dac6ca-fd45-42d7-9f01-32891331b7ba,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1dac6ca-fd') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1773552603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1773552603',id=14,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoDrsOl1L2B2ygRhUPagQG+XN+24BbCzGghObLHCJCNkchqh4x0gnszO53qEkfFR5YFjsCnFLWZGnFmn91XOUwSylaYJe/NOr19YHyyPXKCT8yLEBwZOglZlBB1tEulww==',key_name='tempest-keypair-277180508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44e866b4d7344b81b53cf1e4484faf29',ramdisk_id='',reservation_id='r-xogjbe7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1066904042',owner_user_name='tempest-TaggedBootDevicesTest-1066904042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='756930c1b18340a9a0cfe3f95d9b89c6',uuid=0ce9072b-e003-4921-83bc-8f3449c09e14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "address": "fa:16:3e:6a:5e:82", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4adfe0-b1", "ovs_interfaceid": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converting VIF {"id": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "address": "fa:16:3e:6a:5e:82", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4adfe0-b1", "ovs_interfaceid": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=1e4adfe0-b13d-49ae-8766-5e4dfe754427,network=Network(6b21de98-8e99-4cf6-8fb2-b2554c54c9c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e4adfe0-b1') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1773552603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1773552603',id=14,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoDrsOl1L2B2ygRhUPagQG+XN+24BbCzGghObLHCJCNkchqh4x0gnszO53qEkfFR5YFjsCnFLWZGnFmn91XOUwSylaYJe/NOr19YHyyPXKCT8yLEBwZOglZlBB1tEulww==',key_name='tempest-keypair-277180508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44e866b4d7344b81b53cf1e4484faf29',ramdisk_id='',reservation_id='r-xogjbe7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1066904042',owner_user_name='tempest-TaggedBootDevicesTest-1066904042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='756930c1b18340a9a0cfe3f95d9b89c6',uuid=0ce9072b-e003-4921-83bc-8f3449c09e14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "898bcd3e-b90e-493b-904a-5f533757c60e", "address": "fa:16:3e:b3:e6:5a", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898bcd3e-b9", "ovs_interfaceid": "898bcd3e-b90e-493b-904a-5f533757c60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converting VIF {"id": "898bcd3e-b90e-493b-904a-5f533757c60e", "address": "fa:16:3e:b3:e6:5a", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898bcd3e-b9", "ovs_interfaceid": "898bcd3e-b90e-493b-904a-5f533757c60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:e6:5a,bridge_name='br-int',has_traffic_filtering=True,id=898bcd3e-b90e-493b-904a-5f533757c60e,network=Network(6b21de98-8e99-4cf6-8fb2-b2554c54c9c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898bcd3e-b9') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.objects.instance [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ce9072b-e003-4921-83bc-8f3449c09e14 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:59:49 user nova-compute[74669]:   <uuid>0ce9072b-e003-4921-83bc-8f3449c09e14</uuid>
Nov 08 16:59:49 user nova-compute[74669]:   <name>instance-0000000e</name>
Nov 08 16:59:49 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:59:49 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:59:49 user nova-compute[74669]:   <metadata>
Nov 08 16:59:49 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:59:49 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:59:49 user nova-compute[74669]:       <nova:name>tempest-device-tagging-server-1773552603</nova:name>
Nov 08 16:59:49 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:59:43</nova:creationTime>
Nov 08 16:59:49 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:59:49 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:59:49 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:59:49 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:59:49 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:59:49 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:59:49 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:59:49 user nova-compute[74669]:       <nova:owner>
Nov 08 16:59:49 user nova-compute[74669]:         <nova:user uuid="756930c1b18340a9a0cfe3f95d9b89c6">tempest-TaggedBootDevicesTest-1066904042-project-member</nova:user>
Nov 08 16:59:49 user nova-compute[74669]:         <nova:project uuid="44e866b4d7344b81b53cf1e4484faf29">tempest-TaggedBootDevicesTest-1066904042</nova:project>
Nov 08 16:59:49 user nova-compute[74669]:       </nova:owner>
Nov 08 16:59:49 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:59:49 user nova-compute[74669]:       <nova:ports>
Nov 08 16:59:49 user nova-compute[74669]:         <nova:port uuid="314df0da-c133-46af-bdc1-a317e71ca069">
Nov 08 16:59:49 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 16:59:49 user nova-compute[74669]:         </nova:port>
Nov 08 16:59:49 user nova-compute[74669]:         <nova:port uuid="98dcc41a-801d-4934-8069-75d814493170">
Nov 08 16:59:49 user nova-compute[74669]:           <nova:ip type="fixed" address="10.1.1.86" ipVersion="4"/>
Nov 08 16:59:49 user nova-compute[74669]:         </nova:port>
Nov 08 16:59:49 user nova-compute[74669]:         <nova:port uuid="3416a767-03a6-4f75-8b8b-979eed5ddabe">
Nov 08 16:59:49 user nova-compute[74669]:           <nova:ip type="fixed" address="10.1.1.170" ipVersion="4"/>
Nov 08 16:59:49 user nova-compute[74669]:         </nova:port>
Nov 08 16:59:49 user nova-compute[74669]:         <nova:port uuid="82aa3c9f-7823-4948-9496-449cb8e12f0b">
Nov 08 16:59:49 user nova-compute[74669]:           <nova:ip type="fixed" address="10.1.1.205" ipVersion="4"/>
Nov 08 16:59:49 user nova-compute[74669]:         </nova:port>
Nov 08 16:59:49 user nova-compute[74669]:         <nova:port uuid="f1dac6ca-fd45-42d7-9f01-32891331b7ba">
Nov 08 16:59:49 user nova-compute[74669]:           <nova:ip type="fixed" address="10.1.1.191" ipVersion="4"/>
Nov 08 16:59:49 user nova-compute[74669]:         </nova:port>
Nov 08 16:59:49 user nova-compute[74669]:         <nova:port uuid="1e4adfe0-b13d-49ae-8766-5e4dfe754427">
Nov 08 16:59:49 user nova-compute[74669]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 08 16:59:49 user nova-compute[74669]:         </nova:port>
Nov 08 16:59:49 user nova-compute[74669]:         <nova:port uuid="898bcd3e-b90e-493b-904a-5f533757c60e">
Nov 08 16:59:49 user nova-compute[74669]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 08 16:59:49 user nova-compute[74669]:         </nova:port>
Nov 08 16:59:49 user nova-compute[74669]:       </nova:ports>
Nov 08 16:59:49 user nova-compute[74669]:     </nova:instance>
Nov 08 16:59:49 user nova-compute[74669]:   </metadata>
Nov 08 16:59:49 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:59:49 user nova-compute[74669]:     <system>
Nov 08 16:59:49 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:59:49 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:59:49 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:59:49 user nova-compute[74669]:       <entry name="serial">0ce9072b-e003-4921-83bc-8f3449c09e14</entry>
Nov 08 16:59:49 user nova-compute[74669]:       <entry name="uuid">0ce9072b-e003-4921-83bc-8f3449c09e14</entry>
Nov 08 16:59:49 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:59:49 user nova-compute[74669]:     </system>
Nov 08 16:59:49 user nova-compute[74669]:   </sysinfo>
Nov 08 16:59:49 user nova-compute[74669]:   <os>
Nov 08 16:59:49 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:59:49 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 16:59:49 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:59:49 user nova-compute[74669]:   </os>
Nov 08 16:59:49 user nova-compute[74669]:   <features>
Nov 08 16:59:49 user nova-compute[74669]:     <acpi/>
Nov 08 16:59:49 user nova-compute[74669]:     <apic/>
Nov 08 16:59:49 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:59:49 user nova-compute[74669]:   </features>
Nov 08 16:59:49 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:59:49 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:59:49 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:59:49 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:59:49 user nova-compute[74669]:   </clock>
Nov 08 16:59:49 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:59:49 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:59:49 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:59:49 user nova-compute[74669]:   </cpu>
Nov 08 16:59:49 user nova-compute[74669]:   <devices>
Nov 08 16:59:49 user nova-compute[74669]:     <disk type="file" device="cdrom">
Nov 08 16:59:49 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 16:59:49 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/0ce9072b-e003-4921-83bc-8f3449c09e14/disk.config"/>
Nov 08 16:59:49 user nova-compute[74669]:       <target dev="hda" bus="ide"/>
Nov 08 16:59:49 user nova-compute[74669]:     </disk>
Nov 08 16:59:49 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 16:59:49 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:59:49 user nova-compute[74669]:       <source dev="/dev/sdd"/>
Nov 08 16:59:49 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:59:49 user nova-compute[74669]:       <serial>393d7383-44a3-4a2f-87f2-b2eb33f3acf5</serial>
Nov 08 16:59:49 user nova-compute[74669]:     </disk>
Nov 08 16:59:49 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 16:59:49 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:59:49 user nova-compute[74669]:       <source dev="/dev/sde"/>
Nov 08 16:59:49 user nova-compute[74669]:       <target dev="vdb" bus="virtio"/>
Nov 08 16:59:49 user nova-compute[74669]:       <serial>3270c5a2-1029-4533-9b41-5c9fb2b0ba55</serial>
Nov 08 16:59:49 user nova-compute[74669]:     </disk>
Nov 08 16:59:49 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 16:59:49 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 16:59:49 user nova-compute[74669]:       <source dev="/dev/sdf"/>
Nov 08 16:59:49 user nova-compute[74669]:       <target dev="vdc" bus="virtio"/>
Nov 08 16:59:49 user nova-compute[74669]:       <serial>cf4034c4-569c-410c-b394-7d8196c17336</serial>
Nov 08 16:59:49 user nova-compute[74669]:     </disk>
Nov 08 16:59:49 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:59:49 user nova-compute[74669]:       <mac address="fa:16:3e:c4:c1:5b"/>
Nov 08 16:59:49 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:59:49 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:59:49 user nova-compute[74669]:       <target dev="tap314df0da-c1"/>
Nov 08 16:59:49 user nova-compute[74669]:     </interface>
Nov 08 16:59:49 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:59:49 user nova-compute[74669]:       <mac address="fa:16:3e:4a:0a:4b"/>
Nov 08 16:59:49 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:59:49 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:59:49 user nova-compute[74669]:       <target dev="tap98dcc41a-80"/>
Nov 08 16:59:49 user nova-compute[74669]:     </interface>
Nov 08 16:59:49 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:59:49 user nova-compute[74669]:       <mac address="fa:16:3e:9d:06:2c"/>
Nov 08 16:59:49 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:59:49 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:59:49 user nova-compute[74669]:       <target dev="tap3416a767-03"/>
Nov 08 16:59:49 user nova-compute[74669]:     </interface>
Nov 08 16:59:49 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:59:49 user nova-compute[74669]:       <mac address="fa:16:3e:a4:bd:59"/>
Nov 08 16:59:49 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:59:49 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:59:49 user nova-compute[74669]:       <target dev="tap82aa3c9f-78"/>
Nov 08 16:59:49 user nova-compute[74669]:     </interface>
Nov 08 16:59:49 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:59:49 user nova-compute[74669]:       <mac address="fa:16:3e:c3:25:4b"/>
Nov 08 16:59:49 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:59:49 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:59:49 user nova-compute[74669]:       <target dev="tapf1dac6ca-fd"/>
Nov 08 16:59:49 user nova-compute[74669]:     </interface>
Nov 08 16:59:49 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:59:49 user nova-compute[74669]:       <mac address="fa:16:3e:6a:5e:82"/>
Nov 08 16:59:49 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:59:49 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:59:49 user nova-compute[74669]:       <target dev="tap1e4adfe0-b1"/>
Nov 08 16:59:49 user nova-compute[74669]:     </interface>
Nov 08 16:59:49 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:59:49 user nova-compute[74669]:       <mac address="fa:16:3e:b3:e6:5a"/>
Nov 08 16:59:49 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:59:49 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:59:49 user nova-compute[74669]:       <target dev="tap898bcd3e-b9"/>
Nov 08 16:59:49 user nova-compute[74669]:     </interface>
Nov 08 16:59:49 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:59:49 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/0ce9072b-e003-4921-83bc-8f3449c09e14/console.log" append="off"/>
Nov 08 16:59:49 user nova-compute[74669]:     </serial>
Nov 08 16:59:49 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:59:49 user nova-compute[74669]:     <video>
Nov 08 16:59:49 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:59:49 user nova-compute[74669]:     </video>
Nov 08 16:59:49 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:59:49 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:59:49 user nova-compute[74669]:     </rng>
Nov 08 16:59:49 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:59:49 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:59:49 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:59:49 user nova-compute[74669]:     </memballoon>
Nov 08 16:59:49 user nova-compute[74669]:   </devices>
Nov 08 16:59:49 user nova-compute[74669]: </domain>
Nov 08 16:59:49 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1773552603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1773552603',id=14,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoDrsOl1L2B2ygRhUPagQG+XN+24BbCzGghObLHCJCNkchqh4x0gnszO53qEkfFR5YFjsCnFLWZGnFmn91XOUwSylaYJe/NOr19YHyyPXKCT8yLEBwZOglZlBB1tEulww==',key_name='tempest-keypair-277180508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44e866b4d7344b81b53cf1e4484faf29',ramdisk_id='',reservation_id='r-xogjbe7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1066904042',owner_user_name='tempest-TaggedBootDevicesTest-1066904042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='756930c1b18340a9a0cfe3f95d9b89c6',uuid=0ce9072b-e003-4921-83bc-8f3449c09e14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "314df0da-c133-46af-bdc1-a317e71ca069", "address": "fa:16:3e:c4:c1:5b", "network": {"id": "ee33eeed-0f37-4f56-aa18-e6c986e10eb7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-786579928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314df0da-c1", "ovs_interfaceid": "314df0da-c133-46af-bdc1-a317e71ca069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converting VIF {"id": "314df0da-c133-46af-bdc1-a317e71ca069", "address": "fa:16:3e:c4:c1:5b", "network": {"id": "ee33eeed-0f37-4f56-aa18-e6c986e10eb7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-786579928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314df0da-c1", "ovs_interfaceid": "314df0da-c133-46af-bdc1-a317e71ca069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:c1:5b,bridge_name='br-int',has_traffic_filtering=True,id=314df0da-c133-46af-bdc1-a317e71ca069,network=Network(ee33eeed-0f37-4f56-aa18-e6c986e10eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap314df0da-c1') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG os_vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:c1:5b,bridge_name='br-int',has_traffic_filtering=True,id=314df0da-c133-46af-bdc1-a317e71ca069,network=Network(ee33eeed-0f37-4f56-aa18-e6c986e10eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap314df0da-c1') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '802e1ec6-b72b-5354-a0ba-972127fc83ef', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap314df0da-c1, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap314df0da-c1, col_values=(('qos', UUID('5081f88c-624c-46ed-99b4-cf62aa8c6888')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap314df0da-c1, col_values=(('external_ids', {'iface-id': '314df0da-c133-46af-bdc1-a317e71ca069', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:c1:5b', 'vm-uuid': '0ce9072b-e003-4921-83bc-8f3449c09e14'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:49 user nova-compute[74669]: INFO os_vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:c1:5b,bridge_name='br-int',has_traffic_filtering=True,id=314df0da-c133-46af-bdc1-a317e71ca069,network=Network(ee33eeed-0f37-4f56-aa18-e6c986e10eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap314df0da-c1')
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1773552603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1773552603',id=14,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoDrsOl1L2B2ygRhUPagQG+XN+24BbCzGghObLHCJCNkchqh4x0gnszO53qEkfFR5YFjsCnFLWZGnFmn91XOUwSylaYJe/NOr19YHyyPXKCT8yLEBwZOglZlBB1tEulww==',key_name='tempest-keypair-277180508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44e866b4d7344b81b53cf1e4484faf29',ramdisk_id='',reservation_id='r-xogjbe7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1066904042',owner_user_name='tempest-TaggedBootDevicesTest-1066904042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='756930c1b18340a9a0cfe3f95d9b89c6',uuid=0ce9072b-e003-4921-83bc-8f3449c09e14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98dcc41a-801d-4934-8069-75d814493170", "address": "fa:16:3e:4a:0a:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98dcc41a-80", "ovs_interfaceid": "98dcc41a-801d-4934-8069-75d814493170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converting VIF {"id": "98dcc41a-801d-4934-8069-75d814493170", "address": "fa:16:3e:4a:0a:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98dcc41a-80", "ovs_interfaceid": "98dcc41a-801d-4934-8069-75d814493170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:0a:4b,bridge_name='br-int',has_traffic_filtering=True,id=98dcc41a-801d-4934-8069-75d814493170,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98dcc41a-80') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG os_vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:0a:4b,bridge_name='br-int',has_traffic_filtering=True,id=98dcc41a-801d-4934-8069-75d814493170,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98dcc41a-80') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c49fd800-7b99-5778-9dde-9e6c0924ab5c', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98dcc41a-80, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98dcc41a-80, col_values=(('qos', UUID('8702ddbd-2a3e-4515-bf3a-8b6060104715')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98dcc41a-80, col_values=(('external_ids', {'iface-id': '98dcc41a-801d-4934-8069-75d814493170', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:0a:4b', 'vm-uuid': '0ce9072b-e003-4921-83bc-8f3449c09e14'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:49 user nova-compute[74669]: INFO os_vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:0a:4b,bridge_name='br-int',has_traffic_filtering=True,id=98dcc41a-801d-4934-8069-75d814493170,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98dcc41a-80')
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1773552603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1773552603',id=14,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoDrsOl1L2B2ygRhUPagQG+XN+24BbCzGghObLHCJCNkchqh4x0gnszO53qEkfFR5YFjsCnFLWZGnFmn91XOUwSylaYJe/NOr19YHyyPXKCT8yLEBwZOglZlBB1tEulww==',key_name='tempest-keypair-277180508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44e866b4d7344b81b53cf1e4484faf29',ramdisk_id='',reservation_id='r-xogjbe7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1066904042',owner_user_name='tempest-TaggedBootDevicesTest-1066904042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='756930c1b18340a9a0cfe3f95d9b89c6',uuid=0ce9072b-e003-4921-83bc-8f3449c09e14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "address": "fa:16:3e:9d:06:2c", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3416a767-03", "ovs_interfaceid": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converting VIF {"id": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "address": "fa:16:3e:9d:06:2c", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3416a767-03", "ovs_interfaceid": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:06:2c,bridge_name='br-int',has_traffic_filtering=True,id=3416a767-03a6-4f75-8b8b-979eed5ddabe,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3416a767-03') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG os_vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:06:2c,bridge_name='br-int',has_traffic_filtering=True,id=3416a767-03a6-4f75-8b8b-979eed5ddabe,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3416a767-03') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '792e38eb-84d0-518a-90a3-69cce9d95d66', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3416a767-03, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3416a767-03, col_values=(('qos', UUID('29e4cc83-7e3b-4f0c-9cfd-85b8db8e57a6')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3416a767-03, col_values=(('external_ids', {'iface-id': '3416a767-03a6-4f75-8b8b-979eed5ddabe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:06:2c', 'vm-uuid': '0ce9072b-e003-4921-83bc-8f3449c09e14'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:49 user nova-compute[74669]: INFO os_vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:06:2c,bridge_name='br-int',has_traffic_filtering=True,id=3416a767-03a6-4f75-8b8b-979eed5ddabe,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3416a767-03')
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1773552603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1773552603',id=14,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoDrsOl1L2B2ygRhUPagQG+XN+24BbCzGghObLHCJCNkchqh4x0gnszO53qEkfFR5YFjsCnFLWZGnFmn91XOUwSylaYJe/NOr19YHyyPXKCT8yLEBwZOglZlBB1tEulww==',key_name='tempest-keypair-277180508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44e866b4d7344b81b53cf1e4484faf29',ramdisk_id='',reservation_id='r-xogjbe7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1066904042',owner_user_name='tempest-TaggedBootDevicesTest-1066904042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='756930c1b18340a9a0cfe3f95d9b89c6',uuid=0ce9072b-e003-4921-83bc-8f3449c09e14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "address": "fa:16:3e:a4:bd:59", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82aa3c9f-78", "ovs_interfaceid": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converting VIF {"id": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "address": "fa:16:3e:a4:bd:59", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82aa3c9f-78", "ovs_interfaceid": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:bd:59,bridge_name='br-int',has_traffic_filtering=True,id=82aa3c9f-7823-4948-9496-449cb8e12f0b,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82aa3c9f-78') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG os_vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:bd:59,bridge_name='br-int',has_traffic_filtering=True,id=82aa3c9f-7823-4948-9496-449cb8e12f0b,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82aa3c9f-78') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32f6093f-21a8-57a5-acba-e81fc72a729f', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82aa3c9f-78, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82aa3c9f-78, col_values=(('qos', UUID('8becaf68-1221-42b1-a817-62078b9b272c')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82aa3c9f-78, col_values=(('external_ids', {'iface-id': '82aa3c9f-7823-4948-9496-449cb8e12f0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:bd:59', 'vm-uuid': '0ce9072b-e003-4921-83bc-8f3449c09e14'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: INFO os_vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:bd:59,bridge_name='br-int',has_traffic_filtering=True,id=82aa3c9f-7823-4948-9496-449cb8e12f0b,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82aa3c9f-78')
Nov 08 16:59:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1773552603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1773552603',id=14,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoDrsOl1L2B2ygRhUPagQG+XN+24BbCzGghObLHCJCNkchqh4x0gnszO53qEkfFR5YFjsCnFLWZGnFmn91XOUwSylaYJe/NOr19YHyyPXKCT8yLEBwZOglZlBB1tEulww==',key_name='tempest-keypair-277180508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44e866b4d7344b81b53cf1e4484faf29',ramdisk_id='',reservation_id='r-xogjbe7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1066904042',owner_user_name='tempest-TaggedBootDevicesTest-1066904042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='756930c1b18340a9a0cfe3f95d9b89c6',uuid=0ce9072b-e003-4921-83bc-8f3449c09e14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "address": "fa:16:3e:c3:25:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dac6ca-fd", "ovs_interfaceid": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converting VIF {"id": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "address": "fa:16:3e:c3:25:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dac6ca-fd", "ovs_interfaceid": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:25:4b,bridge_name='br-int',has_traffic_filtering=True,id=f1dac6ca-fd45-42d7-9f01-32891331b7ba,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1dac6ca-fd') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG os_vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:25:4b,bridge_name='br-int',has_traffic_filtering=True,id=f1dac6ca-fd45-42d7-9f01-32891331b7ba,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1dac6ca-fd') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e4b2df5-998a-5a0a-9f00-8eb2a22de08b', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1dac6ca-fd, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf1dac6ca-fd, col_values=(('qos', UUID('22fd76ae-1487-407a-b183-db3ccc59fc35')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf1dac6ca-fd, col_values=(('external_ids', {'iface-id': 'f1dac6ca-fd45-42d7-9f01-32891331b7ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:25:4b', 'vm-uuid': '0ce9072b-e003-4921-83bc-8f3449c09e14'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: INFO os_vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:25:4b,bridge_name='br-int',has_traffic_filtering=True,id=f1dac6ca-fd45-42d7-9f01-32891331b7ba,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1dac6ca-fd')
Nov 08 16:59:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1773552603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1773552603',id=14,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoDrsOl1L2B2ygRhUPagQG+XN+24BbCzGghObLHCJCNkchqh4x0gnszO53qEkfFR5YFjsCnFLWZGnFmn91XOUwSylaYJe/NOr19YHyyPXKCT8yLEBwZOglZlBB1tEulww==',key_name='tempest-keypair-277180508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44e866b4d7344b81b53cf1e4484faf29',ramdisk_id='',reservation_id='r-xogjbe7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1066904042',owner_user_name='tempest-TaggedBootDevicesTest-1066904042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='756930c1b18340a9a0cfe3f95d9b89c6',uuid=0ce9072b-e003-4921-83bc-8f3449c09e14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "address": "fa:16:3e:6a:5e:82", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4adfe0-b1", "ovs_interfaceid": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converting VIF {"id": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "address": "fa:16:3e:6a:5e:82", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4adfe0-b1", "ovs_interfaceid": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=1e4adfe0-b13d-49ae-8766-5e4dfe754427,network=Network(6b21de98-8e99-4cf6-8fb2-b2554c54c9c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e4adfe0-b1') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG os_vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=1e4adfe0-b13d-49ae-8766-5e4dfe754427,network=Network(6b21de98-8e99-4cf6-8fb2-b2554c54c9c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e4adfe0-b1') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '171a0995-2977-54a6-bfcc-78ed7c5dc35c', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e4adfe0-b1, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e4adfe0-b1, col_values=(('qos', UUID('3ad2b81f-2b0d-499e-8424-d4914d0a8ab0')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e4adfe0-b1, col_values=(('external_ids', {'iface-id': '1e4adfe0-b13d-49ae-8766-5e4dfe754427', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:5e:82', 'vm-uuid': '0ce9072b-e003-4921-83bc-8f3449c09e14'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: INFO os_vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=1e4adfe0-b13d-49ae-8766-5e4dfe754427,network=Network(6b21de98-8e99-4cf6-8fb2-b2554c54c9c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e4adfe0-b1')
Nov 08 16:59:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1773552603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1773552603',id=14,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoDrsOl1L2B2ygRhUPagQG+XN+24BbCzGghObLHCJCNkchqh4x0gnszO53qEkfFR5YFjsCnFLWZGnFmn91XOUwSylaYJe/NOr19YHyyPXKCT8yLEBwZOglZlBB1tEulww==',key_name='tempest-keypair-277180508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44e866b4d7344b81b53cf1e4484faf29',ramdisk_id='',reservation_id='r-xogjbe7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1066904042',owner_user_name='tempest-TaggedBootDevicesTest-1066904042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='756930c1b18340a9a0cfe3f95d9b89c6',uuid=0ce9072b-e003-4921-83bc-8f3449c09e14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "898bcd3e-b90e-493b-904a-5f533757c60e", "address": "fa:16:3e:b3:e6:5a", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898bcd3e-b9", "ovs_interfaceid": "898bcd3e-b90e-493b-904a-5f533757c60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converting VIF {"id": "898bcd3e-b90e-493b-904a-5f533757c60e", "address": "fa:16:3e:b3:e6:5a", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898bcd3e-b9", "ovs_interfaceid": "898bcd3e-b90e-493b-904a-5f533757c60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:e6:5a,bridge_name='br-int',has_traffic_filtering=True,id=898bcd3e-b90e-493b-904a-5f533757c60e,network=Network(6b21de98-8e99-4cf6-8fb2-b2554c54c9c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898bcd3e-b9') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG os_vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:e6:5a,bridge_name='br-int',has_traffic_filtering=True,id=898bcd3e-b90e-493b-904a-5f533757c60e,network=Network(6b21de98-8e99-4cf6-8fb2-b2554c54c9c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898bcd3e-b9') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7cedb46-82e8-5798-9346-c3f208e07479', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:50 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:59:50 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:59:50 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=7937MB free_disk=25.54857635498047GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap898bcd3e-b9, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap898bcd3e-b9, col_values=(('qos', UUID('2f2cd4a2-7228-4688-8ccd-96c150ca399e')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap898bcd3e-b9, col_values=(('external_ids', {'iface-id': '898bcd3e-b90e-493b-904a-5f533757c60e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:e6:5a', 'vm-uuid': '0ce9072b-e003-4921-83bc-8f3449c09e14'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:51 user nova-compute[74669]: INFO os_vif [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:e6:5a,bridge_name='br-int',has_traffic_filtering=True,id=898bcd3e-b90e-493b-904a-5f533757c60e,network=Network(6b21de98-8e99-4cf6-8fb2-b2554c54c9c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898bcd3e-b9')
Nov 08 16:59:51 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:59:51 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:59:51 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b26dbeeb-b629-414d-bcca-cdde6c207789 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:59:51 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 1b9ad090-c7bb-4a11-a056-19902844dbf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:59:51 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0ce9072b-e003-4921-83bc-8f3449c09e14 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:59:51 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7b335462-0d93-4899-a223-5c2e36932578 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:59:51 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b663cd16-12b5-48fc-886d-0a7d160faea5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 16:59:51 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 16:59:51 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 16:59:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] No BDM found with device name hda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:59:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:59:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] No VIF found with MAC fa:16:3e:c4:c1:5b, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:59:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] No VIF found with MAC fa:16:3e:c3:25:4b, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:59:51 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Using config drive
Nov 08 16:59:51 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:59:51 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:59:51 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 16:59:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.637s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:51 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Creating config drive at /opt/stack/data/nova/instances/0ce9072b-e003-4921-83bc-8f3449c09e14/disk.config
Nov 08 16:59:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0ce9072b-e003-4921-83bc-8f3449c09e14/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbn7fvx19 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0ce9072b-e003-4921-83bc-8f3449c09e14/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbn7fvx19" returned: 0 in 0.072s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:52 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:59:52 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 16:59:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:59:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:59:52 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 16:59:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "55c67717-eb46-4617-9165-28531360e5d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "55c67717-eb46-4617-9165-28531360e5d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:52 user nova-compute[74669]: DEBUG nova.compute.manager [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 16:59:53 user nova-compute[74669]: INFO nova.compute.claims [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Claim successful on node user
Nov 08 16:59:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG nova.compute.manager [req-f61279dd-d6dd-47cd-a9f1-1a760878eb9c req-f59d0721-f67d-4a83-92e3-03fedee94624 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-plugged-314df0da-c133-46af-bdc1-a317e71ca069 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f61279dd-d6dd-47cd-a9f1-1a760878eb9c req-f59d0721-f67d-4a83-92e3-03fedee94624 service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f61279dd-d6dd-47cd-a9f1-1a760878eb9c req-f59d0721-f67d-4a83-92e3-03fedee94624 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f61279dd-d6dd-47cd-a9f1-1a760878eb9c req-f59d0721-f67d-4a83-92e3-03fedee94624 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG nova.compute.manager [req-f61279dd-d6dd-47cd-a9f1-1a760878eb9c req-f59d0721-f67d-4a83-92e3-03fedee94624 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-plugged-314df0da-c133-46af-bdc1-a317e71ca069 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:53 user nova-compute[74669]: WARNING nova.compute.manager [req-f61279dd-d6dd-47cd-a9f1-1a760878eb9c req-f59d0721-f67d-4a83-92e3-03fedee94624 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received unexpected event network-vif-plugged-314df0da-c133-46af-bdc1-a317e71ca069 for instance with vm_state building and task_state spawning.
Nov 08 16:59:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Updating instance_info_cache with network_info: [{"id": "525ba5da-155c-4f87-9fae-8db52836f73e", "address": "fa:16:3e:7b:7c:e2", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525ba5da-15", "ovs_interfaceid": "525ba5da-155c-4f87-9fae-8db52836f73e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.713s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG nova.compute.manager [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 16:59:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG nova.compute.manager [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG nova.network.neutron [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:54 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 16:59:54 user nova-compute[74669]: DEBUG nova.compute.manager [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG nova.policy [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8bcb0586bce42a3a1a59b2cbc99f846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1e9778e17a4e0fa1aa1f41d323a88c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG nova.compute.manager [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 16:59:54 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Creating image(s)
Nov 08 16:59:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "/opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "/opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "/opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.092s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.368s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.286s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk 1073741824" returned: 0 in 0.082s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.376s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.309s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Acquiring lock "c20b4c52-94b1-4aed-98f0-ae228df81175" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG nova.network.neutron [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Successfully created port: 8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG nova.compute.manager [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG nova.compute.manager [req-f917524b-ca4b-4118-8d3b-4dd466885390 req-bc60f60b-c0e1-45d3-b55e-dc187519efd3 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-plugged-1e4adfe0-b13d-49ae-8766-5e4dfe754427 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f917524b-ca4b-4118-8d3b-4dd466885390 req-bc60f60b-c0e1-45d3-b55e-dc187519efd3 service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f917524b-ca4b-4118-8d3b-4dd466885390 req-bc60f60b-c0e1-45d3-b55e-dc187519efd3 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f917524b-ca4b-4118-8d3b-4dd466885390 req-bc60f60b-c0e1-45d3-b55e-dc187519efd3 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG nova.compute.manager [req-f917524b-ca4b-4118-8d3b-4dd466885390 req-bc60f60b-c0e1-45d3-b55e-dc187519efd3 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-plugged-1e4adfe0-b13d-49ae-8766-5e4dfe754427 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:55 user nova-compute[74669]: WARNING nova.compute.manager [req-f917524b-ca4b-4118-8d3b-4dd466885390 req-bc60f60b-c0e1-45d3-b55e-dc187519efd3 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received unexpected event network-vif-plugged-1e4adfe0-b13d-49ae-8766-5e4dfe754427 for instance with vm_state building and task_state spawning.
Nov 08 16:59:55 user nova-compute[74669]: DEBUG nova.compute.manager [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-plugged-314df0da-c133-46af-bdc1-a317e71ca069 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG nova.compute.manager [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-plugged-314df0da-c133-46af-bdc1-a317e71ca069 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:55 user nova-compute[74669]: WARNING nova.compute.manager [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received unexpected event network-vif-plugged-314df0da-c133-46af-bdc1-a317e71ca069 for instance with vm_state building and task_state spawning.
Nov 08 16:59:55 user nova-compute[74669]: DEBUG nova.compute.manager [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-plugged-98dcc41a-801d-4934-8069-75d814493170 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG nova.compute.manager [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-plugged-98dcc41a-801d-4934-8069-75d814493170 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:55 user nova-compute[74669]: WARNING nova.compute.manager [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received unexpected event network-vif-plugged-98dcc41a-801d-4934-8069-75d814493170 for instance with vm_state building and task_state spawning.
Nov 08 16:59:55 user nova-compute[74669]: DEBUG nova.compute.manager [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-plugged-98dcc41a-801d-4934-8069-75d814493170 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG nova.compute.manager [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-plugged-98dcc41a-801d-4934-8069-75d814493170 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:55 user nova-compute[74669]: WARNING nova.compute.manager [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received unexpected event network-vif-plugged-98dcc41a-801d-4934-8069-75d814493170 for instance with vm_state building and task_state spawning.
Nov 08 16:59:55 user nova-compute[74669]: DEBUG nova.compute.manager [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-plugged-3416a767-03a6-4f75-8b8b-979eed5ddabe {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG nova.compute.manager [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-plugged-3416a767-03a6-4f75-8b8b-979eed5ddabe {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:55 user nova-compute[74669]: WARNING nova.compute.manager [req-ed3af6b9-07cd-4aed-bfd5-e06695636572 req-d5029bbe-7edf-4cc6-8a20-9a583d75cf83 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received unexpected event network-vif-plugged-3416a767-03a6-4f75-8b8b-979eed5ddabe for instance with vm_state building and task_state spawning.
Nov 08 16:59:55 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 16:59:55 user nova-compute[74669]: INFO nova.compute.claims [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Claim successful on node user
Nov 08 16:59:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk --force-share --output=json" returned: 0 in 0.339s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Cannot resize image /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Ensure instance console log exists: /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:56 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 16:59:56 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 16:59:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.814s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:56 user nova-compute[74669]: DEBUG nova.compute.manager [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 16:59:56 user nova-compute[74669]: DEBUG nova.network.neutron [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Successfully updated port: 8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:59:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "refresh_cache-55c67717-eb46-4617-9165-28531360e5d7" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:59:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquired lock "refresh_cache-55c67717-eb46-4617-9165-28531360e5d7" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:59:56 user nova-compute[74669]: DEBUG nova.network.neutron [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:59:56 user nova-compute[74669]: DEBUG nova.compute.manager [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 16:59:56 user nova-compute[74669]: DEBUG nova.network.neutron [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 16:59:56 user nova-compute[74669]: DEBUG nova.compute.manager [req-8631d54b-6ebd-49f5-8ce8-636c000c1b86 req-204ee9eb-44af-40dd-88d8-ddf039b54599 service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Received event network-changed-8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:56 user nova-compute[74669]: DEBUG nova.compute.manager [req-8631d54b-6ebd-49f5-8ce8-636c000c1b86 req-204ee9eb-44af-40dd-88d8-ddf039b54599 service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Refreshing instance network info cache due to event network-changed-8e437d3e-12dd-4bec-aa76-2951dc03b5eb. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:59:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8631d54b-6ebd-49f5-8ce8-636c000c1b86 req-204ee9eb-44af-40dd-88d8-ddf039b54599 service nova] Acquiring lock "refresh_cache-55c67717-eb46-4617-9165-28531360e5d7" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:59:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:56 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 16:59:56 user nova-compute[74669]: DEBUG nova.compute.manager [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 16:59:56 user nova-compute[74669]: DEBUG nova.policy [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbcab9c7167b463aa19203215af5a91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf3cd12d36542129de95b6a2b473906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 16:59:56 user nova-compute[74669]: DEBUG nova.network.neutron [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:59:56 user nova-compute[74669]: DEBUG nova.compute.manager [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 16:59:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 16:59:56 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Creating image(s)
Nov 08 16:59:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Acquiring lock "/opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "/opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.007s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "/opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.203s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.222s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk 1073741824" returned: 0 in 0.068s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.network.neutron [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Updating instance_info_cache with network_info: [{"id": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "address": "fa:16:3e:79:63:9e", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e437d3e-12", "ovs_interfaceid": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Releasing lock "refresh_cache-55c67717-eb46-4617-9165-28531360e5d7" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.compute.manager [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Instance network_info: |[{"id": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "address": "fa:16:3e:79:63:9e", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e437d3e-12", "ovs_interfaceid": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8631d54b-6ebd-49f5-8ce8-636c000c1b86 req-204ee9eb-44af-40dd-88d8-ddf039b54599 service nova] Acquired lock "refresh_cache-55c67717-eb46-4617-9165-28531360e5d7" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.network.neutron [req-8631d54b-6ebd-49f5-8ce8-636c000c1b86 req-204ee9eb-44af-40dd-88d8-ddf039b54599 service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Refreshing network info cache for port 8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Start _get_guest_xml network_info=[{"id": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "address": "fa:16:3e:79:63:9e", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e437d3e-12", "ovs_interfaceid": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:57 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:59:57 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:59:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-287785015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-287785015',id=17,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqTEGMrhgsJerp3F07Qjp9lZ3WIFCasSJwyynJzvn5F9IQ6K479N2ZxX951BDCBv5rK5xSEBYvlpUodpv7Vp0m4MieCBpJEx9IDLx1wyhScDRdXhBk/8ggJAZZ7b45+jg==',key_name='tempest-keypair-185784068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f1e9778e17a4e0fa1aa1f41d323a88c',ramdisk_id='',reservation_id='r-fr2itb4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-317302826',owner_user_name='tempest-AttachVolumeShelveTestJSON-317302826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:59:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8bcb0586bce42a3a1a59b2cbc99f846',uuid=55c67717-eb46-4617-9165-28531360e5d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "address": "fa:16:3e:79:63:9e", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e437d3e-12", "ovs_interfaceid": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converting VIF {"id": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "address": "fa:16:3e:79:63:9e", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e437d3e-12", "ovs_interfaceid": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:63:9e,bridge_name='br-int',has_traffic_filtering=True,id=8e437d3e-12dd-4bec-aa76-2951dc03b5eb,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e437d3e-12') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.objects.instance [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lazy-loading 'pci_devices' on Instance uuid 55c67717-eb46-4617-9165-28531360e5d7 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.network.neutron [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Successfully created port: 1f3f9a10-8444-4120-859e-c682589df53e {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:59:57 user nova-compute[74669]:   <uuid>55c67717-eb46-4617-9165-28531360e5d7</uuid>
Nov 08 16:59:57 user nova-compute[74669]:   <name>instance-00000011</name>
Nov 08 16:59:57 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:59:57 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:59:57 user nova-compute[74669]:   <metadata>
Nov 08 16:59:57 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:59:57 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:59:57 user nova-compute[74669]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-287785015</nova:name>
Nov 08 16:59:57 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:59:57</nova:creationTime>
Nov 08 16:59:57 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:59:57 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:59:57 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:59:57 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:59:57 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:59:57 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:59:57 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:59:57 user nova-compute[74669]:       <nova:owner>
Nov 08 16:59:57 user nova-compute[74669]:         <nova:user uuid="d8bcb0586bce42a3a1a59b2cbc99f846">tempest-AttachVolumeShelveTestJSON-317302826-project-member</nova:user>
Nov 08 16:59:57 user nova-compute[74669]:         <nova:project uuid="9f1e9778e17a4e0fa1aa1f41d323a88c">tempest-AttachVolumeShelveTestJSON-317302826</nova:project>
Nov 08 16:59:57 user nova-compute[74669]:       </nova:owner>
Nov 08 16:59:57 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:59:57 user nova-compute[74669]:       <nova:ports>
Nov 08 16:59:57 user nova-compute[74669]:         <nova:port uuid="8e437d3e-12dd-4bec-aa76-2951dc03b5eb">
Nov 08 16:59:57 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 16:59:57 user nova-compute[74669]:         </nova:port>
Nov 08 16:59:57 user nova-compute[74669]:       </nova:ports>
Nov 08 16:59:57 user nova-compute[74669]:     </nova:instance>
Nov 08 16:59:57 user nova-compute[74669]:   </metadata>
Nov 08 16:59:57 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:59:57 user nova-compute[74669]:     <system>
Nov 08 16:59:57 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:59:57 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:59:57 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:59:57 user nova-compute[74669]:       <entry name="serial">55c67717-eb46-4617-9165-28531360e5d7</entry>
Nov 08 16:59:57 user nova-compute[74669]:       <entry name="uuid">55c67717-eb46-4617-9165-28531360e5d7</entry>
Nov 08 16:59:57 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:59:57 user nova-compute[74669]:     </system>
Nov 08 16:59:57 user nova-compute[74669]:   </sysinfo>
Nov 08 16:59:57 user nova-compute[74669]:   <os>
Nov 08 16:59:57 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:59:57 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 16:59:57 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:59:57 user nova-compute[74669]:   </os>
Nov 08 16:59:57 user nova-compute[74669]:   <features>
Nov 08 16:59:57 user nova-compute[74669]:     <acpi/>
Nov 08 16:59:57 user nova-compute[74669]:     <apic/>
Nov 08 16:59:57 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:59:57 user nova-compute[74669]:   </features>
Nov 08 16:59:57 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:59:57 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:59:57 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:59:57 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:59:57 user nova-compute[74669]:   </clock>
Nov 08 16:59:57 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:59:57 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:59:57 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:59:57 user nova-compute[74669]:   </cpu>
Nov 08 16:59:57 user nova-compute[74669]:   <devices>
Nov 08 16:59:57 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:59:57 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:59:57 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk"/>
Nov 08 16:59:57 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:59:57 user nova-compute[74669]:     </disk>
Nov 08 16:59:57 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:59:57 user nova-compute[74669]:       <mac address="fa:16:3e:79:63:9e"/>
Nov 08 16:59:57 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:59:57 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:59:57 user nova-compute[74669]:       <target dev="tap8e437d3e-12"/>
Nov 08 16:59:57 user nova-compute[74669]:     </interface>
Nov 08 16:59:57 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:59:57 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/console.log" append="off"/>
Nov 08 16:59:57 user nova-compute[74669]:     </serial>
Nov 08 16:59:57 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:59:57 user nova-compute[74669]:     <video>
Nov 08 16:59:57 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:59:57 user nova-compute[74669]:     </video>
Nov 08 16:59:57 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:59:57 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:59:57 user nova-compute[74669]:     </rng>
Nov 08 16:59:57 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:59:57 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:59:57 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:59:57 user nova-compute[74669]:     </memballoon>
Nov 08 16:59:57 user nova-compute[74669]:   </devices>
Nov 08 16:59:57 user nova-compute[74669]: </domain>
Nov 08 16:59:57 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:59:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-287785015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-287785015',id=17,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqTEGMrhgsJerp3F07Qjp9lZ3WIFCasSJwyynJzvn5F9IQ6K479N2ZxX951BDCBv5rK5xSEBYvlpUodpv7Vp0m4MieCBpJEx9IDLx1wyhScDRdXhBk/8ggJAZZ7b45+jg==',key_name='tempest-keypair-185784068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f1e9778e17a4e0fa1aa1f41d323a88c',ramdisk_id='',reservation_id='r-fr2itb4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-317302826',owner_user_name='tempest-AttachVolumeShelveTestJSON-317302826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:59:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8bcb0586bce42a3a1a59b2cbc99f846',uuid=55c67717-eb46-4617-9165-28531360e5d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "address": "fa:16:3e:79:63:9e", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e437d3e-12", "ovs_interfaceid": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converting VIF {"id": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "address": "fa:16:3e:79:63:9e", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e437d3e-12", "ovs_interfaceid": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:63:9e,bridge_name='br-int',has_traffic_filtering=True,id=8e437d3e-12dd-4bec-aa76-2951dc03b5eb,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e437d3e-12') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG os_vif [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:63:9e,bridge_name='br-int',has_traffic_filtering=True,id=8e437d3e-12dd-4bec-aa76-2951dc03b5eb,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e437d3e-12') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4723ce94-0e33-5085-bdc1-b9b01a450539', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e437d3e-12, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e437d3e-12, col_values=(('qos', UUID('18f9d2ca-9dff-47b1-9f2d-be3e321c3b32')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e437d3e-12, col_values=(('external_ids', {'iface-id': '8e437d3e-12dd-4bec-aa76-2951dc03b5eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:63:9e', 'vm-uuid': '55c67717-eb46-4617-9165-28531360e5d7'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.275s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:57 user nova-compute[74669]: INFO os_vif [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:63:9e,bridge_name='br-int',has_traffic_filtering=True,id=8e437d3e-12dd-4bec-aa76-2951dc03b5eb,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e437d3e-12')
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-1d987ba8-d69b-408a-a236-c99d6f0b5603 req-da99b9b5-1319-4922-8539-7908b5dc0cd5 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-plugged-1e4adfe0-b13d-49ae-8766-5e4dfe754427 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1d987ba8-d69b-408a-a236-c99d6f0b5603 req-da99b9b5-1319-4922-8539-7908b5dc0cd5 service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1d987ba8-d69b-408a-a236-c99d6f0b5603 req-da99b9b5-1319-4922-8539-7908b5dc0cd5 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1d987ba8-d69b-408a-a236-c99d6f0b5603 req-da99b9b5-1319-4922-8539-7908b5dc0cd5 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-1d987ba8-d69b-408a-a236-c99d6f0b5603 req-da99b9b5-1319-4922-8539-7908b5dc0cd5 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-plugged-1e4adfe0-b13d-49ae-8766-5e4dfe754427 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:57 user nova-compute[74669]: WARNING nova.compute.manager [req-1d987ba8-d69b-408a-a236-c99d6f0b5603 req-da99b9b5-1319-4922-8539-7908b5dc0cd5 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received unexpected event network-vif-plugged-1e4adfe0-b13d-49ae-8766-5e4dfe754427 for instance with vm_state building and task_state spawning.
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-plugged-3416a767-03a6-4f75-8b8b-979eed5ddabe {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-plugged-3416a767-03a6-4f75-8b8b-979eed5ddabe {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:57 user nova-compute[74669]: WARNING nova.compute.manager [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received unexpected event network-vif-plugged-3416a767-03a6-4f75-8b8b-979eed5ddabe for instance with vm_state building and task_state spawning.
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-plugged-82aa3c9f-7823-4948-9496-449cb8e12f0b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-plugged-82aa3c9f-7823-4948-9496-449cb8e12f0b {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:57 user nova-compute[74669]: WARNING nova.compute.manager [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received unexpected event network-vif-plugged-82aa3c9f-7823-4948-9496-449cb8e12f0b for instance with vm_state building and task_state spawning.
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-plugged-82aa3c9f-7823-4948-9496-449cb8e12f0b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-plugged-82aa3c9f-7823-4948-9496-449cb8e12f0b {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:57 user nova-compute[74669]: WARNING nova.compute.manager [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received unexpected event network-vif-plugged-82aa3c9f-7823-4948-9496-449cb8e12f0b for instance with vm_state building and task_state spawning.
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-plugged-f1dac6ca-fd45-42d7-9f01-32891331b7ba {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-plugged-f1dac6ca-fd45-42d7-9f01-32891331b7ba {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:57 user nova-compute[74669]: WARNING nova.compute.manager [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received unexpected event network-vif-plugged-f1dac6ca-fd45-42d7-9f01-32891331b7ba for instance with vm_state building and task_state spawning.
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-plugged-f1dac6ca-fd45-42d7-9f01-32891331b7ba {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-plugged-f1dac6ca-fd45-42d7-9f01-32891331b7ba {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:57 user nova-compute[74669]: WARNING nova.compute.manager [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received unexpected event network-vif-plugged-f1dac6ca-fd45-42d7-9f01-32891331b7ba for instance with vm_state building and task_state spawning.
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-plugged-898bcd3e-b90e-493b-904a-5f533757c60e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-plugged-898bcd3e-b90e-493b-904a-5f533757c60e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:57 user nova-compute[74669]: WARNING nova.compute.manager [req-a24017ac-dad4-435f-a01c-f19422f4ffa3 req-62c1b8da-b2f1-441f-a752-3340228cc85c service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received unexpected event network-vif-plugged-898bcd3e-b90e-493b-904a-5f533757c60e for instance with vm_state building and task_state spawning.
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:59:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] No VIF found with MAC fa:16:3e:79:63:9e, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Cannot resize image /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Ensure instance console log exists: /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG nova.network.neutron [req-8631d54b-6ebd-49f5-8ce8-636c000c1b86 req-204ee9eb-44af-40dd-88d8-ddf039b54599 service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Updated VIF entry in instance network info cache for port 8e437d3e-12dd-4bec-aa76-2951dc03b5eb. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG nova.network.neutron [req-8631d54b-6ebd-49f5-8ce8-636c000c1b86 req-204ee9eb-44af-40dd-88d8-ddf039b54599 service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Updating instance_info_cache with network_info: [{"id": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "address": "fa:16:3e:79:63:9e", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e437d3e-12", "ovs_interfaceid": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8631d54b-6ebd-49f5-8ce8-636c000c1b86 req-204ee9eb-44af-40dd-88d8-ddf039b54599 service nova] Releasing lock "refresh_cache-55c67717-eb46-4617-9165-28531360e5d7" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG nova.network.neutron [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Successfully updated port: 1f3f9a10-8444-4120-859e-c682589df53e {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Acquiring lock "refresh_cache-c20b4c52-94b1-4aed-98f0-ae228df81175" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Acquired lock "refresh_cache-c20b4c52-94b1-4aed-98f0-ae228df81175" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG nova.network.neutron [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG nova.network.neutron [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 16:59:58 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Instance spawned successfully.
Nov 08 16:59:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG nova.compute.manager [req-2b41d02e-ae31-4edb-a755-966b9136a99c req-c4be3580-9c5d-4bbe-9b9a-25df9238b5d6 service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Received event network-changed-1f3f9a10-8444-4120-859e-c682589df53e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG nova.compute.manager [req-2b41d02e-ae31-4edb-a755-966b9136a99c req-c4be3580-9c5d-4bbe-9b9a-25df9238b5d6 service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Refreshing instance network info cache due to event network-changed-1f3f9a10-8444-4120-859e-c682589df53e. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 16:59:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2b41d02e-ae31-4edb-a755-966b9136a99c req-c4be3580-9c5d-4bbe-9b9a-25df9238b5d6 service nova] Acquiring lock "refresh_cache-c20b4c52-94b1-4aed-98f0-ae228df81175" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 16:59:58 user nova-compute[74669]: INFO nova.compute.manager [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Took 15.05 seconds to spawn the instance on the hypervisor.
Nov 08 16:59:58 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 16:59:58 user nova-compute[74669]: INFO nova.compute.manager [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Took 129.33 seconds to build instance.
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.network.neutron [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Updating instance_info_cache with network_info: [{"id": "1f3f9a10-8444-4120-859e-c682589df53e", "address": "fa:16:3e:62:af:a3", "network": {"id": "41edded2-dc16-49e9-8b02-b176d6e4ff77", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-901731550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faf3cd12d36542129de95b6a2b473906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3f9a10-84", "ovs_interfaceid": "1f3f9a10-8444-4120-859e-c682589df53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ca1ca45f-4dcf-4ccd-89e1-21fce32ec129 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 129.475s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Releasing lock "refresh_cache-c20b4c52-94b1-4aed-98f0-ae228df81175" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.compute.manager [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Instance network_info: |[{"id": "1f3f9a10-8444-4120-859e-c682589df53e", "address": "fa:16:3e:62:af:a3", "network": {"id": "41edded2-dc16-49e9-8b02-b176d6e4ff77", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-901731550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faf3cd12d36542129de95b6a2b473906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3f9a10-84", "ovs_interfaceid": "1f3f9a10-8444-4120-859e-c682589df53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2b41d02e-ae31-4edb-a755-966b9136a99c req-c4be3580-9c5d-4bbe-9b9a-25df9238b5d6 service nova] Acquired lock "refresh_cache-c20b4c52-94b1-4aed-98f0-ae228df81175" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.network.neutron [req-2b41d02e-ae31-4edb-a755-966b9136a99c req-c4be3580-9c5d-4bbe-9b9a-25df9238b5d6 service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Refreshing network info cache for port 1f3f9a10-8444-4120-859e-c682589df53e {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Start _get_guest_xml network_info=[{"id": "1f3f9a10-8444-4120-859e-c682589df53e", "address": "fa:16:3e:62:af:a3", "network": {"id": "41edded2-dc16-49e9-8b02-b176d6e4ff77", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-901731550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faf3cd12d36542129de95b6a2b473906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3f9a10-84", "ovs_interfaceid": "1f3f9a10-8444-4120-859e-c682589df53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 16:59:59 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:59:59 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1284191940',display_name='tempest-TestServerVolumeAttachmentScenario-server-1284191940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1284191940',id=18,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbJYMlPQ4GKmKUtDbAjenDGMeXLqQpRW5oj85LY3v4pCJeaVU2m8wytGDB15EoXjGERIWPOYapJZ4KWzbHKYKk8yb4Y04AX0h8N6aREyby7hBt8m0c7qdj+9pozuajuEA==',key_name='tempest-keypair-737894091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faf3cd12d36542129de95b6a2b473906',ramdisk_id='',reservation_id='r-d1i60x6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-61284172',owner_user_name='tempest-TestServerVolumeAttachmentScenario-61284172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbcab9c7167b463aa19203215af5a91a',uuid=c20b4c52-94b1-4aed-98f0-ae228df81175,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f3f9a10-8444-4120-859e-c682589df53e", "address": "fa:16:3e:62:af:a3", "network": {"id": "41edded2-dc16-49e9-8b02-b176d6e4ff77", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-901731550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faf3cd12d36542129de95b6a2b473906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3f9a10-84", "ovs_interfaceid": "1f3f9a10-8444-4120-859e-c682589df53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Converting VIF {"id": "1f3f9a10-8444-4120-859e-c682589df53e", "address": "fa:16:3e:62:af:a3", "network": {"id": "41edded2-dc16-49e9-8b02-b176d6e4ff77", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-901731550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faf3cd12d36542129de95b6a2b473906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3f9a10-84", "ovs_interfaceid": "1f3f9a10-8444-4120-859e-c682589df53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:af:a3,bridge_name='br-int',has_traffic_filtering=True,id=1f3f9a10-8444-4120-859e-c682589df53e,network=Network(41edded2-dc16-49e9-8b02-b176d6e4ff77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f3f9a10-84') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.objects.instance [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lazy-loading 'pci_devices' on Instance uuid c20b4c52-94b1-4aed-98f0-ae228df81175 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] End _get_guest_xml xml=<domain type="kvm">
Nov 08 16:59:59 user nova-compute[74669]:   <uuid>c20b4c52-94b1-4aed-98f0-ae228df81175</uuid>
Nov 08 16:59:59 user nova-compute[74669]:   <name>instance-00000012</name>
Nov 08 16:59:59 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 16:59:59 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 16:59:59 user nova-compute[74669]:   <metadata>
Nov 08 16:59:59 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 16:59:59 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 16:59:59 user nova-compute[74669]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1284191940</nova:name>
Nov 08 16:59:59 user nova-compute[74669]:       <nova:creationTime>2023-11-08 16:59:59</nova:creationTime>
Nov 08 16:59:59 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 16:59:59 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 16:59:59 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 16:59:59 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 16:59:59 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 16:59:59 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 16:59:59 user nova-compute[74669]:       </nova:flavor>
Nov 08 16:59:59 user nova-compute[74669]:       <nova:owner>
Nov 08 16:59:59 user nova-compute[74669]:         <nova:user uuid="bbcab9c7167b463aa19203215af5a91a">tempest-TestServerVolumeAttachmentScenario-61284172-project-member</nova:user>
Nov 08 16:59:59 user nova-compute[74669]:         <nova:project uuid="faf3cd12d36542129de95b6a2b473906">tempest-TestServerVolumeAttachmentScenario-61284172</nova:project>
Nov 08 16:59:59 user nova-compute[74669]:       </nova:owner>
Nov 08 16:59:59 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 16:59:59 user nova-compute[74669]:       <nova:ports>
Nov 08 16:59:59 user nova-compute[74669]:         <nova:port uuid="1f3f9a10-8444-4120-859e-c682589df53e">
Nov 08 16:59:59 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 16:59:59 user nova-compute[74669]:         </nova:port>
Nov 08 16:59:59 user nova-compute[74669]:       </nova:ports>
Nov 08 16:59:59 user nova-compute[74669]:     </nova:instance>
Nov 08 16:59:59 user nova-compute[74669]:   </metadata>
Nov 08 16:59:59 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 16:59:59 user nova-compute[74669]:     <system>
Nov 08 16:59:59 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 16:59:59 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 16:59:59 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 16:59:59 user nova-compute[74669]:       <entry name="serial">c20b4c52-94b1-4aed-98f0-ae228df81175</entry>
Nov 08 16:59:59 user nova-compute[74669]:       <entry name="uuid">c20b4c52-94b1-4aed-98f0-ae228df81175</entry>
Nov 08 16:59:59 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 16:59:59 user nova-compute[74669]:     </system>
Nov 08 16:59:59 user nova-compute[74669]:   </sysinfo>
Nov 08 16:59:59 user nova-compute[74669]:   <os>
Nov 08 16:59:59 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 16:59:59 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 16:59:59 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 16:59:59 user nova-compute[74669]:   </os>
Nov 08 16:59:59 user nova-compute[74669]:   <features>
Nov 08 16:59:59 user nova-compute[74669]:     <acpi/>
Nov 08 16:59:59 user nova-compute[74669]:     <apic/>
Nov 08 16:59:59 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 16:59:59 user nova-compute[74669]:   </features>
Nov 08 16:59:59 user nova-compute[74669]:   <clock offset="utc">
Nov 08 16:59:59 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 16:59:59 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 16:59:59 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 16:59:59 user nova-compute[74669]:   </clock>
Nov 08 16:59:59 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 16:59:59 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 16:59:59 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 16:59:59 user nova-compute[74669]:   </cpu>
Nov 08 16:59:59 user nova-compute[74669]:   <devices>
Nov 08 16:59:59 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 16:59:59 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 16:59:59 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk"/>
Nov 08 16:59:59 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 16:59:59 user nova-compute[74669]:     </disk>
Nov 08 16:59:59 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 16:59:59 user nova-compute[74669]:       <mac address="fa:16:3e:62:af:a3"/>
Nov 08 16:59:59 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:59:59 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 16:59:59 user nova-compute[74669]:       <target dev="tap1f3f9a10-84"/>
Nov 08 16:59:59 user nova-compute[74669]:     </interface>
Nov 08 16:59:59 user nova-compute[74669]:     <serial type="pty">
Nov 08 16:59:59 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/console.log" append="off"/>
Nov 08 16:59:59 user nova-compute[74669]:     </serial>
Nov 08 16:59:59 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 16:59:59 user nova-compute[74669]:     <video>
Nov 08 16:59:59 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 16:59:59 user nova-compute[74669]:     </video>
Nov 08 16:59:59 user nova-compute[74669]:     <rng model="virtio">
Nov 08 16:59:59 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 16:59:59 user nova-compute[74669]:     </rng>
Nov 08 16:59:59 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 16:59:59 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 16:59:59 user nova-compute[74669]:       <stats period="10"/>
Nov 08 16:59:59 user nova-compute[74669]:     </memballoon>
Nov 08 16:59:59 user nova-compute[74669]:   </devices>
Nov 08 16:59:59 user nova-compute[74669]: </domain>
Nov 08 16:59:59 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1284191940',display_name='tempest-TestServerVolumeAttachmentScenario-server-1284191940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1284191940',id=18,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbJYMlPQ4GKmKUtDbAjenDGMeXLqQpRW5oj85LY3v4pCJeaVU2m8wytGDB15EoXjGERIWPOYapJZ4KWzbHKYKk8yb4Y04AX0h8N6aREyby7hBt8m0c7qdj+9pozuajuEA==',key_name='tempest-keypair-737894091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faf3cd12d36542129de95b6a2b473906',ramdisk_id='',reservation_id='r-d1i60x6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-61284172',owner_user_name='tempest-TestServerVolumeAttachmentScenario-61284172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbcab9c7167b463aa19203215af5a91a',uuid=c20b4c52-94b1-4aed-98f0-ae228df81175,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f3f9a10-8444-4120-859e-c682589df53e", "address": "fa:16:3e:62:af:a3", "network": {"id": "41edded2-dc16-49e9-8b02-b176d6e4ff77", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-901731550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faf3cd12d36542129de95b6a2b473906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3f9a10-84", "ovs_interfaceid": "1f3f9a10-8444-4120-859e-c682589df53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Converting VIF {"id": "1f3f9a10-8444-4120-859e-c682589df53e", "address": "fa:16:3e:62:af:a3", "network": {"id": "41edded2-dc16-49e9-8b02-b176d6e4ff77", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-901731550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faf3cd12d36542129de95b6a2b473906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3f9a10-84", "ovs_interfaceid": "1f3f9a10-8444-4120-859e-c682589df53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:af:a3,bridge_name='br-int',has_traffic_filtering=True,id=1f3f9a10-8444-4120-859e-c682589df53e,network=Network(41edded2-dc16-49e9-8b02-b176d6e4ff77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f3f9a10-84') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG os_vif [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:af:a3,bridge_name='br-int',has_traffic_filtering=True,id=1f3f9a10-8444-4120-859e-c682589df53e,network=Network(41edded2-dc16-49e9-8b02-b176d6e4ff77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f3f9a10-84') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7f02fc9-7fe8-59cc-8af2-48aac67321a8', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f3f9a10-84, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f3f9a10-84, col_values=(('qos', UUID('76db03df-556e-470f-8ce3-bb0aa4fd32b1')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f3f9a10-84, col_values=(('external_ids', {'iface-id': '1f3f9a10-8444-4120-859e-c682589df53e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:af:a3', 'vm-uuid': 'c20b4c52-94b1-4aed-98f0-ae228df81175'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:59 user nova-compute[74669]: INFO os_vif [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:af:a3,bridge_name='br-int',has_traffic_filtering=True,id=1f3f9a10-8444-4120-859e-c682589df53e,network=Network(41edded2-dc16-49e9-8b02-b176d6e4ff77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f3f9a10-84')
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] No VIF found with MAC fa:16:3e:62:af:a3, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.network.neutron [req-2b41d02e-ae31-4edb-a755-966b9136a99c req-c4be3580-9c5d-4bbe-9b9a-25df9238b5d6 service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Updated VIF entry in instance network info cache for port 1f3f9a10-8444-4120-859e-c682589df53e. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.network.neutron [req-2b41d02e-ae31-4edb-a755-966b9136a99c req-c4be3580-9c5d-4bbe-9b9a-25df9238b5d6 service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Updating instance_info_cache with network_info: [{"id": "1f3f9a10-8444-4120-859e-c682589df53e", "address": "fa:16:3e:62:af:a3", "network": {"id": "41edded2-dc16-49e9-8b02-b176d6e4ff77", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-901731550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faf3cd12d36542129de95b6a2b473906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3f9a10-84", "ovs_interfaceid": "1f3f9a10-8444-4120-859e-c682589df53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2b41d02e-ae31-4edb-a755-966b9136a99c req-c4be3580-9c5d-4bbe-9b9a-25df9238b5d6 service nova] Releasing lock "refresh_cache-c20b4c52-94b1-4aed-98f0-ae228df81175" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-0f602a09-e8cd-428e-8ff7-0f1277990cdd req-a58be428-9140-46c9-916d-728313824e55 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-plugged-898bcd3e-b90e-493b-904a-5f533757c60e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0f602a09-e8cd-428e-8ff7-0f1277990cdd req-a58be428-9140-46c9-916d-728313824e55 service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0f602a09-e8cd-428e-8ff7-0f1277990cdd req-a58be428-9140-46c9-916d-728313824e55 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0f602a09-e8cd-428e-8ff7-0f1277990cdd req-a58be428-9140-46c9-916d-728313824e55 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-0f602a09-e8cd-428e-8ff7-0f1277990cdd req-a58be428-9140-46c9-916d-728313824e55 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-plugged-898bcd3e-b90e-493b-904a-5f533757c60e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:59 user nova-compute[74669]: WARNING nova.compute.manager [req-0f602a09-e8cd-428e-8ff7-0f1277990cdd req-a58be428-9140-46c9-916d-728313824e55 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received unexpected event network-vif-plugged-898bcd3e-b90e-493b-904a-5f533757c60e for instance with vm_state active and task_state None.
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-0f602a09-e8cd-428e-8ff7-0f1277990cdd req-a58be428-9140-46c9-916d-728313824e55 service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Received event network-vif-plugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0f602a09-e8cd-428e-8ff7-0f1277990cdd req-a58be428-9140-46c9-916d-728313824e55 service nova] Acquiring lock "55c67717-eb46-4617-9165-28531360e5d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0f602a09-e8cd-428e-8ff7-0f1277990cdd req-a58be428-9140-46c9-916d-728313824e55 service nova] Lock "55c67717-eb46-4617-9165-28531360e5d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0f602a09-e8cd-428e-8ff7-0f1277990cdd req-a58be428-9140-46c9-916d-728313824e55 service nova] Lock "55c67717-eb46-4617-9165-28531360e5d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 16:59:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-0f602a09-e8cd-428e-8ff7-0f1277990cdd req-a58be428-9140-46c9-916d-728313824e55 service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] No waiting events found dispatching network-vif-plugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 16:59:59 user nova-compute[74669]: WARNING nova.compute.manager [req-0f602a09-e8cd-428e-8ff7-0f1277990cdd req-a58be428-9140-46c9-916d-728313824e55 service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Received unexpected event network-vif-plugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb for instance with vm_state building and task_state spawning.
Nov 08 17:00:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:02 user nova-compute[74669]: DEBUG nova.compute.manager [req-e24fddfd-70bd-40cc-b639-ade417094f66 req-d4762768-c487-49e5-8386-89904c37fb30 service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Received event network-vif-plugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:00:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e24fddfd-70bd-40cc-b639-ade417094f66 req-d4762768-c487-49e5-8386-89904c37fb30 service nova] Acquiring lock "55c67717-eb46-4617-9165-28531360e5d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e24fddfd-70bd-40cc-b639-ade417094f66 req-d4762768-c487-49e5-8386-89904c37fb30 service nova] Lock "55c67717-eb46-4617-9165-28531360e5d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e24fddfd-70bd-40cc-b639-ade417094f66 req-d4762768-c487-49e5-8386-89904c37fb30 service nova] Lock "55c67717-eb46-4617-9165-28531360e5d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:02 user nova-compute[74669]: DEBUG nova.compute.manager [req-e24fddfd-70bd-40cc-b639-ade417094f66 req-d4762768-c487-49e5-8386-89904c37fb30 service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] No waiting events found dispatching network-vif-plugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:00:02 user nova-compute[74669]: WARNING nova.compute.manager [req-e24fddfd-70bd-40cc-b639-ade417094f66 req-d4762768-c487-49e5-8386-89904c37fb30 service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Received unexpected event network-vif-plugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb for instance with vm_state building and task_state spawning.
Nov 08 17:00:02 user nova-compute[74669]: DEBUG nova.compute.manager [req-e24fddfd-70bd-40cc-b639-ade417094f66 req-d4762768-c487-49e5-8386-89904c37fb30 service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Received event network-vif-plugged-1f3f9a10-8444-4120-859e-c682589df53e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:00:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e24fddfd-70bd-40cc-b639-ade417094f66 req-d4762768-c487-49e5-8386-89904c37fb30 service nova] Acquiring lock "c20b4c52-94b1-4aed-98f0-ae228df81175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e24fddfd-70bd-40cc-b639-ade417094f66 req-d4762768-c487-49e5-8386-89904c37fb30 service nova] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e24fddfd-70bd-40cc-b639-ade417094f66 req-d4762768-c487-49e5-8386-89904c37fb30 service nova] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:02 user nova-compute[74669]: DEBUG nova.compute.manager [req-e24fddfd-70bd-40cc-b639-ade417094f66 req-d4762768-c487-49e5-8386-89904c37fb30 service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] No waiting events found dispatching network-vif-plugged-1f3f9a10-8444-4120-859e-c682589df53e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:00:02 user nova-compute[74669]: WARNING nova.compute.manager [req-e24fddfd-70bd-40cc-b639-ade417094f66 req-d4762768-c487-49e5-8386-89904c37fb30 service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Received unexpected event network-vif-plugged-1f3f9a10-8444-4120-859e-c682589df53e for instance with vm_state building and task_state spawning.
Nov 08 17:00:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:02 user nova-compute[74669]: DEBUG nova.compute.manager [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:00:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:00:03 user nova-compute[74669]: INFO nova.compute.claims [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Claim successful on node user
Nov 08 17:00:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.598s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.compute.manager [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.compute.manager [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.network.neutron [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.compute.manager [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:00:03 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:00:03 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Instance spawned successfully.
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.compute.manager [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.policy [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6fd033f262943cdabb12db63b11eca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39bcebfdde5c48dc8857824275b0082e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:00:03 user nova-compute[74669]: INFO nova.compute.manager [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Took 9.59 seconds to spawn the instance on the hypervisor.
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.compute.manager [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.compute.manager [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:00:03 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Instance spawned successfully.
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.compute.manager [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:00:03 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Creating image(s)
Nov 08 17:00:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "/opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "/opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "bd32695172ba57e1ed00545e770a3d8ad7a865fd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "bd32695172ba57e1ed00545e770a3d8ad7a865fd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:04 user nova-compute[74669]: INFO nova.compute.manager [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Took 10.96 seconds to build instance.
Nov 08 17:00:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd32695172ba57e1ed00545e770a3d8ad7a865fd.part --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-03443460-033e-4064-b7ed-fe779875e066 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "55c67717-eb46-4617-9165-28531360e5d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.637s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:04 user nova-compute[74669]: INFO nova.compute.manager [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Took 7.63 seconds to spawn the instance on the hypervisor.
Nov 08 17:00:04 user nova-compute[74669]: DEBUG nova.compute.manager [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:00:04 user nova-compute[74669]: DEBUG nova.compute.manager [req-6cc094a6-7c0b-4583-b8b8-187d80753415 req-55aed4da-6cb0-4e97-997d-8b0ffae9b71e service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Received event network-vif-plugged-1f3f9a10-8444-4120-859e-c682589df53e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:00:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6cc094a6-7c0b-4583-b8b8-187d80753415 req-55aed4da-6cb0-4e97-997d-8b0ffae9b71e service nova] Acquiring lock "c20b4c52-94b1-4aed-98f0-ae228df81175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6cc094a6-7c0b-4583-b8b8-187d80753415 req-55aed4da-6cb0-4e97-997d-8b0ffae9b71e service nova] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6cc094a6-7c0b-4583-b8b8-187d80753415 req-55aed4da-6cb0-4e97-997d-8b0ffae9b71e service nova] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:04 user nova-compute[74669]: DEBUG nova.compute.manager [req-6cc094a6-7c0b-4583-b8b8-187d80753415 req-55aed4da-6cb0-4e97-997d-8b0ffae9b71e service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] No waiting events found dispatching network-vif-plugged-1f3f9a10-8444-4120-859e-c682589df53e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:00:04 user nova-compute[74669]: WARNING nova.compute.manager [req-6cc094a6-7c0b-4583-b8b8-187d80753415 req-55aed4da-6cb0-4e97-997d-8b0ffae9b71e service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Received unexpected event network-vif-plugged-1f3f9a10-8444-4120-859e-c682589df53e for instance with vm_state building and task_state spawning.
Nov 08 17:00:04 user nova-compute[74669]: DEBUG nova.network.neutron [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Successfully created port: 6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:00:04 user nova-compute[74669]: INFO nova.compute.manager [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Took 9.07 seconds to build instance.
Nov 08 17:00:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-41f107a0-c9eb-4fbf-8c87-e0b8331ebc03 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.216s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd32695172ba57e1ed00545e770a3d8ad7a865fd.part --force-share --output=json" returned: 0 in 0.262s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:04 user nova-compute[74669]: DEBUG nova.virt.images [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] 527ca5aa-ca8a-47f5-8e2d-d2ec0a0d39e3 was qcow2, converting to raw {{(pid=74669) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 17:00:04 user nova-compute[74669]: DEBUG nova.privsep.utils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74669) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 17:00:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bd32695172ba57e1ed00545e770a3d8ad7a865fd.part /opt/stack/data/nova/instances/_base/bd32695172ba57e1ed00545e770a3d8ad7a865fd.converted {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bd32695172ba57e1ed00545e770a3d8ad7a865fd.part /opt/stack/data/nova/instances/_base/bd32695172ba57e1ed00545e770a3d8ad7a865fd.converted" returned: 0 in 0.200s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd32695172ba57e1ed00545e770a3d8ad7a865fd.converted --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd32695172ba57e1ed00545e770a3d8ad7a865fd.converted --force-share --output=json" returned: 0 in 0.217s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "bd32695172ba57e1ed00545e770a3d8ad7a865fd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.264s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd32695172ba57e1ed00545e770a3d8ad7a865fd --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG nova.network.neutron [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Successfully updated port: 6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd32695172ba57e1ed00545e770a3d8ad7a865fd --force-share --output=json" returned: 0 in 0.221s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "bd32695172ba57e1ed00545e770a3d8ad7a865fd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "bd32695172ba57e1ed00545e770a3d8ad7a865fd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd32695172ba57e1ed00545e770a3d8ad7a865fd --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "refresh_cache-b8bfb971-094b-46cf-b8bd-ba3df8994e7a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquired lock "refresh_cache-b8bfb971-094b-46cf-b8bd-ba3df8994e7a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG nova.network.neutron [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG nova.compute.manager [req-ca978a00-e136-46e3-bf1d-e5e68a34c0b2 req-1a443f89-890c-4275-b6ec-e7d1b121cc30 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Received event network-changed-6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG nova.compute.manager [req-ca978a00-e136-46e3-bf1d-e5e68a34c0b2 req-1a443f89-890c-4275-b6ec-e7d1b121cc30 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Refreshing instance network info cache due to event network-changed-6582b38d-2366-43fe-9a2b-6990e7bc165b. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ca978a00-e136-46e3-bf1d-e5e68a34c0b2 req-1a443f89-890c-4275-b6ec-e7d1b121cc30 service nova] Acquiring lock "refresh_cache-b8bfb971-094b-46cf-b8bd-ba3df8994e7a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG nova.network.neutron [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd32695172ba57e1ed00545e770a3d8ad7a865fd --force-share --output=json" returned: 0 in 0.220s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd32695172ba57e1ed00545e770a3d8ad7a865fd,backing_fmt=raw /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd32695172ba57e1ed00545e770a3d8ad7a865fd,backing_fmt=raw /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk 1073741824" returned: 0 in 0.060s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "bd32695172ba57e1ed00545e770a3d8ad7a865fd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd32695172ba57e1ed00545e770a3d8ad7a865fd --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd32695172ba57e1ed00545e770a3d8ad7a865fd --force-share --output=json" returned: 0 in 0.217s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:00:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.network.neutron [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Updating instance_info_cache with network_info: [{"id": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "address": "fa:16:3e:93:f5:4a", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6582b38d-23", "ovs_interfaceid": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Releasing lock "refresh_cache-b8bfb971-094b-46cf-b8bd-ba3df8994e7a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Instance network_info: |[{"id": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "address": "fa:16:3e:93:f5:4a", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6582b38d-23", "ovs_interfaceid": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ca978a00-e136-46e3-bf1d-e5e68a34c0b2 req-1a443f89-890c-4275-b6ec-e7d1b121cc30 service nova] Acquired lock "refresh_cache-b8bfb971-094b-46cf-b8bd-ba3df8994e7a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.network.neutron [req-ca978a00-e136-46e3-bf1d-e5e68a34c0b2 req-1a443f89-890c-4275-b6ec-e7d1b121cc30 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Refreshing network info cache for port 6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Cannot resize image /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Ensure instance console log exists: /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Start _get_guest_xml network_info=[{"id": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "address": "fa:16:3e:93:f5:4a", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6582b38d-23", "ovs_interfaceid": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:59:59Z,direct_url=<?>,disk_format='qcow2',id=527ca5aa-ca8a-47f5-8e2d-d2ec0a0d39e3,min_disk=0,min_ram=0,name='tempest-scenario-img--2109308060',owner='39bcebfdde5c48dc8857824275b0082e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T17:00:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '527ca5aa-ca8a-47f5-8e2d-d2ec0a0d39e3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:00:06 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:00:06 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:59:59Z,direct_url=<?>,disk_format='qcow2',id=527ca5aa-ca8a-47f5-8e2d-d2ec0a0d39e3,min_disk=0,min_ram=0,name='tempest-scenario-img--2109308060',owner='39bcebfdde5c48dc8857824275b0082e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T17:00:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:00:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1396004842',display_name='tempest-TestMinimumBasicScenario-server-1396004842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1396004842',id=19,image_ref='527ca5aa-ca8a-47f5-8e2d-d2ec0a0d39e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCOD1NU5AKnSEY5ecgGJBWw2CuqlrxCDwkJtqxOzcMha6UEVuT3KdyNUtjj2i4UoYzgC+WcJUNwzoVbSVK+8J24XNPeP7yPtaPMCLWTXNnIgHAt+SU2oKE9MWioZA6wFA==',key_name='tempest-TestMinimumBasicScenario-1345680325',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39bcebfdde5c48dc8857824275b0082e',ramdisk_id='',reservation_id='r-1q48xzql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='527ca5aa-ca8a-47f5-8e2d-d2ec0a0d39e3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1167063302',owner_user_name='tempest-TestMinimumBasicScenario-1167063302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:00:04Z,user_data=None,user_id='d6fd033f262943cdabb12db63b11eca8',uuid=b8bfb971-094b-46cf-b8bd-ba3df8994e7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "address": "fa:16:3e:93:f5:4a", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6582b38d-23", "ovs_interfaceid": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Converting VIF {"id": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "address": "fa:16:3e:93:f5:4a", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6582b38d-23", "ovs_interfaceid": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:f5:4a,bridge_name='br-int',has_traffic_filtering=True,id=6582b38d-2366-43fe-9a2b-6990e7bc165b,network=Network(c618e3db-19f3-4b21-aa37-98985a7bf610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6582b38d-23') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.objects.instance [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lazy-loading 'pci_devices' on Instance uuid b8bfb971-094b-46cf-b8bd-ba3df8994e7a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:00:06 user nova-compute[74669]:   <uuid>b8bfb971-094b-46cf-b8bd-ba3df8994e7a</uuid>
Nov 08 17:00:06 user nova-compute[74669]:   <name>instance-00000013</name>
Nov 08 17:00:06 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:00:06 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:00:06 user nova-compute[74669]:   <metadata>
Nov 08 17:00:06 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:00:06 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:00:06 user nova-compute[74669]:       <nova:name>tempest-TestMinimumBasicScenario-server-1396004842</nova:name>
Nov 08 17:00:06 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:00:06</nova:creationTime>
Nov 08 17:00:06 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:00:06 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:00:06 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:00:06 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:00:06 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:00:06 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:00:06 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:00:06 user nova-compute[74669]:       <nova:owner>
Nov 08 17:00:06 user nova-compute[74669]:         <nova:user uuid="d6fd033f262943cdabb12db63b11eca8">tempest-TestMinimumBasicScenario-1167063302-project-member</nova:user>
Nov 08 17:00:06 user nova-compute[74669]:         <nova:project uuid="39bcebfdde5c48dc8857824275b0082e">tempest-TestMinimumBasicScenario-1167063302</nova:project>
Nov 08 17:00:06 user nova-compute[74669]:       </nova:owner>
Nov 08 17:00:06 user nova-compute[74669]:       <nova:root type="image" uuid="527ca5aa-ca8a-47f5-8e2d-d2ec0a0d39e3"/>
Nov 08 17:00:06 user nova-compute[74669]:       <nova:ports>
Nov 08 17:00:06 user nova-compute[74669]:         <nova:port uuid="6582b38d-2366-43fe-9a2b-6990e7bc165b">
Nov 08 17:00:06 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 17:00:06 user nova-compute[74669]:         </nova:port>
Nov 08 17:00:06 user nova-compute[74669]:       </nova:ports>
Nov 08 17:00:06 user nova-compute[74669]:     </nova:instance>
Nov 08 17:00:06 user nova-compute[74669]:   </metadata>
Nov 08 17:00:06 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:00:06 user nova-compute[74669]:     <system>
Nov 08 17:00:06 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:00:06 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:00:06 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:00:06 user nova-compute[74669]:       <entry name="serial">b8bfb971-094b-46cf-b8bd-ba3df8994e7a</entry>
Nov 08 17:00:06 user nova-compute[74669]:       <entry name="uuid">b8bfb971-094b-46cf-b8bd-ba3df8994e7a</entry>
Nov 08 17:00:06 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:00:06 user nova-compute[74669]:     </system>
Nov 08 17:00:06 user nova-compute[74669]:   </sysinfo>
Nov 08 17:00:06 user nova-compute[74669]:   <os>
Nov 08 17:00:06 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:00:06 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:00:06 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:00:06 user nova-compute[74669]:   </os>
Nov 08 17:00:06 user nova-compute[74669]:   <features>
Nov 08 17:00:06 user nova-compute[74669]:     <acpi/>
Nov 08 17:00:06 user nova-compute[74669]:     <apic/>
Nov 08 17:00:06 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:00:06 user nova-compute[74669]:   </features>
Nov 08 17:00:06 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:00:06 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:00:06 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:00:06 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:00:06 user nova-compute[74669]:   </clock>
Nov 08 17:00:06 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:00:06 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:00:06 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:00:06 user nova-compute[74669]:   </cpu>
Nov 08 17:00:06 user nova-compute[74669]:   <devices>
Nov 08 17:00:06 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:00:06 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:00:06 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk"/>
Nov 08 17:00:06 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:00:06 user nova-compute[74669]:     </disk>
Nov 08 17:00:06 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:00:06 user nova-compute[74669]:       <mac address="fa:16:3e:93:f5:4a"/>
Nov 08 17:00:06 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:00:06 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:00:06 user nova-compute[74669]:       <target dev="tap6582b38d-23"/>
Nov 08 17:00:06 user nova-compute[74669]:     </interface>
Nov 08 17:00:06 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:00:06 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/console.log" append="off"/>
Nov 08 17:00:06 user nova-compute[74669]:     </serial>
Nov 08 17:00:06 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:00:06 user nova-compute[74669]:     <video>
Nov 08 17:00:06 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:00:06 user nova-compute[74669]:     </video>
Nov 08 17:00:06 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:00:06 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:00:06 user nova-compute[74669]:     </rng>
Nov 08 17:00:06 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:00:06 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:00:06 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:00:06 user nova-compute[74669]:     </memballoon>
Nov 08 17:00:06 user nova-compute[74669]:   </devices>
Nov 08 17:00:06 user nova-compute[74669]: </domain>
Nov 08 17:00:06 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:00:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1396004842',display_name='tempest-TestMinimumBasicScenario-server-1396004842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1396004842',id=19,image_ref='527ca5aa-ca8a-47f5-8e2d-d2ec0a0d39e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCOD1NU5AKnSEY5ecgGJBWw2CuqlrxCDwkJtqxOzcMha6UEVuT3KdyNUtjj2i4UoYzgC+WcJUNwzoVbSVK+8J24XNPeP7yPtaPMCLWTXNnIgHAt+SU2oKE9MWioZA6wFA==',key_name='tempest-TestMinimumBasicScenario-1345680325',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39bcebfdde5c48dc8857824275b0082e',ramdisk_id='',reservation_id='r-1q48xzql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='527ca5aa-ca8a-47f5-8e2d-d2ec0a0d39e3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1167063302',owner_user_name='tempest-TestMinimumBasicScenario-1167063302-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:00:04Z,user_data=None,user_id='d6fd033f262943cdabb12db63b11eca8',uuid=b8bfb971-094b-46cf-b8bd-ba3df8994e7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "address": "fa:16:3e:93:f5:4a", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6582b38d-23", "ovs_interfaceid": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Converting VIF {"id": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "address": "fa:16:3e:93:f5:4a", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6582b38d-23", "ovs_interfaceid": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:f5:4a,bridge_name='br-int',has_traffic_filtering=True,id=6582b38d-2366-43fe-9a2b-6990e7bc165b,network=Network(c618e3db-19f3-4b21-aa37-98985a7bf610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6582b38d-23') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG os_vif [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:f5:4a,bridge_name='br-int',has_traffic_filtering=True,id=6582b38d-2366-43fe-9a2b-6990e7bc165b,network=Network(c618e3db-19f3-4b21-aa37-98985a7bf610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6582b38d-23') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '661187de-c6d1-563b-a077-97709a74b90b', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6582b38d-23, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6582b38d-23, col_values=(('qos', UUID('8dc77147-7a68-4b80-ace9-95d1ee4d68e3')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6582b38d-23, col_values=(('external_ids', {'iface-id': '6582b38d-2366-43fe-9a2b-6990e7bc165b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:f5:4a', 'vm-uuid': 'b8bfb971-094b-46cf-b8bd-ba3df8994e7a'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:06 user nova-compute[74669]: INFO os_vif [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:f5:4a,bridge_name='br-int',has_traffic_filtering=True,id=6582b38d-2366-43fe-9a2b-6990e7bc165b,network=Network(c618e3db-19f3-4b21-aa37-98985a7bf610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6582b38d-23')
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] No VIF found with MAC fa:16:3e:93:f5:4a, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.network.neutron [req-ca978a00-e136-46e3-bf1d-e5e68a34c0b2 req-1a443f89-890c-4275-b6ec-e7d1b121cc30 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Updated VIF entry in instance network info cache for port 6582b38d-2366-43fe-9a2b-6990e7bc165b. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG nova.network.neutron [req-ca978a00-e136-46e3-bf1d-e5e68a34c0b2 req-1a443f89-890c-4275-b6ec-e7d1b121cc30 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Updating instance_info_cache with network_info: [{"id": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "address": "fa:16:3e:93:f5:4a", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6582b38d-23", "ovs_interfaceid": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:00:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ca978a00-e136-46e3-bf1d-e5e68a34c0b2 req-1a443f89-890c-4275-b6ec-e7d1b121cc30 service nova] Releasing lock "refresh_cache-b8bfb971-094b-46cf-b8bd-ba3df8994e7a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:00:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:07 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 1b9ad090-c7bb-4a11-a056-19902844dbf0 is timed out.
Nov 08 17:00:07 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Successfully detached device sdc from instance 1b9ad090-c7bb-4a11-a056-19902844dbf0 from the live domain config.
Nov 08 17:00:07 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:00:07 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VLCzUpxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:00:07 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:00:07 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:00:07 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:00:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:07 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0a59ed-4d50-4ade-a003-bd1b6bbcc596]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:00:07 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:00:07 user nova-compute[74669]: No targets found.
Nov 08 17:00:07 user nova-compute[74669]: iSNS:
Nov 08 17:00:07 user nova-compute[74669]: No targets found.
Nov 08 17:00:07 user nova-compute[74669]: STATIC:
Nov 08 17:00:07 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263
Nov 08 17:00:07 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:00:07 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:00:07 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a
Nov 08 17:00:07 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:00:07 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:00:07 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55
Nov 08 17:00:07 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:00:07 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:00:07 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336
Nov 08 17:00:07 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:00:07 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:00:07 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5
Nov 08 17:00:07 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:00:07 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:00:07 user nova-compute[74669]: FIRMWARE:
Nov 08 17:00:07 user nova-compute[74669]: No targets found.
Nov 08 17:00:07 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:00:07 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:00:07 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:00:07 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:00:07 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:00:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0db0fd-996a-4148-9009-b1470630cecb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7745f3e-8136-41ad-ad17-84d03dc33769]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 17:00:08 user nova-compute[74669]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)
Nov 08 17:00:08 user nova-compute[74669]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)
Nov 08 17:00:08 user nova-compute[74669]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 (non-flash)
Nov 08 17:00:08 user nova-compute[74669]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 (non-flash)
Nov 08 17:00:08 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 17:00:08 user nova-compute[74669]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a (non-flash)
Nov 08 17:00:08 user nova-compute[74669]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)
Nov 08 17:00:08 user nova-compute[74669]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 (non-flash)
Nov 08 17:00:08 user nova-compute[74669]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 (non-flash)
Nov 08 17:00:08 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9a848e4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a'): ({'sdc'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Removing single pathed devices sdc {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.040s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b932e4-0a39-40f1-a1df-89a22eb05ac1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.033s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3258c35f-507c-438a-b5c5-f06a5b867bfc]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Flushing IO for device /dev/sdc {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.041s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1837742-d4cc-459d-96f3-4820dd169001]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG nova.compute.manager [req-aad33205-d818-4af3-97ea-9a27a61b9547 req-44718a43-d0f0-4e00-9d3f-4f9894b13365 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Received event network-vif-plugged-6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-aad33205-d818-4af3-97ea-9a27a61b9547 req-44718a43-d0f0-4e00-9d3f-4f9894b13365 service nova] Acquiring lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-aad33205-d818-4af3-97ea-9a27a61b9547 req-44718a43-d0f0-4e00-9d3f-4f9894b13365 service nova] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-aad33205-d818-4af3-97ea-9a27a61b9547 req-44718a43-d0f0-4e00-9d3f-4f9894b13365 service nova] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG nova.compute.manager [req-aad33205-d818-4af3-97ea-9a27a61b9547 req-44718a43-d0f0-4e00-9d3f-4f9894b13365 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] No waiting events found dispatching network-vif-plugged-6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:00:08 user nova-compute[74669]: WARNING nova.compute.manager [req-aad33205-d818-4af3-97ea-9a27a61b9547 req-44718a43-d0f0-4e00-9d3f-4f9894b13365 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Received unexpected event network-vif-plugged-6582b38d-2366-43fe-9a2b-6990e7bc165b for instance with vm_state building and task_state spawning.
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.086s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[42df10de-9cb4-4f24-a149-2854e90c046d]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50973fd-7ee0-45a5-9699-4851a1a10433]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbabf1b-5568-42ca-8669-7b84a7b7b6ab]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a, portal: 172.16.0.220,3260]
Nov 08 17:00:08 user nova-compute[74669]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a, portal: 172.16.0.220,3260] successful.
Nov 08 17:00:08 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e3eac5-f7ff-4c32-a62b-89c25af2100a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a690fb3-cdf3-4803-a834-6dda66938abd]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.525s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] <== disconnect_volume: return (529ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:09 user nova-compute[74669]: DEBUG nova.objects.instance [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lazy-loading 'flavor' on Instance uuid 1b9ad090-c7bb-4a11-a056-19902844dbf0 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:00:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c982f137-41a7-4d81-9e68-acc34e1176af tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "1b9ad090-c7bb-4a11-a056-19902844dbf0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.563s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:10 user nova-compute[74669]: DEBUG nova.compute.manager [req-9e8f1f29-fb2b-43bd-8b5d-5f3ba5817e2a req-68e40515-1c75-4d67-936c-722532b89db6 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Received event network-vif-plugged-6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:00:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9e8f1f29-fb2b-43bd-8b5d-5f3ba5817e2a req-68e40515-1c75-4d67-936c-722532b89db6 service nova] Acquiring lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9e8f1f29-fb2b-43bd-8b5d-5f3ba5817e2a req-68e40515-1c75-4d67-936c-722532b89db6 service nova] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9e8f1f29-fb2b-43bd-8b5d-5f3ba5817e2a req-68e40515-1c75-4d67-936c-722532b89db6 service nova] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:10 user nova-compute[74669]: DEBUG nova.compute.manager [req-9e8f1f29-fb2b-43bd-8b5d-5f3ba5817e2a req-68e40515-1c75-4d67-936c-722532b89db6 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] No waiting events found dispatching network-vif-plugged-6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:00:10 user nova-compute[74669]: WARNING nova.compute.manager [req-9e8f1f29-fb2b-43bd-8b5d-5f3ba5817e2a req-68e40515-1c75-4d67-936c-722532b89db6 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Received unexpected event network-vif-plugged-6582b38d-2366-43fe-9a2b-6990e7bc165b for instance with vm_state building and task_state spawning.
Nov 08 17:00:10 user nova-compute[74669]: DEBUG nova.compute.manager [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:00:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:00:10 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Instance spawned successfully.
Nov 08 17:00:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:00:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:10 user nova-compute[74669]: INFO nova.compute.manager [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Took 6.78 seconds to spawn the instance on the hypervisor.
Nov 08 17:00:10 user nova-compute[74669]: DEBUG nova.compute.manager [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:00:10 user nova-compute[74669]: INFO nova.compute.manager [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Took 7.89 seconds to build instance.
Nov 08 17:00:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-233df009-de7a-4a97-a0c8-b2e61bac8561 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.105s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Acquiring lock "1b9ad090-c7bb-4a11-a056-19902844dbf0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "1b9ad090-c7bb-4a11-a056-19902844dbf0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Acquiring lock "1b9ad090-c7bb-4a11-a056-19902844dbf0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "1b9ad090-c7bb-4a11-a056-19902844dbf0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "1b9ad090-c7bb-4a11-a056-19902844dbf0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:10 user nova-compute[74669]: INFO nova.compute.manager [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Terminating instance
Nov 08 17:00:10 user nova-compute[74669]: DEBUG nova.compute.manager [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG nova.compute.manager [req-56b99c54-fe52-4b8f-b6a8-b0fc145585a1 req-0bca395b-ed12-4822-a34d-89936bf79db7 service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Received event network-vif-unplugged-9094cae8-f197-47d4-8ba3-8a1e274c3f04 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-56b99c54-fe52-4b8f-b6a8-b0fc145585a1 req-0bca395b-ed12-4822-a34d-89936bf79db7 service nova] Acquiring lock "1b9ad090-c7bb-4a11-a056-19902844dbf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-56b99c54-fe52-4b8f-b6a8-b0fc145585a1 req-0bca395b-ed12-4822-a34d-89936bf79db7 service nova] Lock "1b9ad090-c7bb-4a11-a056-19902844dbf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-56b99c54-fe52-4b8f-b6a8-b0fc145585a1 req-0bca395b-ed12-4822-a34d-89936bf79db7 service nova] Lock "1b9ad090-c7bb-4a11-a056-19902844dbf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG nova.compute.manager [req-56b99c54-fe52-4b8f-b6a8-b0fc145585a1 req-0bca395b-ed12-4822-a34d-89936bf79db7 service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] No waiting events found dispatching network-vif-unplugged-9094cae8-f197-47d4-8ba3-8a1e274c3f04 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG nova.compute.manager [req-56b99c54-fe52-4b8f-b6a8-b0fc145585a1 req-0bca395b-ed12-4822-a34d-89936bf79db7 service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Received event network-vif-unplugged-9094cae8-f197-47d4-8ba3-8a1e274c3f04 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:00:11 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Instance destroyed successfully.
Nov 08 17:00:11 user nova-compute[74669]: DEBUG nova.objects.instance [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lazy-loading 'resources' on Instance uuid 1b9ad090-c7bb-4a11-a056-19902844dbf0 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:56:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-571001023',display_name='tempest-AttachSCSIVolumeTestJSON-server-571001023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-571001023',id=13,image_ref='d713d2a4-1cef-4336-9ea3-593965526391',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkMDs8xzTKElrywZZWnz+Un1FN54LpSvfh6mK613vOoyk7B/n3R8l4bdaNR0SPEv9kG+kXnfBuDIdEivU/h7d4Z1xPXevLXMGuaXsr3BQsOH68OU1MHNVCNCWwynt0/AA==',key_name='tempest-keypair-1924695154',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:56:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51ba6ed05fa648a6ab7618d83d11a4a6',ramdisk_id='',reservation_id='r-68w76pon',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d713d2a4-1cef-4336-9ea3-593965526391',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-219670464',owner_user_name='tempest-AttachSCSIVolumeTestJSON-219670464-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:56:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dd4e7c5cf7424df0a0b8f684284eae8c',uuid=1b9ad090-c7bb-4a11-a056-19902844dbf0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9094cae8-f197-47d4-8ba3-8a1e274c3f04", "address": "fa:16:3e:a1:4d:7a", "network": {"id": "3e057921-3f7f-4344-bd63-e80de5bbe2be", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1558760908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ba6ed05fa648a6ab7618d83d11a4a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9094cae8-f1", "ovs_interfaceid": "9094cae8-f197-47d4-8ba3-8a1e274c3f04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Converting VIF {"id": "9094cae8-f197-47d4-8ba3-8a1e274c3f04", "address": "fa:16:3e:a1:4d:7a", "network": {"id": "3e057921-3f7f-4344-bd63-e80de5bbe2be", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1558760908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51ba6ed05fa648a6ab7618d83d11a4a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9094cae8-f1", "ovs_interfaceid": "9094cae8-f197-47d4-8ba3-8a1e274c3f04", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:4d:7a,bridge_name='br-int',has_traffic_filtering=True,id=9094cae8-f197-47d4-8ba3-8a1e274c3f04,network=Network(3e057921-3f7f-4344-bd63-e80de5bbe2be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9094cae8-f1') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG os_vif [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:4d:7a,bridge_name='br-int',has_traffic_filtering=True,id=9094cae8-f197-47d4-8ba3-8a1e274c3f04,network=Network(3e057921-3f7f-4344-bd63-e80de5bbe2be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9094cae8-f1') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9094cae8-f1, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c82a753-125b-44d1-b9ae-dc547e4ed7fa) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:00:11 user nova-compute[74669]: INFO os_vif [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:4d:7a,bridge_name='br-int',has_traffic_filtering=True,id=9094cae8-f197-47d4-8ba3-8a1e274c3f04,network=Network(3e057921-3f7f-4344-bd63-e80de5bbe2be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9094cae8-f1')
Nov 08 17:00:11 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Deleting instance files /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0_del
Nov 08 17:00:11 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Deletion of /opt/stack/data/nova/instances/1b9ad090-c7bb-4a11-a056-19902844dbf0_del complete
Nov 08 17:00:12 user nova-compute[74669]: INFO nova.compute.manager [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 08 17:00:12 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:00:12 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:00:12 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:00:12 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:00:12 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Took 0.89 seconds to deallocate network for instance.
Nov 08 17:00:12 user nova-compute[74669]: DEBUG nova.compute.manager [req-aeb90ad8-d2b2-4643-a279-ad963002c757 req-d8018876-494a-4eb4-89f2-696b9ceeb420 service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Received event network-vif-deleted-9094cae8-f197-47d4-8ba3-8a1e274c3f04 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:00:12 user nova-compute[74669]: INFO nova.compute.manager [req-aeb90ad8-d2b2-4643-a279-ad963002c757 req-d8018876-494a-4eb4-89f2-696b9ceeb420 service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Neutron deleted interface 9094cae8-f197-47d4-8ba3-8a1e274c3f04; detaching it from the instance and deleting it from the info cache
Nov 08 17:00:12 user nova-compute[74669]: DEBUG nova.network.neutron [req-aeb90ad8-d2b2-4643-a279-ad963002c757 req-d8018876-494a-4eb4-89f2-696b9ceeb420 service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:00:13 user nova-compute[74669]: DEBUG nova.compute.manager [req-aeb90ad8-d2b2-4643-a279-ad963002c757 req-d8018876-494a-4eb4-89f2-696b9ceeb420 service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Detach interface failed, port_id=9094cae8-f197-47d4-8ba3-8a1e274c3f04, reason: Instance 1b9ad090-c7bb-4a11-a056-19902844dbf0 could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 17:00:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:13 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:00:13 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:00:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:13 user nova-compute[74669]: DEBUG nova.compute.manager [req-8f9e2396-d8f3-4414-8d52-38426b0219f9 req-630ebd97-8fd4-446a-82b8-ed55bed736ae service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Received event network-vif-plugged-9094cae8-f197-47d4-8ba3-8a1e274c3f04 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:00:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8f9e2396-d8f3-4414-8d52-38426b0219f9 req-630ebd97-8fd4-446a-82b8-ed55bed736ae service nova] Acquiring lock "1b9ad090-c7bb-4a11-a056-19902844dbf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8f9e2396-d8f3-4414-8d52-38426b0219f9 req-630ebd97-8fd4-446a-82b8-ed55bed736ae service nova] Lock "1b9ad090-c7bb-4a11-a056-19902844dbf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8f9e2396-d8f3-4414-8d52-38426b0219f9 req-630ebd97-8fd4-446a-82b8-ed55bed736ae service nova] Lock "1b9ad090-c7bb-4a11-a056-19902844dbf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:13 user nova-compute[74669]: DEBUG nova.compute.manager [req-8f9e2396-d8f3-4414-8d52-38426b0219f9 req-630ebd97-8fd4-446a-82b8-ed55bed736ae service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] No waiting events found dispatching network-vif-plugged-9094cae8-f197-47d4-8ba3-8a1e274c3f04 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:00:13 user nova-compute[74669]: WARNING nova.compute.manager [req-8f9e2396-d8f3-4414-8d52-38426b0219f9 req-630ebd97-8fd4-446a-82b8-ed55bed736ae service nova] [instance: 1b9ad090-c7bb-4a11-a056-19902844dbf0] Received unexpected event network-vif-plugged-9094cae8-f197-47d4-8ba3-8a1e274c3f04 for instance with vm_state deleted and task_state None.
Nov 08 17:00:13 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Deleted allocations for instance 1b9ad090-c7bb-4a11-a056-19902844dbf0
Nov 08 17:00:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bfc29639-3120-436e-b78f-b5d78e53ab69 tempest-AttachSCSIVolumeTestJSON-219670464 tempest-AttachSCSIVolumeTestJSON-219670464-project-member] Lock "1b9ad090-c7bb-4a11-a056-19902844dbf0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.690s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Acquiring lock "46df3fed-e88a-45ed-a05e-2fb2f1bf017c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Lock "46df3fed-e88a-45ed-a05e-2fb2f1bf017c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:18 user nova-compute[74669]: DEBUG nova.compute.manager [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:00:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:18 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:00:18 user nova-compute[74669]: INFO nova.compute.claims [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Claim successful on node user
Nov 08 17:00:18 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:00:18 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:00:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.665s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:18 user nova-compute[74669]: DEBUG nova.compute.manager [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:00:19 user nova-compute[74669]: DEBUG nova.compute.manager [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:00:19 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:00:19 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:00:19 user nova-compute[74669]: DEBUG nova.compute.manager [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:00:19 user nova-compute[74669]: DEBUG nova.policy [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e485d1d0937e45c2850f98520b208756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8f4d7d37534880972312430acb9807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:00:19 user nova-compute[74669]: DEBUG nova.compute.manager [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:00:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:00:19 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Creating image(s)
Nov 08 17:00:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Acquiring lock "/opt/stack/data/nova/instances/46df3fed-e88a-45ed-a05e-2fb2f1bf017c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Lock "/opt/stack/data/nova/instances/46df3fed-e88a-45ed-a05e-2fb2f1bf017c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Lock "/opt/stack/data/nova/instances/46df3fed-e88a-45ed-a05e-2fb2f1bf017c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.322s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.241s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/46df3fed-e88a-45ed-a05e-2fb2f1bf017c/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/46df3fed-e88a-45ed-a05e-2fb2f1bf017c/disk 1073741824" returned: 0 in 0.056s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.221s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:20 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46df3fed-e88a-45ed-a05e-2fb2f1bf017c/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:00:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46df3fed-e88a-45ed-a05e-2fb2f1bf017c/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:20 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Successfully created port: 4f341664-0a50-41a2-8f1d-9732a3a77907 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:00:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46df3fed-e88a-45ed-a05e-2fb2f1bf017c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:20 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Cannot resize image /opt/stack/data/nova/instances/46df3fed-e88a-45ed-a05e-2fb2f1bf017c/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:00:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:00:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Ensure instance console log exists: /opt/stack/data/nova/instances/46df3fed-e88a-45ed-a05e-2fb2f1bf017c/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:00:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Successfully updated port: 4f341664-0a50-41a2-8f1d-9732a3a77907 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Acquiring lock "refresh_cache-46df3fed-e88a-45ed-a05e-2fb2f1bf017c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Acquired lock "refresh_cache-46df3fed-e88a-45ed-a05e-2fb2f1bf017c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.compute.manager [req-e00a3166-70b6-4583-88be-9639e92e3741 req-37e370ef-1670-4fba-a18f-e7e86d025d80 service nova] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Received event network-changed-4f341664-0a50-41a2-8f1d-9732a3a77907 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.compute.manager [req-e00a3166-70b6-4583-88be-9639e92e3741 req-37e370ef-1670-4fba-a18f-e7e86d025d80 service nova] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Refreshing instance network info cache due to event network-changed-4f341664-0a50-41a2-8f1d-9732a3a77907. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e00a3166-70b6-4583-88be-9639e92e3741 req-37e370ef-1670-4fba-a18f-e7e86d025d80 service nova] Acquiring lock "refresh_cache-46df3fed-e88a-45ed-a05e-2fb2f1bf017c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Updating instance_info_cache with network_info: [{"id": "4f341664-0a50-41a2-8f1d-9732a3a77907", "address": "fa:16:3e:c5:5b:d8", "network": {"id": "2f4a5a1d-142b-4985-a492-a6c78609683a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "79496da39fb84da59931e2879cd9367e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f341664-0a", "ovs_interfaceid": "4f341664-0a50-41a2-8f1d-9732a3a77907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Releasing lock "refresh_cache-46df3fed-e88a-45ed-a05e-2fb2f1bf017c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.compute.manager [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Instance network_info: |[{"id": "4f341664-0a50-41a2-8f1d-9732a3a77907", "address": "fa:16:3e:c5:5b:d8", "network": {"id": "2f4a5a1d-142b-4985-a492-a6c78609683a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "79496da39fb84da59931e2879cd9367e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f341664-0a", "ovs_interfaceid": "4f341664-0a50-41a2-8f1d-9732a3a77907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e00a3166-70b6-4583-88be-9639e92e3741 req-37e370ef-1670-4fba-a18f-e7e86d025d80 service nova] Acquired lock "refresh_cache-46df3fed-e88a-45ed-a05e-2fb2f1bf017c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.network.neutron [req-e00a3166-70b6-4583-88be-9639e92e3741 req-37e370ef-1670-4fba-a18f-e7e86d025d80 service nova] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Refreshing network info cache for port 4f341664-0a50-41a2-8f1d-9732a3a77907 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Start _get_guest_xml network_info=[{"id": "4f341664-0a50-41a2-8f1d-9732a3a77907", "address": "fa:16:3e:c5:5b:d8", "network": {"id": "2f4a5a1d-142b-4985-a492-a6c78609683a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "79496da39fb84da59931e2879cd9367e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f341664-0a", "ovs_interfaceid": "4f341664-0a50-41a2-8f1d-9732a3a77907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:00:21 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:00:21 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:00:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-450773641',display_name='tempest-VolumesNegativeTest-instance-450773641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-450773641',id=20,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af8f4d7d37534880972312430acb9807',ramdisk_id='',reservation_id='r-l590iw2t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1242653964',owner_user_name='tempest-VolumesNegativeTest-1242653964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:00:19Z,user_data=None,user_id='e485d1d0937e45c2850f98520b208756',uuid=46df3fed-e88a-45ed-a05e-2fb2f1bf017c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f341664-0a50-41a2-8f1d-9732a3a77907", "address": "fa:16:3e:c5:5b:d8", "network": {"id": "2f4a5a1d-142b-4985-a492-a6c78609683a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "79496da39fb84da59931e2879cd9367e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f341664-0a", "ovs_interfaceid": "4f341664-0a50-41a2-8f1d-9732a3a77907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Converting VIF {"id": "4f341664-0a50-41a2-8f1d-9732a3a77907", "address": "fa:16:3e:c5:5b:d8", "network": {"id": "2f4a5a1d-142b-4985-a492-a6c78609683a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "79496da39fb84da59931e2879cd9367e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f341664-0a", "ovs_interfaceid": "4f341664-0a50-41a2-8f1d-9732a3a77907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:5b:d8,bridge_name='br-int',has_traffic_filtering=True,id=4f341664-0a50-41a2-8f1d-9732a3a77907,network=Network(2f4a5a1d-142b-4985-a492-a6c78609683a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f341664-0a') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.objects.instance [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Lazy-loading 'pci_devices' on Instance uuid 46df3fed-e88a-45ed-a05e-2fb2f1bf017c {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:00:21 user nova-compute[74669]:   <uuid>46df3fed-e88a-45ed-a05e-2fb2f1bf017c</uuid>
Nov 08 17:00:21 user nova-compute[74669]:   <name>instance-00000014</name>
Nov 08 17:00:21 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:00:21 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:00:21 user nova-compute[74669]:   <metadata>
Nov 08 17:00:21 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:00:21 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:00:21 user nova-compute[74669]:       <nova:name>tempest-VolumesNegativeTest-instance-450773641</nova:name>
Nov 08 17:00:21 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:00:21</nova:creationTime>
Nov 08 17:00:21 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:00:21 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:00:21 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:00:21 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:00:21 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:00:21 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:00:21 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:00:21 user nova-compute[74669]:       <nova:owner>
Nov 08 17:00:21 user nova-compute[74669]:         <nova:user uuid="e485d1d0937e45c2850f98520b208756">tempest-VolumesNegativeTest-1242653964-project-member</nova:user>
Nov 08 17:00:21 user nova-compute[74669]:         <nova:project uuid="af8f4d7d37534880972312430acb9807">tempest-VolumesNegativeTest-1242653964</nova:project>
Nov 08 17:00:21 user nova-compute[74669]:       </nova:owner>
Nov 08 17:00:21 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:00:21 user nova-compute[74669]:       <nova:ports>
Nov 08 17:00:21 user nova-compute[74669]:         <nova:port uuid="4f341664-0a50-41a2-8f1d-9732a3a77907">
Nov 08 17:00:21 user nova-compute[74669]:           <nova:ip type="fixed" address="192.168.233.197" ipVersion="4"/>
Nov 08 17:00:21 user nova-compute[74669]:         </nova:port>
Nov 08 17:00:21 user nova-compute[74669]:       </nova:ports>
Nov 08 17:00:21 user nova-compute[74669]:     </nova:instance>
Nov 08 17:00:21 user nova-compute[74669]:   </metadata>
Nov 08 17:00:21 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:00:21 user nova-compute[74669]:     <system>
Nov 08 17:00:21 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:00:21 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:00:21 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:00:21 user nova-compute[74669]:       <entry name="serial">46df3fed-e88a-45ed-a05e-2fb2f1bf017c</entry>
Nov 08 17:00:21 user nova-compute[74669]:       <entry name="uuid">46df3fed-e88a-45ed-a05e-2fb2f1bf017c</entry>
Nov 08 17:00:21 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:00:21 user nova-compute[74669]:     </system>
Nov 08 17:00:21 user nova-compute[74669]:   </sysinfo>
Nov 08 17:00:21 user nova-compute[74669]:   <os>
Nov 08 17:00:21 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:00:21 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:00:21 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:00:21 user nova-compute[74669]:   </os>
Nov 08 17:00:21 user nova-compute[74669]:   <features>
Nov 08 17:00:21 user nova-compute[74669]:     <acpi/>
Nov 08 17:00:21 user nova-compute[74669]:     <apic/>
Nov 08 17:00:21 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:00:21 user nova-compute[74669]:   </features>
Nov 08 17:00:21 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:00:21 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:00:21 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:00:21 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:00:21 user nova-compute[74669]:   </clock>
Nov 08 17:00:21 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:00:21 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:00:21 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:00:21 user nova-compute[74669]:   </cpu>
Nov 08 17:00:21 user nova-compute[74669]:   <devices>
Nov 08 17:00:21 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:00:21 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:00:21 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/46df3fed-e88a-45ed-a05e-2fb2f1bf017c/disk"/>
Nov 08 17:00:21 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:00:21 user nova-compute[74669]:     </disk>
Nov 08 17:00:21 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:00:21 user nova-compute[74669]:       <mac address="fa:16:3e:c5:5b:d8"/>
Nov 08 17:00:21 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:00:21 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:00:21 user nova-compute[74669]:       <target dev="tap4f341664-0a"/>
Nov 08 17:00:21 user nova-compute[74669]:     </interface>
Nov 08 17:00:21 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:00:21 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/46df3fed-e88a-45ed-a05e-2fb2f1bf017c/console.log" append="off"/>
Nov 08 17:00:21 user nova-compute[74669]:     </serial>
Nov 08 17:00:21 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:00:21 user nova-compute[74669]:     <video>
Nov 08 17:00:21 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:00:21 user nova-compute[74669]:     </video>
Nov 08 17:00:21 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:00:21 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:00:21 user nova-compute[74669]:     </rng>
Nov 08 17:00:21 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:00:21 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:00:21 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:00:21 user nova-compute[74669]:     </memballoon>
Nov 08 17:00:21 user nova-compute[74669]:   </devices>
Nov 08 17:00:21 user nova-compute[74669]: </domain>
Nov 08 17:00:21 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:00:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-450773641',display_name='tempest-VolumesNegativeTest-instance-450773641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-450773641',id=20,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af8f4d7d37534880972312430acb9807',ramdisk_id='',reservation_id='r-l590iw2t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1242653964',owner_user_name='tempest-VolumesNegativeTest-1242653964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:00:19Z,user_data=None,user_id='e485d1d0937e45c2850f98520b208756',uuid=46df3fed-e88a-45ed-a05e-2fb2f1bf017c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f341664-0a50-41a2-8f1d-9732a3a77907", "address": "fa:16:3e:c5:5b:d8", "network": {"id": "2f4a5a1d-142b-4985-a492-a6c78609683a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "79496da39fb84da59931e2879cd9367e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f341664-0a", "ovs_interfaceid": "4f341664-0a50-41a2-8f1d-9732a3a77907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Converting VIF {"id": "4f341664-0a50-41a2-8f1d-9732a3a77907", "address": "fa:16:3e:c5:5b:d8", "network": {"id": "2f4a5a1d-142b-4985-a492-a6c78609683a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "79496da39fb84da59931e2879cd9367e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f341664-0a", "ovs_interfaceid": "4f341664-0a50-41a2-8f1d-9732a3a77907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:5b:d8,bridge_name='br-int',has_traffic_filtering=True,id=4f341664-0a50-41a2-8f1d-9732a3a77907,network=Network(2f4a5a1d-142b-4985-a492-a6c78609683a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f341664-0a') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG os_vif [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:5b:d8,bridge_name='br-int',has_traffic_filtering=True,id=4f341664-0a50-41a2-8f1d-9732a3a77907,network=Network(2f4a5a1d-142b-4985-a492-a6c78609683a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f341664-0a') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92b17af2-53e4-55f0-99cf-8757911f9ef1', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f341664-0a, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f341664-0a, col_values=(('qos', UUID('9e9b78f3-3120-4df1-9369-2f672c6a775c')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f341664-0a, col_values=(('external_ids', {'iface-id': '4f341664-0a50-41a2-8f1d-9732a3a77907', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:5b:d8', 'vm-uuid': '46df3fed-e88a-45ed-a05e-2fb2f1bf017c'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:21 user nova-compute[74669]: INFO os_vif [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:5b:d8,bridge_name='br-int',has_traffic_filtering=True,id=4f341664-0a50-41a2-8f1d-9732a3a77907,network=Network(2f4a5a1d-142b-4985-a492-a6c78609683a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f341664-0a')
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:00:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] No VIF found with MAC fa:16:3e:c5:5b:d8, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:00:22 user nova-compute[74669]: DEBUG nova.network.neutron [req-e00a3166-70b6-4583-88be-9639e92e3741 req-37e370ef-1670-4fba-a18f-e7e86d025d80 service nova] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Updated VIF entry in instance network info cache for port 4f341664-0a50-41a2-8f1d-9732a3a77907. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:00:22 user nova-compute[74669]: DEBUG nova.network.neutron [req-e00a3166-70b6-4583-88be-9639e92e3741 req-37e370ef-1670-4fba-a18f-e7e86d025d80 service nova] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Updating instance_info_cache with network_info: [{"id": "4f341664-0a50-41a2-8f1d-9732a3a77907", "address": "fa:16:3e:c5:5b:d8", "network": {"id": "2f4a5a1d-142b-4985-a492-a6c78609683a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "79496da39fb84da59931e2879cd9367e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f341664-0a", "ovs_interfaceid": "4f341664-0a50-41a2-8f1d-9732a3a77907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:00:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e00a3166-70b6-4583-88be-9639e92e3741 req-37e370ef-1670-4fba-a18f-e7e86d025d80 service nova] Releasing lock "refresh_cache-46df3fed-e88a-45ed-a05e-2fb2f1bf017c" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:00:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:23 user nova-compute[74669]: DEBUG nova.compute.manager [req-66e6f150-950e-4e94-89be-a2c90e5bb0ac req-c6b3dcc4-2b34-43cd-9824-6978313cda78 service nova] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Received event network-vif-plugged-4f341664-0a50-41a2-8f1d-9732a3a77907 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:00:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-66e6f150-950e-4e94-89be-a2c90e5bb0ac req-c6b3dcc4-2b34-43cd-9824-6978313cda78 service nova] Acquiring lock "46df3fed-e88a-45ed-a05e-2fb2f1bf017c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-66e6f150-950e-4e94-89be-a2c90e5bb0ac req-c6b3dcc4-2b34-43cd-9824-6978313cda78 service nova] Lock "46df3fed-e88a-45ed-a05e-2fb2f1bf017c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-66e6f150-950e-4e94-89be-a2c90e5bb0ac req-c6b3dcc4-2b34-43cd-9824-6978313cda78 service nova] Lock "46df3fed-e88a-45ed-a05e-2fb2f1bf017c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:23 user nova-compute[74669]: DEBUG nova.compute.manager [req-66e6f150-950e-4e94-89be-a2c90e5bb0ac req-c6b3dcc4-2b34-43cd-9824-6978313cda78 service nova] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] No waiting events found dispatching network-vif-plugged-4f341664-0a50-41a2-8f1d-9732a3a77907 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:00:23 user nova-compute[74669]: WARNING nova.compute.manager [req-66e6f150-950e-4e94-89be-a2c90e5bb0ac req-c6b3dcc4-2b34-43cd-9824-6978313cda78 service nova] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Received unexpected event network-vif-plugged-4f341664-0a50-41a2-8f1d-9732a3a77907 for instance with vm_state building and task_state spawning.
Nov 08 17:00:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:25 user nova-compute[74669]: DEBUG nova.compute.manager [req-69723055-5cbe-40cd-aa2e-1665fcb42633 req-855e00cb-8f69-4abd-ba1c-194b6e79e70b service nova] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Received event network-vif-plugged-4f341664-0a50-41a2-8f1d-9732a3a77907 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:00:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-69723055-5cbe-40cd-aa2e-1665fcb42633 req-855e00cb-8f69-4abd-ba1c-194b6e79e70b service nova] Acquiring lock "46df3fed-e88a-45ed-a05e-2fb2f1bf017c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-69723055-5cbe-40cd-aa2e-1665fcb42633 req-855e00cb-8f69-4abd-ba1c-194b6e79e70b service nova] Lock "46df3fed-e88a-45ed-a05e-2fb2f1bf017c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-69723055-5cbe-40cd-aa2e-1665fcb42633 req-855e00cb-8f69-4abd-ba1c-194b6e79e70b service nova] Lock "46df3fed-e88a-45ed-a05e-2fb2f1bf017c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:25 user nova-compute[74669]: DEBUG nova.compute.manager [req-69723055-5cbe-40cd-aa2e-1665fcb42633 req-855e00cb-8f69-4abd-ba1c-194b6e79e70b service nova] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] No waiting events found dispatching network-vif-plugged-4f341664-0a50-41a2-8f1d-9732a3a77907 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:00:25 user nova-compute[74669]: WARNING nova.compute.manager [req-69723055-5cbe-40cd-aa2e-1665fcb42633 req-855e00cb-8f69-4abd-ba1c-194b6e79e70b service nova] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Received unexpected event network-vif-plugged-4f341664-0a50-41a2-8f1d-9732a3a77907 for instance with vm_state building and task_state spawning.
Nov 08 17:00:25 user nova-compute[74669]: DEBUG nova.compute.manager [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:00:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:00:25 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Instance spawned successfully.
Nov 08 17:00:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:00:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:25 user nova-compute[74669]: INFO nova.compute.manager [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Took 6.43 seconds to spawn the instance on the hypervisor.
Nov 08 17:00:25 user nova-compute[74669]: DEBUG nova.compute.manager [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:00:25 user nova-compute[74669]: INFO nova.compute.manager [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Took 7.73 seconds to build instance.
Nov 08 17:00:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3ff0793e-ebc8-482e-ada7-9251be090b9c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Lock "46df3fed-e88a-45ed-a05e-2fb2f1bf017c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.062s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:31 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:33 user nova-compute[74669]: DEBUG nova.compute.manager [req-3e3889f0-3278-43a8-8864-6596433dfd93 req-edee6a55-ca1f-4e17-81c2-7c8beb699722 service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Received event network-changed-9bfc353f-1fb9-412e-80c7-64b5a2ecc32c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:00:33 user nova-compute[74669]: DEBUG nova.compute.manager [req-3e3889f0-3278-43a8-8864-6596433dfd93 req-edee6a55-ca1f-4e17-81c2-7c8beb699722 service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Refreshing instance network info cache due to event network-changed-9bfc353f-1fb9-412e-80c7-64b5a2ecc32c. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:00:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3e3889f0-3278-43a8-8864-6596433dfd93 req-edee6a55-ca1f-4e17-81c2-7c8beb699722 service nova] Acquiring lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:00:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3e3889f0-3278-43a8-8864-6596433dfd93 req-edee6a55-ca1f-4e17-81c2-7c8beb699722 service nova] Acquired lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:00:33 user nova-compute[74669]: DEBUG nova.network.neutron [req-3e3889f0-3278-43a8-8864-6596433dfd93 req-edee6a55-ca1f-4e17-81c2-7c8beb699722 service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Refreshing network info cache for port 9bfc353f-1fb9-412e-80c7-64b5a2ecc32c {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:00:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:33 user nova-compute[74669]: DEBUG nova.network.neutron [req-3e3889f0-3278-43a8-8864-6596433dfd93 req-edee6a55-ca1f-4e17-81c2-7c8beb699722 service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Updated VIF entry in instance network info cache for port 9bfc353f-1fb9-412e-80c7-64b5a2ecc32c. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:00:33 user nova-compute[74669]: DEBUG nova.network.neutron [req-3e3889f0-3278-43a8-8864-6596433dfd93 req-edee6a55-ca1f-4e17-81c2-7c8beb699722 service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Updating instance_info_cache with network_info: [{"id": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "address": "fa:16:3e:e6:99:99", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bfc353f-1f", "ovs_interfaceid": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:00:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3e3889f0-3278-43a8-8864-6596433dfd93 req-edee6a55-ca1f-4e17-81c2-7c8beb699722 service nova] Releasing lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:00:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "d91eaa51-6bf4-40eb-9f36-f8e838501373" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:40 user nova-compute[74669]: DEBUG nova.compute.manager [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:00:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:00:40 user nova-compute[74669]: INFO nova.compute.claims [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Claim successful on node user
Nov 08 17:00:40 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:00:40 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:00:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:40 user nova-compute[74669]: DEBUG nova.compute.manager [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:00:40 user nova-compute[74669]: DEBUG nova.compute.manager [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:00:40 user nova-compute[74669]: DEBUG nova.network.neutron [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:00:41 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:00:41 user nova-compute[74669]: DEBUG nova.compute.manager [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:00:41 user nova-compute[74669]: DEBUG nova.policy [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '645f4df51c4240609e10a787918ddf41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f704465bf5a44db5aa573ec6546b16c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:00:41 user nova-compute[74669]: DEBUG nova.compute.manager [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:00:41 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:00:41 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Creating image(s)
Nov 08 17:00:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "/opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "/opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "/opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.192s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.186s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk 1073741824" returned: 0 in 0.054s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:41 user nova-compute[74669]: DEBUG nova.network.neutron [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Successfully created port: cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:00:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.205s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:41 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:00:41 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:42 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Cannot resize image /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:00:42 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:00:42 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Ensure instance console log exists: /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:00:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:42 user nova-compute[74669]: DEBUG nova.network.neutron [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Successfully updated port: cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:00:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "refresh_cache-d91eaa51-6bf4-40eb-9f36-f8e838501373" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:00:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquired lock "refresh_cache-d91eaa51-6bf4-40eb-9f36-f8e838501373" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:00:42 user nova-compute[74669]: DEBUG nova.network.neutron [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:00:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-b518aa25-9a39-4017-8d5c-abedd3c718ca req-ac5ba4b2-3075-41e6-9cc8-3f0552acdfd9 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Received event network-changed-cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:00:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-b518aa25-9a39-4017-8d5c-abedd3c718ca req-ac5ba4b2-3075-41e6-9cc8-3f0552acdfd9 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Refreshing instance network info cache due to event network-changed-cd57159a-b86e-4130-ad82-ddaa0fb63501. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:00:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b518aa25-9a39-4017-8d5c-abedd3c718ca req-ac5ba4b2-3075-41e6-9cc8-3f0552acdfd9 service nova] Acquiring lock "refresh_cache-d91eaa51-6bf4-40eb-9f36-f8e838501373" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:00:42 user nova-compute[74669]: DEBUG nova.network.neutron [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.network.neutron [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Updating instance_info_cache with network_info: [{"id": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "address": "fa:16:3e:96:ba:06", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd57159a-b8", "ovs_interfaceid": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Releasing lock "refresh_cache-d91eaa51-6bf4-40eb-9f36-f8e838501373" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.compute.manager [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Instance network_info: |[{"id": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "address": "fa:16:3e:96:ba:06", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd57159a-b8", "ovs_interfaceid": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b518aa25-9a39-4017-8d5c-abedd3c718ca req-ac5ba4b2-3075-41e6-9cc8-3f0552acdfd9 service nova] Acquired lock "refresh_cache-d91eaa51-6bf4-40eb-9f36-f8e838501373" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.network.neutron [req-b518aa25-9a39-4017-8d5c-abedd3c718ca req-ac5ba4b2-3075-41e6-9cc8-3f0552acdfd9 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Refreshing network info cache for port cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Start _get_guest_xml network_info=[{"id": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "address": "fa:16:3e:96:ba:06", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd57159a-b8", "ovs_interfaceid": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:00:43 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:00:43 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:00:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-793229153',display_name='tempest-TestStampPattern-server-793229153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-793229153',id=21,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPDGzyFrH3MdZrG/tSqCKZcN7lhFYTpjgjac9mXXE01cRHOS7+HZPHOYTre5OIE1b16d2AzYSrfjX/N3IGTtTcXx8PnKlOincfS8vgaHln6XlhTSOcFKiwt6piilyaUFg==',key_name='tempest-TestStampPattern-1970291243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f704465bf5a44db5aa573ec6546b16c8',ramdisk_id='',reservation_id='r-1hqbz4tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-440069879',owner_user_name='tempest-TestStampPattern-440069879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:00:41Z,user_data=None,user_id='645f4df51c4240609e10a787918ddf41',uuid=d91eaa51-6bf4-40eb-9f36-f8e838501373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "address": "fa:16:3e:96:ba:06", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd57159a-b8", "ovs_interfaceid": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Converting VIF {"id": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "address": "fa:16:3e:96:ba:06", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd57159a-b8", "ovs_interfaceid": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:ba:06,bridge_name='br-int',has_traffic_filtering=True,id=cd57159a-b86e-4130-ad82-ddaa0fb63501,network=Network(1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd57159a-b8') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.objects.instance [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lazy-loading 'pci_devices' on Instance uuid d91eaa51-6bf4-40eb-9f36-f8e838501373 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:00:43 user nova-compute[74669]:   <uuid>d91eaa51-6bf4-40eb-9f36-f8e838501373</uuid>
Nov 08 17:00:43 user nova-compute[74669]:   <name>instance-00000015</name>
Nov 08 17:00:43 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:00:43 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:00:43 user nova-compute[74669]:   <metadata>
Nov 08 17:00:43 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:00:43 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:00:43 user nova-compute[74669]:       <nova:name>tempest-TestStampPattern-server-793229153</nova:name>
Nov 08 17:00:43 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:00:43</nova:creationTime>
Nov 08 17:00:43 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:00:43 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:00:43 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:00:43 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:00:43 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:00:43 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:00:43 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:00:43 user nova-compute[74669]:       <nova:owner>
Nov 08 17:00:43 user nova-compute[74669]:         <nova:user uuid="645f4df51c4240609e10a787918ddf41">tempest-TestStampPattern-440069879-project-member</nova:user>
Nov 08 17:00:43 user nova-compute[74669]:         <nova:project uuid="f704465bf5a44db5aa573ec6546b16c8">tempest-TestStampPattern-440069879</nova:project>
Nov 08 17:00:43 user nova-compute[74669]:       </nova:owner>
Nov 08 17:00:43 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:00:43 user nova-compute[74669]:       <nova:ports>
Nov 08 17:00:43 user nova-compute[74669]:         <nova:port uuid="cd57159a-b86e-4130-ad82-ddaa0fb63501">
Nov 08 17:00:43 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 17:00:43 user nova-compute[74669]:         </nova:port>
Nov 08 17:00:43 user nova-compute[74669]:       </nova:ports>
Nov 08 17:00:43 user nova-compute[74669]:     </nova:instance>
Nov 08 17:00:43 user nova-compute[74669]:   </metadata>
Nov 08 17:00:43 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:00:43 user nova-compute[74669]:     <system>
Nov 08 17:00:43 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:00:43 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:00:43 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:00:43 user nova-compute[74669]:       <entry name="serial">d91eaa51-6bf4-40eb-9f36-f8e838501373</entry>
Nov 08 17:00:43 user nova-compute[74669]:       <entry name="uuid">d91eaa51-6bf4-40eb-9f36-f8e838501373</entry>
Nov 08 17:00:43 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:00:43 user nova-compute[74669]:     </system>
Nov 08 17:00:43 user nova-compute[74669]:   </sysinfo>
Nov 08 17:00:43 user nova-compute[74669]:   <os>
Nov 08 17:00:43 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:00:43 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:00:43 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:00:43 user nova-compute[74669]:   </os>
Nov 08 17:00:43 user nova-compute[74669]:   <features>
Nov 08 17:00:43 user nova-compute[74669]:     <acpi/>
Nov 08 17:00:43 user nova-compute[74669]:     <apic/>
Nov 08 17:00:43 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:00:43 user nova-compute[74669]:   </features>
Nov 08 17:00:43 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:00:43 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:00:43 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:00:43 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:00:43 user nova-compute[74669]:   </clock>
Nov 08 17:00:43 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:00:43 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:00:43 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:00:43 user nova-compute[74669]:   </cpu>
Nov 08 17:00:43 user nova-compute[74669]:   <devices>
Nov 08 17:00:43 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:00:43 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:00:43 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk"/>
Nov 08 17:00:43 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:00:43 user nova-compute[74669]:     </disk>
Nov 08 17:00:43 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:00:43 user nova-compute[74669]:       <mac address="fa:16:3e:96:ba:06"/>
Nov 08 17:00:43 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:00:43 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:00:43 user nova-compute[74669]:       <target dev="tapcd57159a-b8"/>
Nov 08 17:00:43 user nova-compute[74669]:     </interface>
Nov 08 17:00:43 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:00:43 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/console.log" append="off"/>
Nov 08 17:00:43 user nova-compute[74669]:     </serial>
Nov 08 17:00:43 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:00:43 user nova-compute[74669]:     <video>
Nov 08 17:00:43 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:00:43 user nova-compute[74669]:     </video>
Nov 08 17:00:43 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:00:43 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:00:43 user nova-compute[74669]:     </rng>
Nov 08 17:00:43 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:00:43 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:00:43 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:00:43 user nova-compute[74669]:     </memballoon>
Nov 08 17:00:43 user nova-compute[74669]:   </devices>
Nov 08 17:00:43 user nova-compute[74669]: </domain>
Nov 08 17:00:43 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:00:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-793229153',display_name='tempest-TestStampPattern-server-793229153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-793229153',id=21,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPDGzyFrH3MdZrG/tSqCKZcN7lhFYTpjgjac9mXXE01cRHOS7+HZPHOYTre5OIE1b16d2AzYSrfjX/N3IGTtTcXx8PnKlOincfS8vgaHln6XlhTSOcFKiwt6piilyaUFg==',key_name='tempest-TestStampPattern-1970291243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f704465bf5a44db5aa573ec6546b16c8',ramdisk_id='',reservation_id='r-1hqbz4tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-440069879',owner_user_name='tempest-TestStampPattern-440069879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:00:41Z,user_data=None,user_id='645f4df51c4240609e10a787918ddf41',uuid=d91eaa51-6bf4-40eb-9f36-f8e838501373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "address": "fa:16:3e:96:ba:06", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd57159a-b8", "ovs_interfaceid": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Converting VIF {"id": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "address": "fa:16:3e:96:ba:06", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd57159a-b8", "ovs_interfaceid": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:ba:06,bridge_name='br-int',has_traffic_filtering=True,id=cd57159a-b86e-4130-ad82-ddaa0fb63501,network=Network(1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd57159a-b8') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG os_vif [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ba:06,bridge_name='br-int',has_traffic_filtering=True,id=cd57159a-b86e-4130-ad82-ddaa0fb63501,network=Network(1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd57159a-b8') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8a5ad34-790e-5a0d-80fd-bfd6f80105ed', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd57159a-b8, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd57159a-b8, col_values=(('qos', UUID('41a191a5-abe5-4313-afbe-215f59cbfa96')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd57159a-b8, col_values=(('external_ids', {'iface-id': 'cd57159a-b86e-4130-ad82-ddaa0fb63501', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:ba:06', 'vm-uuid': 'd91eaa51-6bf4-40eb-9f36-f8e838501373'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:43 user nova-compute[74669]: INFO os_vif [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ba:06,bridge_name='br-int',has_traffic_filtering=True,id=cd57159a-b86e-4130-ad82-ddaa0fb63501,network=Network(1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd57159a-b8')
Nov 08 17:00:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] No VIF found with MAC fa:16:3e:96:ba:06, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.network.neutron [req-b518aa25-9a39-4017-8d5c-abedd3c718ca req-ac5ba4b2-3075-41e6-9cc8-3f0552acdfd9 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Updated VIF entry in instance network info cache for port cd57159a-b86e-4130-ad82-ddaa0fb63501. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG nova.network.neutron [req-b518aa25-9a39-4017-8d5c-abedd3c718ca req-ac5ba4b2-3075-41e6-9cc8-3f0552acdfd9 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Updating instance_info_cache with network_info: [{"id": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "address": "fa:16:3e:96:ba:06", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd57159a-b8", "ovs_interfaceid": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:00:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b518aa25-9a39-4017-8d5c-abedd3c718ca req-ac5ba4b2-3075-41e6-9cc8-3f0552acdfd9 service nova] Releasing lock "refresh_cache-d91eaa51-6bf4-40eb-9f36-f8e838501373" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:00:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:45 user nova-compute[74669]: DEBUG nova.compute.manager [req-b9b33a70-7f2b-47d8-95bd-83b26dce526c req-f99d9563-3859-4b5a-a48a-efc05ef1f01f service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Received event network-vif-plugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:00:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b9b33a70-7f2b-47d8-95bd-83b26dce526c req-f99d9563-3859-4b5a-a48a-efc05ef1f01f service nova] Acquiring lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b9b33a70-7f2b-47d8-95bd-83b26dce526c req-f99d9563-3859-4b5a-a48a-efc05ef1f01f service nova] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b9b33a70-7f2b-47d8-95bd-83b26dce526c req-f99d9563-3859-4b5a-a48a-efc05ef1f01f service nova] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:45 user nova-compute[74669]: DEBUG nova.compute.manager [req-b9b33a70-7f2b-47d8-95bd-83b26dce526c req-f99d9563-3859-4b5a-a48a-efc05ef1f01f service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] No waiting events found dispatching network-vif-plugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:00:45 user nova-compute[74669]: WARNING nova.compute.manager [req-b9b33a70-7f2b-47d8-95bd-83b26dce526c req-f99d9563-3859-4b5a-a48a-efc05ef1f01f service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Received unexpected event network-vif-plugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 for instance with vm_state building and task_state spawning.
Nov 08 17:00:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-e4f9df88-e427-4567-bd49-89d71c2bdf48 req-4e45bcc8-d099-4910-b23f-6c7e1fb989ac service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Received event network-vif-plugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:00:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e4f9df88-e427-4567-bd49-89d71c2bdf48 req-4e45bcc8-d099-4910-b23f-6c7e1fb989ac service nova] Acquiring lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e4f9df88-e427-4567-bd49-89d71c2bdf48 req-4e45bcc8-d099-4910-b23f-6c7e1fb989ac service nova] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e4f9df88-e427-4567-bd49-89d71c2bdf48 req-4e45bcc8-d099-4910-b23f-6c7e1fb989ac service nova] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-e4f9df88-e427-4567-bd49-89d71c2bdf48 req-4e45bcc8-d099-4910-b23f-6c7e1fb989ac service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] No waiting events found dispatching network-vif-plugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:00:47 user nova-compute[74669]: WARNING nova.compute.manager [req-e4f9df88-e427-4567-bd49-89d71c2bdf48 req-4e45bcc8-d099-4910-b23f-6c7e1fb989ac service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Received unexpected event network-vif-plugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 for instance with vm_state building and task_state spawning.
Nov 08 17:00:47 user nova-compute[74669]: DEBUG nova.compute.manager [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:00:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:00:47 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Instance spawned successfully.
Nov 08 17:00:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:00:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:00:47 user nova-compute[74669]: INFO nova.compute.manager [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Took 6.14 seconds to spawn the instance on the hypervisor.
Nov 08 17:00:47 user nova-compute[74669]: DEBUG nova.compute.manager [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:00:47 user nova-compute[74669]: INFO nova.compute.manager [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Took 7.05 seconds to build instance.
Nov 08 17:00:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-61c5cf5d-c888-45b1-ba98-30b4400b0237 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.177s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:47 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:00:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:48 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:00:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:48 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:00:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:00:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:00:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:00:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46df3fed-e88a-45ed-a05e-2fb2f1bf017c/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46df3fed-e88a-45ed-a05e-2fb2f1bf017c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46df3fed-e88a-45ed-a05e-2fb2f1bf017c/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46df3fed-e88a-45ed-a05e-2fb2f1bf017c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:00:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:00:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:00:54 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:00:54 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:00:54 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=7098MB free_disk=25.397090911865234GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:00:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:00:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:00:54 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:00:54 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:00:54 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b26dbeeb-b629-414d-bcca-cdde6c207789 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:00:54 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0ce9072b-e003-4921-83bc-8f3449c09e14 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:00:54 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7b335462-0d93-4899-a223-5c2e36932578 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:00:54 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b663cd16-12b5-48fc-886d-0a7d160faea5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:00:54 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 55c67717-eb46-4617-9165-28531360e5d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:00:54 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance c20b4c52-94b1-4aed-98f0-ae228df81175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:00:54 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b8bfb971-094b-46cf-b8bd-ba3df8994e7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:00:54 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 46df3fed-e88a-45ed-a05e-2fb2f1bf017c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:00:54 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance d91eaa51-6bf4-40eb-9f36-f8e838501373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:00:54 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:00:54 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:00:54 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:00:55 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:00:55 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:00:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.680s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:00:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:56 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:00:56 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:00:56 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:00:56 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:00:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:00:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:00:56 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:00:56 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Updating instance_info_cache with network_info: [{"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:00:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-b26dbeeb-b629-414d-bcca-cdde6c207789" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:00:56 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:00:56 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:00:56 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:00:56 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:00:56 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:00:56 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:00:56 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:00:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:00:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:22 user nova-compute[74669]: DEBUG nova.compute.manager [req-bf304922-e042-4c73-91e7-0428c6efb774 req-14c65659-5a3e-42fc-85bd-f72766f8d3c8 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-changed-314df0da-c133-46af-bdc1-a317e71ca069 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:22 user nova-compute[74669]: DEBUG nova.compute.manager [req-bf304922-e042-4c73-91e7-0428c6efb774 req-14c65659-5a3e-42fc-85bd-f72766f8d3c8 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Refreshing instance network info cache due to event network-changed-314df0da-c133-46af-bdc1-a317e71ca069. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:01:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-bf304922-e042-4c73-91e7-0428c6efb774 req-14c65659-5a3e-42fc-85bd-f72766f8d3c8 service nova] Acquiring lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:01:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-bf304922-e042-4c73-91e7-0428c6efb774 req-14c65659-5a3e-42fc-85bd-f72766f8d3c8 service nova] Acquired lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:01:22 user nova-compute[74669]: DEBUG nova.network.neutron [req-bf304922-e042-4c73-91e7-0428c6efb774 req-14c65659-5a3e-42fc-85bd-f72766f8d3c8 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Refreshing network info cache for port 314df0da-c133-46af-bdc1-a317e71ca069 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG nova.network.neutron [req-bf304922-e042-4c73-91e7-0428c6efb774 req-14c65659-5a3e-42fc-85bd-f72766f8d3c8 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Updated VIF entry in instance network info cache for port 314df0da-c133-46af-bdc1-a317e71ca069. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG nova.network.neutron [req-bf304922-e042-4c73-91e7-0428c6efb774 req-14c65659-5a3e-42fc-85bd-f72766f8d3c8 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Updating instance_info_cache with network_info: [{"id": "314df0da-c133-46af-bdc1-a317e71ca069", "address": "fa:16:3e:c4:c1:5b", "network": {"id": "ee33eeed-0f37-4f56-aa18-e6c986e10eb7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-786579928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314df0da-c1", "ovs_interfaceid": "314df0da-c133-46af-bdc1-a317e71ca069", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98dcc41a-801d-4934-8069-75d814493170", "address": "fa:16:3e:4a:0a:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98dcc41a-80", "ovs_interfaceid": "98dcc41a-801d-4934-8069-75d814493170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "address": "fa:16:3e:9d:06:2c", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3416a767-03", "ovs_interfaceid": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "address": "fa:16:3e:a4:bd:59", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82aa3c9f-78", "ovs_interfaceid": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "address": "fa:16:3e:c3:25:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dac6ca-fd", "ovs_interfaceid": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "address": "fa:16:3e:6a:5e:82", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4adfe0-b1", "ovs_interfaceid": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "898bcd3e-b90e-493b-904a-5f533757c60e", "address": "fa:16:3e:b3:e6:5a", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898bcd3e-b9", "ovs_interfaceid": "898bcd3e-b90e-493b-904a-5f533757c60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-bf304922-e042-4c73-91e7-0428c6efb774 req-14c65659-5a3e-42fc-85bd-f72766f8d3c8 service nova] Releasing lock "refresh_cache-0ce9072b-e003-4921-83bc-8f3449c09e14" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG nova.compute.manager [req-03f23c8a-b396-4453-889e-482689196631 req-e3a5d335-cf9b-45ce-a037-4589685ee0b0 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received event network-changed-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG nova.compute.manager [req-03f23c8a-b396-4453-889e-482689196631 req-e3a5d335-cf9b-45ce-a037-4589685ee0b0 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Refreshing instance network info cache due to event network-changed-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-03f23c8a-b396-4453-889e-482689196631 req-e3a5d335-cf9b-45ce-a037-4589685ee0b0 service nova] Acquiring lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-03f23c8a-b396-4453-889e-482689196631 req-e3a5d335-cf9b-45ce-a037-4589685ee0b0 service nova] Acquired lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG nova.network.neutron [req-03f23c8a-b396-4453-889e-482689196631 req-e3a5d335-cf9b-45ce-a037-4589685ee0b0 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Refreshing network info cache for port f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "b663cd16-12b5-48fc-886d-0a7d160faea5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG nova.objects.instance [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'flavor' on Instance uuid b663cd16-12b5-48fc-886d-0a7d160faea5 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "b663cd16-12b5-48fc-886d-0a7d160faea5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:23 user nova-compute[74669]: INFO nova.compute.manager [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Attaching volume f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 to /dev/vdb
Nov 08 17:01:23 user nova-compute[74669]: DEBUG os_brick.utils [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG nova.network.neutron [req-03f23c8a-b396-4453-889e-482689196631 req-e3a5d335-cf9b-45ce-a037-4589685ee0b0 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Updated VIF entry in instance network info cache for port f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG nova.network.neutron [req-03f23c8a-b396-4453-889e-482689196631 req-e3a5d335-cf9b-45ce-a037-4589685ee0b0 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Updating instance_info_cache with network_info: [{"id": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "address": "fa:16:3e:70:48:8f", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c0ff3a-f7", "ovs_interfaceid": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b0a979-90b9-4a77-806c-d15df148bcd0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-03f23c8a-b396-4453-889e-482689196631 req-e3a5d335-cf9b-45ce-a037-4589685ee0b0 service nova] Releasing lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.034s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f79c13-7b3c-4a1c-bbb8-6600d9a8fe08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac140f96-cca5-4e4d-aa06-f1abd1f65177]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9491a65-c1ca-4b55-87b2-3d95b1e9adb7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:01:23 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:01:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[110f31c7-e1f8-431e-9b2a-29e049f51b40]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG os_brick.utils [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:01:23 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Updating existing volume attachment record: 0d09788c-0426-46bc-b1d2-0c892e3404e3 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "b26dbeeb-b629-414d-bcca-cdde6c207789" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:25 user nova-compute[74669]: INFO nova.compute.manager [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Terminating instance
Nov 08 17:01:25 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:25 user nova-compute[74669]: INFO nova.compute.manager [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Terminating instance
Nov 08 17:01:25 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG nova.compute.manager [req-8daa3216-d9cf-46a2-8dbd-5f7ad1e4ad98 req-21b4954f-799f-4ea6-9868-ab0cabfd0d67 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received event network-vif-unplugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8daa3216-d9cf-46a2-8dbd-5f7ad1e4ad98 req-21b4954f-799f-4ea6-9868-ab0cabfd0d67 service nova] Acquiring lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8daa3216-d9cf-46a2-8dbd-5f7ad1e4ad98 req-21b4954f-799f-4ea6-9868-ab0cabfd0d67 service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8daa3216-d9cf-46a2-8dbd-5f7ad1e4ad98 req-21b4954f-799f-4ea6-9868-ab0cabfd0d67 service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG nova.compute.manager [req-8daa3216-d9cf-46a2-8dbd-5f7ad1e4ad98 req-21b4954f-799f-4ea6-9868-ab0cabfd0d67 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] No waiting events found dispatching network-vif-unplugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG nova.compute.manager [req-8daa3216-d9cf-46a2-8dbd-5f7ad1e4ad98 req-21b4954f-799f-4ea6-9868-ab0cabfd0d67 service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received event network-vif-unplugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG nova.compute.manager [req-e3321e21-235e-4c87-85df-ebd73511edb0 req-4c4929e9-2596-48a8-9d0d-444bd8c9563b service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-unplugged-314df0da-c133-46af-bdc1-a317e71ca069 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e3321e21-235e-4c87-85df-ebd73511edb0 req-4c4929e9-2596-48a8-9d0d-444bd8c9563b service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e3321e21-235e-4c87-85df-ebd73511edb0 req-4c4929e9-2596-48a8-9d0d-444bd8c9563b service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e3321e21-235e-4c87-85df-ebd73511edb0 req-4c4929e9-2596-48a8-9d0d-444bd8c9563b service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG nova.compute.manager [req-e3321e21-235e-4c87-85df-ebd73511edb0 req-4c4929e9-2596-48a8-9d0d-444bd8c9563b service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-unplugged-314df0da-c133-46af-bdc1-a317e71ca069 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG nova.compute.manager [req-e3321e21-235e-4c87-85df-ebd73511edb0 req-4c4929e9-2596-48a8-9d0d-444bd8c9563b service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-unplugged-314df0da-c133-46af-bdc1-a317e71ca069 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:26 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Instance destroyed successfully.
Nov 08 17:01:26 user nova-compute[74669]: DEBUG nova.objects.instance [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lazy-loading 'resources' on Instance uuid b26dbeeb-b629-414d-bcca-cdde6c207789 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-82074997',display_name='tempest-ServerActionsTestOtherB-server-82074997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-82074997',id=5,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVVAiZ/J+loI4/5CGCEcHyBdao/VDdeBeozCcJvl0eh7qycgoJCVfo066fltlkQiowyw4815L1dFrqeYMGOPhwhd9fpfcyVQWgEILP3lJeo6lsJtZZ3WMWpczoYeL0t+w==',key_name='tempest-keypair-1692388907',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:59:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bc128b2ae524ce0aff2afb7301888bf',ramdisk_id='',reservation_id='r-fjmhrntp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-839528249',owner_user_name='tempest-ServerActionsTestOtherB-839528249-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:59:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acb95477d6ba46d4be3b34280c5892e5',uuid=b26dbeeb-b629-414d-bcca-cdde6c207789,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Converting VIF {"id": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "address": "fa:16:3e:33:33:ae", "network": {"id": "35a879d8-439e-4ac4-a8ae-292e3b9a1966", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1823624814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bc128b2ae524ce0aff2afb7301888bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9314f-4e", "ovs_interfaceid": "47c9314f-4ea9-49c3-9b34-2fb94cc1eac4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:33:ae,bridge_name='br-int',has_traffic_filtering=True,id=47c9314f-4ea9-49c3-9b34-2fb94cc1eac4,network=Network(35a879d8-439e-4ac4-a8ae-292e3b9a1966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9314f-4e') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG os_vif [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:33:ae,bridge_name='br-int',has_traffic_filtering=True,id=47c9314f-4ea9-49c3-9b34-2fb94cc1eac4,network=Network(35a879d8-439e-4ac4-a8ae-292e3b9a1966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9314f-4e') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47c9314f-4e, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e33ff415-b8f9-4bf8-8d8a-d86af86b258e) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:26 user nova-compute[74669]: INFO os_vif [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:33:ae,bridge_name='br-int',has_traffic_filtering=True,id=47c9314f-4ea9-49c3-9b34-2fb94cc1eac4,network=Network(35a879d8-439e-4ac4-a8ae-292e3b9a1966),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9314f-4e')
Nov 08 17:01:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygTldqYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:01:26 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:01:26 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81b9dd9-273b-44ce-b726-e4f8b07177a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:01:26 user nova-compute[74669]: No targets found.
Nov 08 17:01:26 user nova-compute[74669]: iSNS:
Nov 08 17:01:26 user nova-compute[74669]: No targets found.
Nov 08 17:01:26 user nova-compute[74669]: STATIC:
Nov 08 17:01:26 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263
Nov 08 17:01:26 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:01:26 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:01:26 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55
Nov 08 17:01:26 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:01:26 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:01:26 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336
Nov 08 17:01:26 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:01:26 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:01:26 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5
Nov 08 17:01:26 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:01:26 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:01:26 user nova-compute[74669]: FIRMWARE:
Nov 08 17:01:26 user nova-compute[74669]: No targets found.
Nov 08 17:01:26 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:01:26 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:01:26 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7769626-1baf-40ea-9244-09a188a75b82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1b2d27-6484-4f73-9412-df737c37ea90]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 17:01:26 user nova-compute[74669]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)
Nov 08 17:01:26 user nova-compute[74669]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 (non-flash)
Nov 08 17:01:26 user nova-compute[74669]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 (non-flash)
Nov 08 17:01:26 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 (non-flash)
Nov 08 17:01:26 user nova-compute[74669]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)
Nov 08 17:01:26 user nova-compute[74669]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 (non-flash)
Nov 08 17:01:26 user nova-compute[74669]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 (non-flash)
Nov 08 17:01:26 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd984690790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263'): ({'sdb'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Removing single pathed devices sdb {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4dd629-ac39-4c66-9aad-edb2183acf73]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[099e1269-ae0c-4b40-bcf0-18b6cf2c59db]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Flushing IO for device /dev/sdb {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e35d6a6-8751-4b7c-9ed4-a3dd1636dc4e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ab7b45-e0bd-498a-8386-6a25b7f6f307]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b291b3-4677-4265-8a6a-2bedea97fcd6]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b623427-a845-43b2-be50-8a4506929f7d]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260]
Nov 08 17:01:26 user nova-compute[74669]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263, portal: 172.16.0.220,3260] successful.
Nov 08 17:01:26 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1176f50-24fe-4e13-aa36-02955f521263 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1df593-7c82-42cb-a9de-a9791c676498]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] <== disconnect_volume: return (408ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:01:26 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Deleting instance files /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789_del
Nov 08 17:01:26 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Deletion of /opt/stack/data/nova/instances/b26dbeeb-b629-414d-bcca-cdde6c207789_del complete
Nov 08 17:01:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: INFO nova.compute.manager [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Took 1.89 seconds to destroy the instance on the hypervisor.
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Instance destroyed successfully.
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.objects.instance [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lazy-loading 'resources' on Instance uuid 0ce9072b-e003-4921-83bc-8f3449c09e14 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1773552603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1773552603',id=14,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoDrsOl1L2B2ygRhUPagQG+XN+24BbCzGghObLHCJCNkchqh4x0gnszO53qEkfFR5YFjsCnFLWZGnFmn91XOUwSylaYJe/NOr19YHyyPXKCT8yLEBwZOglZlBB1tEulww==',key_name='tempest-keypair-277180508',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:59:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44e866b4d7344b81b53cf1e4484faf29',ramdisk_id='',reservation_id='r-xogjbe7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1066904042',owner_user_name='tempest-TaggedBootDevicesTest-1066904042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:59:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='756930c1b18340a9a0cfe3f95d9b89c6',uuid=0ce9072b-e003-4921-83bc-8f3449c09e14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "314df0da-c133-46af-bdc1-a317e71ca069", "address": "fa:16:3e:c4:c1:5b", "network": {"id": "ee33eeed-0f37-4f56-aa18-e6c986e10eb7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-786579928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314df0da-c1", "ovs_interfaceid": "314df0da-c133-46af-bdc1-a317e71ca069", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converting VIF {"id": "314df0da-c133-46af-bdc1-a317e71ca069", "address": "fa:16:3e:c4:c1:5b", "network": {"id": "ee33eeed-0f37-4f56-aa18-e6c986e10eb7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-786579928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314df0da-c1", "ovs_interfaceid": "314df0da-c133-46af-bdc1-a317e71ca069", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:c1:5b,bridge_name='br-int',has_traffic_filtering=True,id=314df0da-c133-46af-bdc1-a317e71ca069,network=Network(ee33eeed-0f37-4f56-aa18-e6c986e10eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap314df0da-c1') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG os_vif [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:c1:5b,bridge_name='br-int',has_traffic_filtering=True,id=314df0da-c133-46af-bdc1-a317e71ca069,network=Network(ee33eeed-0f37-4f56-aa18-e6c986e10eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap314df0da-c1') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap314df0da-c1, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5081f88c-624c-46ed-99b4-cf62aa8c6888) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: INFO os_vif [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:c1:5b,bridge_name='br-int',has_traffic_filtering=True,id=314df0da-c133-46af-bdc1-a317e71ca069,network=Network(ee33eeed-0f37-4f56-aa18-e6c986e10eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap314df0da-c1')
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1773552603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1773552603',id=14,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoDrsOl1L2B2ygRhUPagQG+XN+24BbCzGghObLHCJCNkchqh4x0gnszO53qEkfFR5YFjsCnFLWZGnFmn91XOUwSylaYJe/NOr19YHyyPXKCT8yLEBwZOglZlBB1tEulww==',key_name='tempest-keypair-277180508',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:59:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44e866b4d7344b81b53cf1e4484faf29',ramdisk_id='',reservation_id='r-xogjbe7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1066904042',owner_user_name='tempest-TaggedBootDevicesTest-1066904042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:59:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='756930c1b18340a9a0cfe3f95d9b89c6',uuid=0ce9072b-e003-4921-83bc-8f3449c09e14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98dcc41a-801d-4934-8069-75d814493170", "address": "fa:16:3e:4a:0a:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98dcc41a-80", "ovs_interfaceid": "98dcc41a-801d-4934-8069-75d814493170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converting VIF {"id": "98dcc41a-801d-4934-8069-75d814493170", "address": "fa:16:3e:4a:0a:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98dcc41a-80", "ovs_interfaceid": "98dcc41a-801d-4934-8069-75d814493170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:0a:4b,bridge_name='br-int',has_traffic_filtering=True,id=98dcc41a-801d-4934-8069-75d814493170,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98dcc41a-80') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG os_vif [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:0a:4b,bridge_name='br-int',has_traffic_filtering=True,id=98dcc41a-801d-4934-8069-75d814493170,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98dcc41a-80') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98dcc41a-80, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8702ddbd-2a3e-4515-bf3a-8b6060104715) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: INFO os_vif [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:0a:4b,bridge_name='br-int',has_traffic_filtering=True,id=98dcc41a-801d-4934-8069-75d814493170,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98dcc41a-80')
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1773552603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1773552603',id=14,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoDrsOl1L2B2ygRhUPagQG+XN+24BbCzGghObLHCJCNkchqh4x0gnszO53qEkfFR5YFjsCnFLWZGnFmn91XOUwSylaYJe/NOr19YHyyPXKCT8yLEBwZOglZlBB1tEulww==',key_name='tempest-keypair-277180508',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:59:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44e866b4d7344b81b53cf1e4484faf29',ramdisk_id='',reservation_id='r-xogjbe7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1066904042',owner_user_name='tempest-TaggedBootDevicesTest-1066904042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:59:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='756930c1b18340a9a0cfe3f95d9b89c6',uuid=0ce9072b-e003-4921-83bc-8f3449c09e14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "address": "fa:16:3e:9d:06:2c", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3416a767-03", "ovs_interfaceid": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converting VIF {"id": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "address": "fa:16:3e:9d:06:2c", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3416a767-03", "ovs_interfaceid": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:06:2c,bridge_name='br-int',has_traffic_filtering=True,id=3416a767-03a6-4f75-8b8b-979eed5ddabe,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3416a767-03') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG os_vif [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:06:2c,bridge_name='br-int',has_traffic_filtering=True,id=3416a767-03a6-4f75-8b8b-979eed5ddabe,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3416a767-03') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3416a767-03, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29e4cc83-7e3b-4f0c-9cfd-85b8db8e57a6) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: INFO os_vif [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:06:2c,bridge_name='br-int',has_traffic_filtering=True,id=3416a767-03a6-4f75-8b8b-979eed5ddabe,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3416a767-03')
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1773552603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1773552603',id=14,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoDrsOl1L2B2ygRhUPagQG+XN+24BbCzGghObLHCJCNkchqh4x0gnszO53qEkfFR5YFjsCnFLWZGnFmn91XOUwSylaYJe/NOr19YHyyPXKCT8yLEBwZOglZlBB1tEulww==',key_name='tempest-keypair-277180508',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:59:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44e866b4d7344b81b53cf1e4484faf29',ramdisk_id='',reservation_id='r-xogjbe7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1066904042',owner_user_name='tempest-TaggedBootDevicesTest-1066904042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:59:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='756930c1b18340a9a0cfe3f95d9b89c6',uuid=0ce9072b-e003-4921-83bc-8f3449c09e14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "address": "fa:16:3e:a4:bd:59", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82aa3c9f-78", "ovs_interfaceid": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converting VIF {"id": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "address": "fa:16:3e:a4:bd:59", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82aa3c9f-78", "ovs_interfaceid": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:bd:59,bridge_name='br-int',has_traffic_filtering=True,id=82aa3c9f-7823-4948-9496-449cb8e12f0b,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82aa3c9f-78') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG os_vif [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:bd:59,bridge_name='br-int',has_traffic_filtering=True,id=82aa3c9f-7823-4948-9496-449cb8e12f0b,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82aa3c9f-78') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82aa3c9f-78, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8becaf68-1221-42b1-a817-62078b9b272c) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-4b6ee232-eb81-4870-96aa-36646a94fe87 req-908963be-112a-40d0-872d-dc704f5f610f service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received event network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4b6ee232-eb81-4870-96aa-36646a94fe87 req-908963be-112a-40d0-872d-dc704f5f610f service nova] Acquiring lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4b6ee232-eb81-4870-96aa-36646a94fe87 req-908963be-112a-40d0-872d-dc704f5f610f service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4b6ee232-eb81-4870-96aa-36646a94fe87 req-908963be-112a-40d0-872d-dc704f5f610f service nova] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-4b6ee232-eb81-4870-96aa-36646a94fe87 req-908963be-112a-40d0-872d-dc704f5f610f service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] No waiting events found dispatching network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:27 user nova-compute[74669]: WARNING nova.compute.manager [req-4b6ee232-eb81-4870-96aa-36646a94fe87 req-908963be-112a-40d0-872d-dc704f5f610f service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received unexpected event network-vif-plugged-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 for instance with vm_state active and task_state deleting.
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: INFO os_vif [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:bd:59,bridge_name='br-int',has_traffic_filtering=True,id=82aa3c9f-7823-4948-9496-449cb8e12f0b,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82aa3c9f-78')
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1773552603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1773552603',id=14,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoDrsOl1L2B2ygRhUPagQG+XN+24BbCzGghObLHCJCNkchqh4x0gnszO53qEkfFR5YFjsCnFLWZGnFmn91XOUwSylaYJe/NOr19YHyyPXKCT8yLEBwZOglZlBB1tEulww==',key_name='tempest-keypair-277180508',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:59:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44e866b4d7344b81b53cf1e4484faf29',ramdisk_id='',reservation_id='r-xogjbe7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1066904042',owner_user_name='tempest-TaggedBootDevicesTest-1066904042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:59:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='756930c1b18340a9a0cfe3f95d9b89c6',uuid=0ce9072b-e003-4921-83bc-8f3449c09e14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "address": "fa:16:3e:c3:25:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dac6ca-fd", "ovs_interfaceid": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converting VIF {"id": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "address": "fa:16:3e:c3:25:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dac6ca-fd", "ovs_interfaceid": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:25:4b,bridge_name='br-int',has_traffic_filtering=True,id=f1dac6ca-fd45-42d7-9f01-32891331b7ba,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1dac6ca-fd') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG os_vif [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:25:4b,bridge_name='br-int',has_traffic_filtering=True,id=f1dac6ca-fd45-42d7-9f01-32891331b7ba,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1dac6ca-fd') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1dac6ca-fd, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22fd76ae-1487-407a-b183-db3ccc59fc35) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: INFO os_vif [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:25:4b,bridge_name='br-int',has_traffic_filtering=True,id=f1dac6ca-fd45-42d7-9f01-32891331b7ba,network=Network(d4c99e31-8ef5-46b0-a201-4bee1a15e870),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1dac6ca-fd')
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1773552603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1773552603',id=14,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoDrsOl1L2B2ygRhUPagQG+XN+24BbCzGghObLHCJCNkchqh4x0gnszO53qEkfFR5YFjsCnFLWZGnFmn91XOUwSylaYJe/NOr19YHyyPXKCT8yLEBwZOglZlBB1tEulww==',key_name='tempest-keypair-277180508',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:59:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44e866b4d7344b81b53cf1e4484faf29',ramdisk_id='',reservation_id='r-xogjbe7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1066904042',owner_user_name='tempest-TaggedBootDevicesTest-1066904042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:59:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='756930c1b18340a9a0cfe3f95d9b89c6',uuid=0ce9072b-e003-4921-83bc-8f3449c09e14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "address": "fa:16:3e:6a:5e:82", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4adfe0-b1", "ovs_interfaceid": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converting VIF {"id": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "address": "fa:16:3e:6a:5e:82", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e4adfe0-b1", "ovs_interfaceid": "1e4adfe0-b13d-49ae-8766-5e4dfe754427", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=1e4adfe0-b13d-49ae-8766-5e4dfe754427,network=Network(6b21de98-8e99-4cf6-8fb2-b2554c54c9c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e4adfe0-b1') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG os_vif [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=1e4adfe0-b13d-49ae-8766-5e4dfe754427,network=Network(6b21de98-8e99-4cf6-8fb2-b2554c54c9c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e4adfe0-b1') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e4adfe0-b1, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ad2b81f-2b0d-499e-8424-d4914d0a8ab0) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: INFO os_vif [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:5e:82,bridge_name='br-int',has_traffic_filtering=True,id=1e4adfe0-b13d-49ae-8766-5e4dfe754427,network=Network(6b21de98-8e99-4cf6-8fb2-b2554c54c9c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e4adfe0-b1')
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T16:57:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1773552603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1773552603',id=14,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoDrsOl1L2B2ygRhUPagQG+XN+24BbCzGghObLHCJCNkchqh4x0gnszO53qEkfFR5YFjsCnFLWZGnFmn91XOUwSylaYJe/NOr19YHyyPXKCT8yLEBwZOglZlBB1tEulww==',key_name='tempest-keypair-277180508',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:59:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44e866b4d7344b81b53cf1e4484faf29',ramdisk_id='',reservation_id='r-xogjbe7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1066904042',owner_user_name='tempest-TaggedBootDevicesTest-1066904042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:59:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='756930c1b18340a9a0cfe3f95d9b89c6',uuid=0ce9072b-e003-4921-83bc-8f3449c09e14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "898bcd3e-b90e-493b-904a-5f533757c60e", "address": "fa:16:3e:b3:e6:5a", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898bcd3e-b9", "ovs_interfaceid": "898bcd3e-b90e-493b-904a-5f533757c60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converting VIF {"id": "898bcd3e-b90e-493b-904a-5f533757c60e", "address": "fa:16:3e:b3:e6:5a", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898bcd3e-b9", "ovs_interfaceid": "898bcd3e-b90e-493b-904a-5f533757c60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:e6:5a,bridge_name='br-int',has_traffic_filtering=True,id=898bcd3e-b90e-493b-904a-5f533757c60e,network=Network(6b21de98-8e99-4cf6-8fb2-b2554c54c9c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898bcd3e-b9') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG os_vif [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:e6:5a,bridge_name='br-int',has_traffic_filtering=True,id=898bcd3e-b90e-493b-904a-5f533757c60e,network=Network(6b21de98-8e99-4cf6-8fb2-b2554c54c9c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898bcd3e-b9') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap898bcd3e-b9, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f2cd4a2-7228-4688-8ccd-96c150ca399e) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-plugged-314df0da-c133-46af-bdc1-a317e71ca069 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-plugged-314df0da-c133-46af-bdc1-a317e71ca069 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:27 user nova-compute[74669]: WARNING nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received unexpected event network-vif-plugged-314df0da-c133-46af-bdc1-a317e71ca069 for instance with vm_state active and task_state deleting.
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-unplugged-98dcc41a-801d-4934-8069-75d814493170 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-unplugged-98dcc41a-801d-4934-8069-75d814493170 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-unplugged-98dcc41a-801d-4934-8069-75d814493170 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-plugged-98dcc41a-801d-4934-8069-75d814493170 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-plugged-98dcc41a-801d-4934-8069-75d814493170 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:27 user nova-compute[74669]: WARNING nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received unexpected event network-vif-plugged-98dcc41a-801d-4934-8069-75d814493170 for instance with vm_state active and task_state deleting.
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-unplugged-3416a767-03a6-4f75-8b8b-979eed5ddabe {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-unplugged-3416a767-03a6-4f75-8b8b-979eed5ddabe {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-unplugged-3416a767-03a6-4f75-8b8b-979eed5ddabe for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-plugged-3416a767-03a6-4f75-8b8b-979eed5ddabe {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-plugged-3416a767-03a6-4f75-8b8b-979eed5ddabe {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:27 user nova-compute[74669]: WARNING nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received unexpected event network-vif-plugged-3416a767-03a6-4f75-8b8b-979eed5ddabe for instance with vm_state active and task_state deleting.
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-unplugged-82aa3c9f-7823-4948-9496-449cb8e12f0b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-unplugged-82aa3c9f-7823-4948-9496-449cb8e12f0b {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-unplugged-82aa3c9f-7823-4948-9496-449cb8e12f0b for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-plugged-82aa3c9f-7823-4948-9496-449cb8e12f0b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-plugged-82aa3c9f-7823-4948-9496-449cb8e12f0b {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:27 user nova-compute[74669]: WARNING nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received unexpected event network-vif-plugged-82aa3c9f-7823-4948-9496-449cb8e12f0b for instance with vm_state active and task_state deleting.
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-unplugged-f1dac6ca-fd45-42d7-9f01-32891331b7ba {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-unplugged-f1dac6ca-fd45-42d7-9f01-32891331b7ba {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-unplugged-f1dac6ca-fd45-42d7-9f01-32891331b7ba for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-plugged-f1dac6ca-fd45-42d7-9f01-32891331b7ba {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-plugged-f1dac6ca-fd45-42d7-9f01-32891331b7ba {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:27 user nova-compute[74669]: WARNING nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received unexpected event network-vif-plugged-f1dac6ca-fd45-42d7-9f01-32891331b7ba for instance with vm_state active and task_state deleting.
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-unplugged-898bcd3e-b90e-493b-904a-5f533757c60e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-unplugged-898bcd3e-b90e-493b-904a-5f533757c60e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-unplugged-898bcd3e-b90e-493b-904a-5f533757c60e for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-plugged-898bcd3e-b90e-493b-904a-5f533757c60e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-plugged-898bcd3e-b90e-493b-904a-5f533757c60e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:27 user nova-compute[74669]: WARNING nova.compute.manager [req-eaa01ec1-870f-4af2-add3-b90d98758429 req-5b12772c-0418-45b7-8864-cf6d3ff403b2 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received unexpected event network-vif-plugged-898bcd3e-b90e-493b-904a-5f533757c60e for instance with vm_state active and task_state deleting.
Nov 08 17:01:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:27 user nova-compute[74669]: INFO os_vif [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:e6:5a,bridge_name='br-int',has_traffic_filtering=True,id=898bcd3e-b90e-493b-904a-5f533757c60e,network=Network(6b21de98-8e99-4cf6-8fb2-b2554c54c9c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898bcd3e-b9')
Nov 08 17:01:27 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fLXFRugl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:01:27 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:01:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2f5ddb-c5ec-433e-8e50-67cdefd5abde]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:01:27 user nova-compute[74669]: No targets found.
Nov 08 17:01:27 user nova-compute[74669]: iSNS:
Nov 08 17:01:27 user nova-compute[74669]: No targets found.
Nov 08 17:01:27 user nova-compute[74669]: STATIC:
Nov 08 17:01:27 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55
Nov 08 17:01:27 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:01:27 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:01:27 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336
Nov 08 17:01:27 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:01:27 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:01:27 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5
Nov 08 17:01:27 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:01:27 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:01:27 user nova-compute[74669]: FIRMWARE:
Nov 08 17:01:27 user nova-compute[74669]: No targets found.
Nov 08 17:01:27 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:01:27 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:01:27 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9873683c-183d-4d3a-b5bf-56de26f48106]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d7df82-55b2-4830-aef6-936a36893227]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)
Nov 08 17:01:28 user nova-compute[74669]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 (non-flash)
Nov 08 17:01:28 user nova-compute[74669]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 (non-flash)
Nov 08 17:01:28 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)
Nov 08 17:01:28 user nova-compute[74669]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 (non-flash)
Nov 08 17:01:28 user nova-compute[74669]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 (non-flash)
Nov 08 17:01:28 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9a8258040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55'): ({'sde'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Removing single pathed devices sde {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d594c2d-9192-44db-934d-665716802ed7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd506c78-cb26-4219-a0b0-a6b5c9450a1c]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Flushing IO for device /dev/sde {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c23296-ebf6-4463-9068-ecb556df6c62]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62b2518-7da9-4ab0-82ac-2d75fb338910]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] SCSI volumes sde have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fb264d-4d06-4fe1-9d1b-8ac657480ffe]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4e6007-c696-46fc-9b25-d9fd694b38fa]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55, portal: 172.16.0.220,3260]
Nov 08 17:01:28 user nova-compute[74669]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55, portal: 172.16.0.220,3260] successful.
Nov 08 17:01:28 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3270c5a2-1029-4533-9b41-5c9fb2b0ba55 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[026eebab-a4f2-4384-aa5e-06cc458e801e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] <== disconnect_volume: return (299ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WuEbvZjM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:01:28 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61cb36c-8bd6-4554-bbcc-9c93cf1df4cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:01:28 user nova-compute[74669]: No targets found.
Nov 08 17:01:28 user nova-compute[74669]: iSNS:
Nov 08 17:01:28 user nova-compute[74669]: No targets found.
Nov 08 17:01:28 user nova-compute[74669]: STATIC:
Nov 08 17:01:28 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336
Nov 08 17:01:28 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:01:28 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:01:28 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5
Nov 08 17:01:28 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:01:28 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:01:28 user nova-compute[74669]: FIRMWARE:
Nov 08 17:01:28 user nova-compute[74669]: No targets found.
Nov 08 17:01:28 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:01:28 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:01:28 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1691713a-c97b-4052-a167-61818c4c3d26]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b5046a-5523-46a3-85a6-ffb6dbc1f4e5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)
Nov 08 17:01:28 user nova-compute[74669]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 (non-flash)
Nov 08 17:01:28 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 (non-flash)
Nov 08 17:01:28 user nova-compute[74669]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 (non-flash)
Nov 08 17:01:28 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9a8258040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5'): ({'sdd'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Removing single pathed devices sdd {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[27151a9c-b1fe-4213-9bcc-8ebeecb98ea9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6e8a7d-755b-41f0-a67a-d7d05fe6cbbd]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Flushing IO for device /dev/sdd {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c75d33-128a-4925-93fe-d36ba4ae75fd]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2df236-8e7f-4724-8ba8-3dcac60f82b6]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] SCSI volumes sdd have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a17c5d-7f78-4aa8-930b-1093ecf67f98]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd3a273-e3eb-4112-8431-d50a0a3588fa]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5, portal: 172.16.0.220,3260]
Nov 08 17:01:28 user nova-compute[74669]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5, portal: 172.16.0.220,3260] successful.
Nov 08 17:01:28 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393d7383-44a3-4a2f-87f2-b2eb33f3acf5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b195b4-af4e-46a0-b51d-f4eca1b5a003]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] <== disconnect_volume: return (298ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLREoOtM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:01:28 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85119e4-b923-4b6a-af83-90b4e1df71e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:01:28 user nova-compute[74669]: No targets found.
Nov 08 17:01:28 user nova-compute[74669]: iSNS:
Nov 08 17:01:28 user nova-compute[74669]: No targets found.
Nov 08 17:01:28 user nova-compute[74669]: STATIC:
Nov 08 17:01:28 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336
Nov 08 17:01:28 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:01:28 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:01:28 user nova-compute[74669]: FIRMWARE:
Nov 08 17:01:28 user nova-compute[74669]: No targets found.
Nov 08 17:01:28 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:01:28 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:01:28 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b959364-a451-499a-8a39-2b63edf3e1f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15cff8a-15c1-4170-a2e2-dfa43f11aefd]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 (non-flash)
Nov 08 17:01:28 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 (non-flash)
Nov 08 17:01:28 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9a8698b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336'): ({'sdf'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Removing single pathed devices sdf {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:01:28 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Took 1.61 seconds to deallocate network for instance.
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[af10f7d4-c25b-4d70-a2c2-22721c8a1b5b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fc50c7-d200-429b-9bb6-bc57732df4b0]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Flushing IO for device /dev/sdf {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef43e4c-e8c1-4ac5-9d93-ee1a761e2b7b]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-c6edd186-03e6-4ad8-9cdf-064e69b169b2 req-6e5b33b2-0f93-43ef-87dc-65a45e53966e service nova] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Received event network-vif-deleted-47c9314f-4ea9-49c3-9b34-2fb94cc1eac4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[102bf67e-2bdb-437f-99c3-65f6b15269ba]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] SCSI volumes sdf have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e3dd8f-98d2-4b3f-b177-bd480feaecbe]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc0c421-6f70-42bd-886f-dc16ecdd1228]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336, portal: 172.16.0.220,3260]
Nov 08 17:01:28 user nova-compute[74669]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336, portal: 172.16.0.220,3260] successful.
Nov 08 17:01:28 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf4034c4-569c-410c-b394-7d8196c17336 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b364c2-f254-4ed4-86d7-85f9e3843a72]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] <== disconnect_volume: return (318ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:01:28 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Deleting instance files /opt/stack/data/nova/instances/0ce9072b-e003-4921-83bc-8f3449c09e14_del
Nov 08 17:01:28 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Deletion of /opt/stack/data/nova/instances/0ce9072b-e003-4921-83bc-8f3449c09e14_del complete
Nov 08 17:01:28 user nova-compute[74669]: INFO nova.compute.manager [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Took 3.43 seconds to destroy the instance on the hypervisor.
Nov 08 17:01:28 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:01:28 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:01:29 user nova-compute[74669]: INFO nova.compute.manager [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] [instance: b26dbeeb-b629-414d-bcca-cdde6c207789] Took 0.94 seconds to detach 1 volumes for instance.
Nov 08 17:01:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-b7843003-2d2c-4c97-b514-f2b217ad3c17 req-2b1abd94-a89f-4c98-b3dd-9af02f57a891 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-unplugged-1e4adfe0-b13d-49ae-8766-5e4dfe754427 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b7843003-2d2c-4c97-b514-f2b217ad3c17 req-2b1abd94-a89f-4c98-b3dd-9af02f57a891 service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b7843003-2d2c-4c97-b514-f2b217ad3c17 req-2b1abd94-a89f-4c98-b3dd-9af02f57a891 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b7843003-2d2c-4c97-b514-f2b217ad3c17 req-2b1abd94-a89f-4c98-b3dd-9af02f57a891 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-b7843003-2d2c-4c97-b514-f2b217ad3c17 req-2b1abd94-a89f-4c98-b3dd-9af02f57a891 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-unplugged-1e4adfe0-b13d-49ae-8766-5e4dfe754427 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-b7843003-2d2c-4c97-b514-f2b217ad3c17 req-2b1abd94-a89f-4c98-b3dd-9af02f57a891 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-unplugged-1e4adfe0-b13d-49ae-8766-5e4dfe754427 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:01:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-b7843003-2d2c-4c97-b514-f2b217ad3c17 req-2b1abd94-a89f-4c98-b3dd-9af02f57a891 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-plugged-1e4adfe0-b13d-49ae-8766-5e4dfe754427 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b7843003-2d2c-4c97-b514-f2b217ad3c17 req-2b1abd94-a89f-4c98-b3dd-9af02f57a891 service nova] Acquiring lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b7843003-2d2c-4c97-b514-f2b217ad3c17 req-2b1abd94-a89f-4c98-b3dd-9af02f57a891 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b7843003-2d2c-4c97-b514-f2b217ad3c17 req-2b1abd94-a89f-4c98-b3dd-9af02f57a891 service nova] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-b7843003-2d2c-4c97-b514-f2b217ad3c17 req-2b1abd94-a89f-4c98-b3dd-9af02f57a891 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] No waiting events found dispatching network-vif-plugged-1e4adfe0-b13d-49ae-8766-5e4dfe754427 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:29 user nova-compute[74669]: WARNING nova.compute.manager [req-b7843003-2d2c-4c97-b514-f2b217ad3c17 req-2b1abd94-a89f-4c98-b3dd-9af02f57a891 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received unexpected event network-vif-plugged-1e4adfe0-b13d-49ae-8766-5e4dfe754427 for instance with vm_state active and task_state deleting.
Nov 08 17:01:29 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:01:30 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:01:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:30 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Deleted allocations for instance b26dbeeb-b629-414d-bcca-cdde6c207789
Nov 08 17:01:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5e817f1a-c164-4405-8c2d-78f1ff9e339f tempest-ServerActionsTestOtherB-839528249 tempest-ServerActionsTestOtherB-839528249-project-member] Lock "b26dbeeb-b629-414d-bcca-cdde6c207789" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.091s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:31 user nova-compute[74669]: DEBUG nova.compute.manager [req-2db85e1f-7f1f-418b-879e-ddc787837817 req-ff0b5958-1387-48e1-a053-8d657ff62658 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-deleted-1e4adfe0-b13d-49ae-8766-5e4dfe754427 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:31 user nova-compute[74669]: INFO nova.compute.manager [req-2db85e1f-7f1f-418b-879e-ddc787837817 req-ff0b5958-1387-48e1-a053-8d657ff62658 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Neutron deleted interface 1e4adfe0-b13d-49ae-8766-5e4dfe754427; detaching it from the instance and deleting it from the info cache
Nov 08 17:01:31 user nova-compute[74669]: DEBUG nova.network.neutron [req-2db85e1f-7f1f-418b-879e-ddc787837817 req-ff0b5958-1387-48e1-a053-8d657ff62658 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Updating instance_info_cache with network_info: [{"id": "314df0da-c133-46af-bdc1-a317e71ca069", "address": "fa:16:3e:c4:c1:5b", "network": {"id": "ee33eeed-0f37-4f56-aa18-e6c986e10eb7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-786579928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap314df0da-c1", "ovs_interfaceid": "314df0da-c133-46af-bdc1-a317e71ca069", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98dcc41a-801d-4934-8069-75d814493170", "address": "fa:16:3e:4a:0a:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98dcc41a-80", "ovs_interfaceid": "98dcc41a-801d-4934-8069-75d814493170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "address": "fa:16:3e:9d:06:2c", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3416a767-03", "ovs_interfaceid": "3416a767-03a6-4f75-8b8b-979eed5ddabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "address": "fa:16:3e:a4:bd:59", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82aa3c9f-78", "ovs_interfaceid": "82aa3c9f-7823-4948-9496-449cb8e12f0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "address": "fa:16:3e:c3:25:4b", "network": {"id": "d4c99e31-8ef5-46b0-a201-4bee1a15e870", "bridge": "br-int", "label": "tempest-device-tagging-net1-1462938959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1dac6ca-fd", "ovs_interfaceid": "f1dac6ca-fd45-42d7-9f01-32891331b7ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "898bcd3e-b90e-493b-904a-5f533757c60e", "address": "fa:16:3e:b3:e6:5a", "network": {"id": "6b21de98-8e99-4cf6-8fb2-b2554c54c9c9", "bridge": "br-int", "label": "tempest-device-tagging-net2-1126423314", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44e866b4d7344b81b53cf1e4484faf29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898bcd3e-b9", "ovs_interfaceid": "898bcd3e-b90e-493b-904a-5f533757c60e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:01:31 user nova-compute[74669]: DEBUG nova.compute.manager [req-2db85e1f-7f1f-418b-879e-ddc787837817 req-ff0b5958-1387-48e1-a053-8d657ff62658 service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Detach interface failed, port_id=1e4adfe0-b13d-49ae-8766-5e4dfe754427, reason: Instance 0ce9072b-e003-4921-83bc-8f3449c09e14 could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 17:01:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:33 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:01:33 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Took 4.25 seconds to deallocate network for instance.
Nov 08 17:01:33 user nova-compute[74669]: DEBUG nova.compute.manager [req-96414a9c-9236-4687-b5cf-414ace081388 req-54f5ea6a-4440-4cd6-ab54-eff841d18aac service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-deleted-f1dac6ca-fd45-42d7-9f01-32891331b7ba {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:33 user nova-compute[74669]: DEBUG nova.compute.manager [req-96414a9c-9236-4687-b5cf-414ace081388 req-54f5ea6a-4440-4cd6-ab54-eff841d18aac service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-deleted-314df0da-c133-46af-bdc1-a317e71ca069 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:33 user nova-compute[74669]: DEBUG nova.compute.manager [req-96414a9c-9236-4687-b5cf-414ace081388 req-54f5ea6a-4440-4cd6-ab54-eff841d18aac service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-deleted-898bcd3e-b90e-493b-904a-5f533757c60e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:33 user nova-compute[74669]: DEBUG nova.compute.manager [req-96414a9c-9236-4687-b5cf-414ace081388 req-54f5ea6a-4440-4cd6-ab54-eff841d18aac service nova] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Received event network-vif-deleted-82aa3c9f-7823-4948-9496-449cb8e12f0b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "ee7af599-1f24-4828-913f-5ba3687619df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "ee7af599-1f24-4828-913f-5ba3687619df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:01:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:01:38 user nova-compute[74669]: INFO nova.compute.claims [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Claim successful on node user
Nov 08 17:01:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:38 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:01:38 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:01:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:01:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:01:38 user nova-compute[74669]: DEBUG nova.network.neutron [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:01:38 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:01:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:01:38 user nova-compute[74669]: DEBUG nova.policy [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e118c178ece2492bb2d975643c405196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b82c0c2cd480f96d155adf4f6de4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:01:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:01:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:01:38 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Creating image(s)
Nov 08 17:01:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "/opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "/opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.092s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.207s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.179s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk 1073741824" returned: 0 in 0.067s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:39 user nova-compute[74669]: DEBUG nova.network.neutron [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Successfully created port: ec94ef8c-0c4b-4578-99cd-a00aab4aa569 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:01:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.207s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:39 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:01:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:39 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Cannot resize image /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:01:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:01:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Ensure instance console log exists: /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:01:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.network.neutron [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Successfully updated port: ec94ef8c-0c4b-4578-99cd-a00aab4aa569 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "refresh_cache-ee7af599-1f24-4828-913f-5ba3687619df" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquired lock "refresh_cache-ee7af599-1f24-4828-913f-5ba3687619df" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.network.neutron [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-10e91a43-4164-4ca2-befc-f7ef5ef134f3 req-71aedaa1-cf48-4dd3-8b5f-4fa0808404d7 service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Received event network-changed-ec94ef8c-0c4b-4578-99cd-a00aab4aa569 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-10e91a43-4164-4ca2-befc-f7ef5ef134f3 req-71aedaa1-cf48-4dd3-8b5f-4fa0808404d7 service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Refreshing instance network info cache due to event network-changed-ec94ef8c-0c4b-4578-99cd-a00aab4aa569. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-10e91a43-4164-4ca2-befc-f7ef5ef134f3 req-71aedaa1-cf48-4dd3-8b5f-4fa0808404d7 service nova] Acquiring lock "refresh_cache-ee7af599-1f24-4828-913f-5ba3687619df" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.network.neutron [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.network.neutron [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Updating instance_info_cache with network_info: [{"id": "ec94ef8c-0c4b-4578-99cd-a00aab4aa569", "address": "fa:16:3e:4e:de:98", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec94ef8c-0c", "ovs_interfaceid": "ec94ef8c-0c4b-4578-99cd-a00aab4aa569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Releasing lock "refresh_cache-ee7af599-1f24-4828-913f-5ba3687619df" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.compute.manager [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Instance network_info: |[{"id": "ec94ef8c-0c4b-4578-99cd-a00aab4aa569", "address": "fa:16:3e:4e:de:98", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec94ef8c-0c", "ovs_interfaceid": "ec94ef8c-0c4b-4578-99cd-a00aab4aa569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-10e91a43-4164-4ca2-befc-f7ef5ef134f3 req-71aedaa1-cf48-4dd3-8b5f-4fa0808404d7 service nova] Acquired lock "refresh_cache-ee7af599-1f24-4828-913f-5ba3687619df" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.network.neutron [req-10e91a43-4164-4ca2-befc-f7ef5ef134f3 req-71aedaa1-cf48-4dd3-8b5f-4fa0808404d7 service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Refreshing network info cache for port ec94ef8c-0c4b-4578-99cd-a00aab4aa569 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Start _get_guest_xml network_info=[{"id": "ec94ef8c-0c4b-4578-99cd-a00aab4aa569", "address": "fa:16:3e:4e:de:98", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec94ef8c-0c", "ovs_interfaceid": "ec94ef8c-0c4b-4578-99cd-a00aab4aa569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:01:40 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:01:40 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:01:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1978130736',display_name='tempest-tempest.common.compute-instance-1978130736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1978130736',id=22,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3A71/NbWcwpTJz22ESjYCtiVwC2rdyy/Yutt8aAXWNb+I+QadzUiCPwuOVtgyI1vm3q9D1X3xnbz+4EixM+d9MN7xlEr6K2tBXLrgiIndpb1q+Dq8t7EKp9UoVLLBA1w==',key_name='tempest-keypair-726294899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='766b82c0c2cd480f96d155adf4f6de4c',ramdisk_id='',reservation_id='r-tvnwhmql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-23582724',owner_user_name='tempest-ServerActionsTestOtherA-23582724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:01:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e118c178ece2492bb2d975643c405196',uuid=ee7af599-1f24-4828-913f-5ba3687619df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec94ef8c-0c4b-4578-99cd-a00aab4aa569", "address": "fa:16:3e:4e:de:98", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec94ef8c-0c", "ovs_interfaceid": "ec94ef8c-0c4b-4578-99cd-a00aab4aa569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converting VIF {"id": "ec94ef8c-0c4b-4578-99cd-a00aab4aa569", "address": "fa:16:3e:4e:de:98", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec94ef8c-0c", "ovs_interfaceid": "ec94ef8c-0c4b-4578-99cd-a00aab4aa569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:de:98,bridge_name='br-int',has_traffic_filtering=True,id=ec94ef8c-0c4b-4578-99cd-a00aab4aa569,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec94ef8c-0c') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.objects.instance [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lazy-loading 'pci_devices' on Instance uuid ee7af599-1f24-4828-913f-5ba3687619df {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:01:40 user nova-compute[74669]:   <uuid>ee7af599-1f24-4828-913f-5ba3687619df</uuid>
Nov 08 17:01:40 user nova-compute[74669]:   <name>instance-00000016</name>
Nov 08 17:01:40 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:01:40 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:01:40 user nova-compute[74669]:   <metadata>
Nov 08 17:01:40 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:01:40 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:01:40 user nova-compute[74669]:       <nova:name>tempest-tempest.common.compute-instance-1978130736</nova:name>
Nov 08 17:01:40 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:01:40</nova:creationTime>
Nov 08 17:01:40 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:01:40 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:01:40 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:01:40 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:01:40 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:01:40 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:01:40 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:01:40 user nova-compute[74669]:       <nova:owner>
Nov 08 17:01:40 user nova-compute[74669]:         <nova:user uuid="e118c178ece2492bb2d975643c405196">tempest-ServerActionsTestOtherA-23582724-project-member</nova:user>
Nov 08 17:01:40 user nova-compute[74669]:         <nova:project uuid="766b82c0c2cd480f96d155adf4f6de4c">tempest-ServerActionsTestOtherA-23582724</nova:project>
Nov 08 17:01:40 user nova-compute[74669]:       </nova:owner>
Nov 08 17:01:40 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:01:40 user nova-compute[74669]:       <nova:ports>
Nov 08 17:01:40 user nova-compute[74669]:         <nova:port uuid="ec94ef8c-0c4b-4578-99cd-a00aab4aa569">
Nov 08 17:01:40 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 17:01:40 user nova-compute[74669]:         </nova:port>
Nov 08 17:01:40 user nova-compute[74669]:       </nova:ports>
Nov 08 17:01:40 user nova-compute[74669]:     </nova:instance>
Nov 08 17:01:40 user nova-compute[74669]:   </metadata>
Nov 08 17:01:40 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:01:40 user nova-compute[74669]:     <system>
Nov 08 17:01:40 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:01:40 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:01:40 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:01:40 user nova-compute[74669]:       <entry name="serial">ee7af599-1f24-4828-913f-5ba3687619df</entry>
Nov 08 17:01:40 user nova-compute[74669]:       <entry name="uuid">ee7af599-1f24-4828-913f-5ba3687619df</entry>
Nov 08 17:01:40 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:01:40 user nova-compute[74669]:     </system>
Nov 08 17:01:40 user nova-compute[74669]:   </sysinfo>
Nov 08 17:01:40 user nova-compute[74669]:   <os>
Nov 08 17:01:40 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:01:40 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:01:40 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:01:40 user nova-compute[74669]:   </os>
Nov 08 17:01:40 user nova-compute[74669]:   <features>
Nov 08 17:01:40 user nova-compute[74669]:     <acpi/>
Nov 08 17:01:40 user nova-compute[74669]:     <apic/>
Nov 08 17:01:40 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:01:40 user nova-compute[74669]:   </features>
Nov 08 17:01:40 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:01:40 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:01:40 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:01:40 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:01:40 user nova-compute[74669]:   </clock>
Nov 08 17:01:40 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:01:40 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:01:40 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:01:40 user nova-compute[74669]:   </cpu>
Nov 08 17:01:40 user nova-compute[74669]:   <devices>
Nov 08 17:01:40 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:01:40 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:01:40 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk"/>
Nov 08 17:01:40 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:01:40 user nova-compute[74669]:     </disk>
Nov 08 17:01:40 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:01:40 user nova-compute[74669]:       <mac address="fa:16:3e:4e:de:98"/>
Nov 08 17:01:40 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:01:40 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:01:40 user nova-compute[74669]:       <target dev="tapec94ef8c-0c"/>
Nov 08 17:01:40 user nova-compute[74669]:     </interface>
Nov 08 17:01:40 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:01:40 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/console.log" append="off"/>
Nov 08 17:01:40 user nova-compute[74669]:     </serial>
Nov 08 17:01:40 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:01:40 user nova-compute[74669]:     <video>
Nov 08 17:01:40 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:01:40 user nova-compute[74669]:     </video>
Nov 08 17:01:40 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:01:40 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:01:40 user nova-compute[74669]:     </rng>
Nov 08 17:01:40 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:01:40 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:01:40 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:01:40 user nova-compute[74669]:     </memballoon>
Nov 08 17:01:40 user nova-compute[74669]:   </devices>
Nov 08 17:01:40 user nova-compute[74669]: </domain>
Nov 08 17:01:40 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:01:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1978130736',display_name='tempest-tempest.common.compute-instance-1978130736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1978130736',id=22,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3A71/NbWcwpTJz22ESjYCtiVwC2rdyy/Yutt8aAXWNb+I+QadzUiCPwuOVtgyI1vm3q9D1X3xnbz+4EixM+d9MN7xlEr6K2tBXLrgiIndpb1q+Dq8t7EKp9UoVLLBA1w==',key_name='tempest-keypair-726294899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='766b82c0c2cd480f96d155adf4f6de4c',ramdisk_id='',reservation_id='r-tvnwhmql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-23582724',owner_user_name='tempest-ServerActionsTestOtherA-23582724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:01:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e118c178ece2492bb2d975643c405196',uuid=ee7af599-1f24-4828-913f-5ba3687619df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec94ef8c-0c4b-4578-99cd-a00aab4aa569", "address": "fa:16:3e:4e:de:98", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec94ef8c-0c", "ovs_interfaceid": "ec94ef8c-0c4b-4578-99cd-a00aab4aa569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converting VIF {"id": "ec94ef8c-0c4b-4578-99cd-a00aab4aa569", "address": "fa:16:3e:4e:de:98", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec94ef8c-0c", "ovs_interfaceid": "ec94ef8c-0c4b-4578-99cd-a00aab4aa569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:de:98,bridge_name='br-int',has_traffic_filtering=True,id=ec94ef8c-0c4b-4578-99cd-a00aab4aa569,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec94ef8c-0c') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG os_vif [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:de:98,bridge_name='br-int',has_traffic_filtering=True,id=ec94ef8c-0c4b-4578-99cd-a00aab4aa569,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec94ef8c-0c') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b4f318f-bed6-56d3-8574-c295d5149a90', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec94ef8c-0c, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec94ef8c-0c, col_values=(('qos', UUID('2ea3dc9e-ec96-4ab1-b900-2dbe795f48d1')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec94ef8c-0c, col_values=(('external_ids', {'iface-id': 'ec94ef8c-0c4b-4578-99cd-a00aab4aa569', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:de:98', 'vm-uuid': 'ee7af599-1f24-4828-913f-5ba3687619df'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:40 user nova-compute[74669]: INFO os_vif [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:de:98,bridge_name='br-int',has_traffic_filtering=True,id=ec94ef8c-0c4b-4578-99cd-a00aab4aa569,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec94ef8c-0c')
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] No VIF found with MAC fa:16:3e:4e:de:98, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.network.neutron [req-10e91a43-4164-4ca2-befc-f7ef5ef134f3 req-71aedaa1-cf48-4dd3-8b5f-4fa0808404d7 service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Updated VIF entry in instance network info cache for port ec94ef8c-0c4b-4578-99cd-a00aab4aa569. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG nova.network.neutron [req-10e91a43-4164-4ca2-befc-f7ef5ef134f3 req-71aedaa1-cf48-4dd3-8b5f-4fa0808404d7 service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Updating instance_info_cache with network_info: [{"id": "ec94ef8c-0c4b-4578-99cd-a00aab4aa569", "address": "fa:16:3e:4e:de:98", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec94ef8c-0c", "ovs_interfaceid": "ec94ef8c-0c4b-4578-99cd-a00aab4aa569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:01:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-10e91a43-4164-4ca2-befc-f7ef5ef134f3 req-71aedaa1-cf48-4dd3-8b5f-4fa0808404d7 service nova] Releasing lock "refresh_cache-ee7af599-1f24-4828-913f-5ba3687619df" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:01:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-2367c001-ea16-454a-97e7-d09ab6cb4246 req-44403bec-fdd2-4293-8494-8f0abe3dc20a service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Received event network-vif-plugged-ec94ef8c-0c4b-4578-99cd-a00aab4aa569 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2367c001-ea16-454a-97e7-d09ab6cb4246 req-44403bec-fdd2-4293-8494-8f0abe3dc20a service nova] Acquiring lock "ee7af599-1f24-4828-913f-5ba3687619df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2367c001-ea16-454a-97e7-d09ab6cb4246 req-44403bec-fdd2-4293-8494-8f0abe3dc20a service nova] Lock "ee7af599-1f24-4828-913f-5ba3687619df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2367c001-ea16-454a-97e7-d09ab6cb4246 req-44403bec-fdd2-4293-8494-8f0abe3dc20a service nova] Lock "ee7af599-1f24-4828-913f-5ba3687619df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-2367c001-ea16-454a-97e7-d09ab6cb4246 req-44403bec-fdd2-4293-8494-8f0abe3dc20a service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] No waiting events found dispatching network-vif-plugged-ec94ef8c-0c4b-4578-99cd-a00aab4aa569 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:42 user nova-compute[74669]: WARNING nova.compute.manager [req-2367c001-ea16-454a-97e7-d09ab6cb4246 req-44403bec-fdd2-4293-8494-8f0abe3dc20a service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Received unexpected event network-vif-plugged-ec94ef8c-0c4b-4578-99cd-a00aab4aa569 for instance with vm_state building and task_state spawning.
Nov 08 17:01:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:42 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:01:42 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74669) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 17:01:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-51bfe567-0d53-44e8-afcc-a8a021e75b05 req-d99b402c-5d94-47de-a2b2-2dfaaed75acf service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Received event network-changed-8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-51bfe567-0d53-44e8-afcc-a8a021e75b05 req-d99b402c-5d94-47de-a2b2-2dfaaed75acf service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Refreshing instance network info cache due to event network-changed-8e437d3e-12dd-4bec-aa76-2951dc03b5eb. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:01:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-51bfe567-0d53-44e8-afcc-a8a021e75b05 req-d99b402c-5d94-47de-a2b2-2dfaaed75acf service nova] Acquiring lock "refresh_cache-55c67717-eb46-4617-9165-28531360e5d7" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:01:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-51bfe567-0d53-44e8-afcc-a8a021e75b05 req-d99b402c-5d94-47de-a2b2-2dfaaed75acf service nova] Acquired lock "refresh_cache-55c67717-eb46-4617-9165-28531360e5d7" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:01:44 user nova-compute[74669]: DEBUG nova.network.neutron [req-51bfe567-0d53-44e8-afcc-a8a021e75b05 req-d99b402c-5d94-47de-a2b2-2dfaaed75acf service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Refreshing network info cache for port 8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:01:44 user nova-compute[74669]: DEBUG nova.compute.manager [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:01:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:01:44 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Instance spawned successfully.
Nov 08 17:01:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:01:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:01:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:01:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:01:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:01:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:01:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:01:44 user nova-compute[74669]: INFO nova.compute.manager [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 08 17:01:44 user nova-compute[74669]: DEBUG nova.compute.manager [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:01:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-b65d6b8e-4d87-429c-b360-401c83a48477 req-26eb1f1f-675b-4822-a8e5-d7fa5c66663f service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Received event network-vif-plugged-ec94ef8c-0c4b-4578-99cd-a00aab4aa569 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b65d6b8e-4d87-429c-b360-401c83a48477 req-26eb1f1f-675b-4822-a8e5-d7fa5c66663f service nova] Acquiring lock "ee7af599-1f24-4828-913f-5ba3687619df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b65d6b8e-4d87-429c-b360-401c83a48477 req-26eb1f1f-675b-4822-a8e5-d7fa5c66663f service nova] Lock "ee7af599-1f24-4828-913f-5ba3687619df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b65d6b8e-4d87-429c-b360-401c83a48477 req-26eb1f1f-675b-4822-a8e5-d7fa5c66663f service nova] Lock "ee7af599-1f24-4828-913f-5ba3687619df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-b65d6b8e-4d87-429c-b360-401c83a48477 req-26eb1f1f-675b-4822-a8e5-d7fa5c66663f service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] No waiting events found dispatching network-vif-plugged-ec94ef8c-0c4b-4578-99cd-a00aab4aa569 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:44 user nova-compute[74669]: WARNING nova.compute.manager [req-b65d6b8e-4d87-429c-b360-401c83a48477 req-26eb1f1f-675b-4822-a8e5-d7fa5c66663f service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Received unexpected event network-vif-plugged-ec94ef8c-0c4b-4578-99cd-a00aab4aa569 for instance with vm_state building and task_state spawning.
Nov 08 17:01:44 user nova-compute[74669]: INFO nova.compute.manager [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Took 6.30 seconds to build instance.
Nov 08 17:01:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7a8ace36-97c7-4c28-847b-57ba92a7edcd tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "ee7af599-1f24-4828-913f-5ba3687619df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.414s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:44 user nova-compute[74669]: DEBUG nova.network.neutron [req-51bfe567-0d53-44e8-afcc-a8a021e75b05 req-d99b402c-5d94-47de-a2b2-2dfaaed75acf service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Updated VIF entry in instance network info cache for port 8e437d3e-12dd-4bec-aa76-2951dc03b5eb. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:01:44 user nova-compute[74669]: DEBUG nova.network.neutron [req-51bfe567-0d53-44e8-afcc-a8a021e75b05 req-d99b402c-5d94-47de-a2b2-2dfaaed75acf service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Updating instance_info_cache with network_info: [{"id": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "address": "fa:16:3e:79:63:9e", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e437d3e-12", "ovs_interfaceid": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:01:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-51bfe567-0d53-44e8-afcc-a8a021e75b05 req-d99b402c-5d94-47de-a2b2-2dfaaed75acf service nova] Releasing lock "refresh_cache-55c67717-eb46-4617-9165-28531360e5d7" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:01:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:46 user nova-compute[74669]: DEBUG nova.compute.manager [req-b402c314-229f-46bf-a9a7-3ff9556add0c req-91444c8a-4548-4f1e-a2ea-b0a5527f7976 service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Received event network-changed-1f3f9a10-8444-4120-859e-c682589df53e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:46 user nova-compute[74669]: DEBUG nova.compute.manager [req-b402c314-229f-46bf-a9a7-3ff9556add0c req-91444c8a-4548-4f1e-a2ea-b0a5527f7976 service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Refreshing instance network info cache due to event network-changed-1f3f9a10-8444-4120-859e-c682589df53e. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:01:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b402c314-229f-46bf-a9a7-3ff9556add0c req-91444c8a-4548-4f1e-a2ea-b0a5527f7976 service nova] Acquiring lock "refresh_cache-c20b4c52-94b1-4aed-98f0-ae228df81175" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:01:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b402c314-229f-46bf-a9a7-3ff9556add0c req-91444c8a-4548-4f1e-a2ea-b0a5527f7976 service nova] Acquired lock "refresh_cache-c20b4c52-94b1-4aed-98f0-ae228df81175" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:01:46 user nova-compute[74669]: DEBUG nova.network.neutron [req-b402c314-229f-46bf-a9a7-3ff9556add0c req-91444c8a-4548-4f1e-a2ea-b0a5527f7976 service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Refreshing network info cache for port 1f3f9a10-8444-4120-859e-c682589df53e {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:01:46 user nova-compute[74669]: DEBUG nova.network.neutron [req-b402c314-229f-46bf-a9a7-3ff9556add0c req-91444c8a-4548-4f1e-a2ea-b0a5527f7976 service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Updated VIF entry in instance network info cache for port 1f3f9a10-8444-4120-859e-c682589df53e. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:01:46 user nova-compute[74669]: DEBUG nova.network.neutron [req-b402c314-229f-46bf-a9a7-3ff9556add0c req-91444c8a-4548-4f1e-a2ea-b0a5527f7976 service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Updating instance_info_cache with network_info: [{"id": "1f3f9a10-8444-4120-859e-c682589df53e", "address": "fa:16:3e:62:af:a3", "network": {"id": "41edded2-dc16-49e9-8b02-b176d6e4ff77", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-901731550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faf3cd12d36542129de95b6a2b473906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3f9a10-84", "ovs_interfaceid": "1f3f9a10-8444-4120-859e-c682589df53e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:01:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b402c314-229f-46bf-a9a7-3ff9556add0c req-91444c8a-4548-4f1e-a2ea-b0a5527f7976 service nova] Releasing lock "refresh_cache-c20b4c52-94b1-4aed-98f0-ae228df81175" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Acquiring lock "c20b4c52-94b1-4aed-98f0-ae228df81175" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG nova.objects.instance [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lazy-loading 'flavor' on Instance uuid c20b4c52-94b1-4aed-98f0-ae228df81175 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Acquiring lock "c20b4c52-94b1-4aed-98f0-ae228df81175" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:47 user nova-compute[74669]: INFO nova.compute.manager [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Attaching volume 8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 to /dev/vdb
Nov 08 17:01:47 user nova-compute[74669]: DEBUG os_brick.utils [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac74b6d-7a85-42ab-a8b0-d41b60f9601d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f5fd8c-bf55-4e91-8044-81af531b2b7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b675cc-7312-45e7-9453-07d3946f4307]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f8f23c-8d86-4502-b662-3294e00d95ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:01:47 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:01:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac6d965-c699-4ef9-802f-c5e910c56084]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG os_brick.utils [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:01:47 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Updating existing volume attachment record: d2d8172d-79a4-4327-9f71-f71ce0a90961 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:01:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:48 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBhCzkmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:01:49 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:01:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:01:49 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:01:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:01:49 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8334c5-fe04-4335-a427-26c0030f6acd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:01:49 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a6d524-e5aa-467f-a04c-c7596a50b89c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2] added
Nov 08 17:01:49 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cb26fc-24da-4f37-a97a-7d6a96262513]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[32feb24f-ed40-4e3f-966e-f14ea25ce069]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NBhCzkmx {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NBhCzkmx" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90f83e6-9784-455c-a7d4-2304c36813fa]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NBhCzkmx'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c1dee4-ac14-4430-b8db-12fd993155ac]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9883827c-9fd2-44ba-9e19-6089c6e212dc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 17:01:49 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 17:01:49 user nova-compute[74669]:  {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:01:49 user nova-compute[74669]: WARNING os_brick.initiator.connectors.iscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 17:01:49 user nova-compute[74669]: 
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[86572dbe-fee4-412e-83f5-50bf3f4ee652]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2, portal: 172.16.0.220,3260]
Nov 08 17:01:49 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2, portal: 172.16.0.220,3260] successful.
Nov 08 17:01:49 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be27bb9-4bb7-414c-8194-8a666f538e34]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9af776-2ddf-4efd-ac94-b32c2de77890]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:01:49 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:01:49 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[15046922-7951-40df-97d0-c8c9a37fd55e]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:01:49 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: None {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:01:50 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:01:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBhCzkmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:01:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:01:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23739373534643761', 'path': '/dev/sdb'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:01:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739373534643761', 'path': '/dev/sdb'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:01:50 user nova-compute[74669]: DEBUG nova.objects.instance [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'flavor' on Instance uuid b663cd16-12b5-48fc-886d-0a7d160faea5 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:01:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 17:01:50 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:01:50 user nova-compute[74669]:   <source dev="/dev/sdb"/>
Nov 08 17:01:50 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:01:50 user nova-compute[74669]:   <serial>f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2</serial>
Nov 08 17:01:50 user nova-compute[74669]: </disk>
Nov 08 17:01:50 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 17:01:50 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:01:50 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:01:50 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:01:50 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:01:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:50 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:01:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:01:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:01:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] No VIF found with MAC fa:16:3e:70:48:8f, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:01:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8d039930-98a1-4156-a78d-51bf16095fe4 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.692s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.251s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:52 user nova-compute[74669]: INFO nova.compute.manager [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Rescuing
Nov 08 17:01:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:01:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquired lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:01:52 user nova-compute[74669]: DEBUG nova.network.neutron [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:01:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:01:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:52 user nova-compute[74669]: DEBUG nova.network.neutron [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Updating instance_info_cache with network_info: [{"id": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "address": "fa:16:3e:70:48:8f", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c0ff3a-f7", "ovs_interfaceid": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:01:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Releasing lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:01:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:52 user nova-compute[74669]: DEBUG nova.compute.manager [req-059e6079-ad80-4d52-bdb7-65ecba1ac157 req-008548ac-5973-4ac8-ad07-46219c51aeb8 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received event network-vif-unplugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-059e6079-ad80-4d52-bdb7-65ecba1ac157 req-008548ac-5973-4ac8-ad07-46219c51aeb8 service nova] Acquiring lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-059e6079-ad80-4d52-bdb7-65ecba1ac157 req-008548ac-5973-4ac8-ad07-46219c51aeb8 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-059e6079-ad80-4d52-bdb7-65ecba1ac157 req-008548ac-5973-4ac8-ad07-46219c51aeb8 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:52 user nova-compute[74669]: DEBUG nova.compute.manager [req-059e6079-ad80-4d52-bdb7-65ecba1ac157 req-008548ac-5973-4ac8-ad07-46219c51aeb8 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] No waiting events found dispatching network-vif-unplugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:52 user nova-compute[74669]: WARNING nova.compute.manager [req-059e6079-ad80-4d52-bdb7-65ecba1ac157 req-008548ac-5973-4ac8-ad07-46219c51aeb8 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received unexpected event network-vif-unplugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 for instance with vm_state active and task_state rescuing.
Nov 08 17:01:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "55c67717-eb46-4617-9165-28531360e5d7" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "55c67717-eb46-4617-9165-28531360e5d7" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:53 user nova-compute[74669]: INFO nova.compute.manager [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Shelving
Nov 08 17:01:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:53 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Instance destroyed successfully.
Nov 08 17:01:53 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Attempting rescue
Nov 08 17:01:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74669) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Instance directory exists: not creating {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 17:01:53 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Creating image(s)
Nov 08 17:01:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "/opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "/opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "/opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG nova.objects.instance [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'trusted_certs' on Instance uuid b663cd16-12b5-48fc-886d-0a7d160faea5 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.236s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk.rescue {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk.rescue" returned: 0 in 0.115s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.372s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:53 user nova-compute[74669]: DEBUG nova.objects.instance [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'migration_context' on Instance uuid b663cd16-12b5-48fc-886d-0a7d160faea5 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.objects.base [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Object Instance<b663cd16-12b5-48fc-886d-0a7d160faea5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Start _get_guest_xml network_info=[{"id": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "address": "fa:16:3e:70:48:8f", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "vif_mac": "fa:16:3e:70:48:8f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c0ff3a-f7", "ovs_interfaceid": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.objects.instance [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'resources' on Instance uuid b663cd16-12b5-48fc-886d-0a7d160faea5 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.objects.base [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Object Instance<b663cd16-12b5-48fc-886d-0a7d160faea5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.objects.instance [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'numa_topology' on Instance uuid b663cd16-12b5-48fc-886d-0a7d160faea5 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.objects.base [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Object Instance<b663cd16-12b5-48fc-886d-0a7d160faea5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:01:54 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:01:54 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-f901b315-f2a9-4af9-9dab-3e2a9924cb32 req-3dcc5b3f-852d-4e66-91df-0db5542d25a3 service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Received event network-vif-unplugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f901b315-f2a9-4af9-9dab-3e2a9924cb32 req-3dcc5b3f-852d-4e66-91df-0db5542d25a3 service nova] Acquiring lock "55c67717-eb46-4617-9165-28531360e5d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f901b315-f2a9-4af9-9dab-3e2a9924cb32 req-3dcc5b3f-852d-4e66-91df-0db5542d25a3 service nova] Lock "55c67717-eb46-4617-9165-28531360e5d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f901b315-f2a9-4af9-9dab-3e2a9924cb32 req-3dcc5b3f-852d-4e66-91df-0db5542d25a3 service nova] Lock "55c67717-eb46-4617-9165-28531360e5d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-f901b315-f2a9-4af9-9dab-3e2a9924cb32 req-3dcc5b3f-852d-4e66-91df-0db5542d25a3 service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] No waiting events found dispatching network-vif-unplugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:54 user nova-compute[74669]: WARNING nova.compute.manager [req-f901b315-f2a9-4af9-9dab-3e2a9924cb32 req-3dcc5b3f-852d-4e66-91df-0db5542d25a3 service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Received unexpected event network-vif-unplugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb for instance with vm_state active and task_state shelving.
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.objects.instance [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'vcpu_model' on Instance uuid b663cd16-12b5-48fc-886d-0a7d160faea5 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.objects.base [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Object Instance<b663cd16-12b5-48fc-886d-0a7d160faea5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1617099866',display_name='tempest-ServerRescueNegativeTestJSON-server-1617099866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1617099866',id=16,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4Cgsm6cX2qyzx8rq6D9dugDe4RZp7Igjsfdo3CJijmqQ1dHOQM5HOFxPzKN86OgMWJ2HHhOKlvxf15iLNojfkf1D4DQ0XYMSMxUPTQJoEkRD6CCzrhdyhlfH+CXTjE8g==',key_name='tempest-keypair-1917158791',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:59:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='632d3acc026b4a869be4899a0ed2e2e2',ramdisk_id='',reservation_id='r-kojzv90d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1743978403',owner_user_name='tempest-ServerRescueNegativeTestJSON-1743978403-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T16:59:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4836f11b0e8346a2a7e835a6012f53fb',uuid=b663cd16-12b5-48fc-886d-0a7d160faea5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "address": "fa:16:3e:70:48:8f", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "vif_mac": "fa:16:3e:70:48:8f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c0ff3a-f7", "ovs_interfaceid": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converting VIF {"id": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "address": "fa:16:3e:70:48:8f", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "vif_mac": "fa:16:3e:70:48:8f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c0ff3a-f7", "ovs_interfaceid": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:48:8f,bridge_name='br-int',has_traffic_filtering=True,id=f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6c0ff3a-f7') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.objects.instance [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'pci_devices' on Instance uuid b663cd16-12b5-48fc-886d-0a7d160faea5 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk --force-share --output=json" returned: 0 in 0.331s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.objects.base [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Object Instance<b663cd16-12b5-48fc-886d-0a7d160faea5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:01:54 user nova-compute[74669]:   <uuid>b663cd16-12b5-48fc-886d-0a7d160faea5</uuid>
Nov 08 17:01:54 user nova-compute[74669]:   <name>instance-00000010</name>
Nov 08 17:01:54 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:01:54 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:01:54 user nova-compute[74669]:   <metadata>
Nov 08 17:01:54 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:01:54 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:01:54 user nova-compute[74669]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1617099866</nova:name>
Nov 08 17:01:54 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:01:54</nova:creationTime>
Nov 08 17:01:54 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:01:54 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:01:54 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:01:54 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:01:54 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:01:54 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:01:54 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:01:54 user nova-compute[74669]:       <nova:owner>
Nov 08 17:01:54 user nova-compute[74669]:         <nova:user uuid="4836f11b0e8346a2a7e835a6012f53fb">tempest-ServerRescueNegativeTestJSON-1743978403-project-member</nova:user>
Nov 08 17:01:54 user nova-compute[74669]:         <nova:project uuid="632d3acc026b4a869be4899a0ed2e2e2">tempest-ServerRescueNegativeTestJSON-1743978403</nova:project>
Nov 08 17:01:54 user nova-compute[74669]:       </nova:owner>
Nov 08 17:01:54 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:01:54 user nova-compute[74669]:       <nova:ports>
Nov 08 17:01:54 user nova-compute[74669]:         <nova:port uuid="f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791">
Nov 08 17:01:54 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 17:01:54 user nova-compute[74669]:         </nova:port>
Nov 08 17:01:54 user nova-compute[74669]:       </nova:ports>
Nov 08 17:01:54 user nova-compute[74669]:     </nova:instance>
Nov 08 17:01:54 user nova-compute[74669]:   </metadata>
Nov 08 17:01:54 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:01:54 user nova-compute[74669]:     <system>
Nov 08 17:01:54 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:01:54 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:01:54 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:01:54 user nova-compute[74669]:       <entry name="serial">b663cd16-12b5-48fc-886d-0a7d160faea5</entry>
Nov 08 17:01:54 user nova-compute[74669]:       <entry name="uuid">b663cd16-12b5-48fc-886d-0a7d160faea5</entry>
Nov 08 17:01:54 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:01:54 user nova-compute[74669]:     </system>
Nov 08 17:01:54 user nova-compute[74669]:   </sysinfo>
Nov 08 17:01:54 user nova-compute[74669]:   <os>
Nov 08 17:01:54 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:01:54 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:01:54 user nova-compute[74669]:   </os>
Nov 08 17:01:54 user nova-compute[74669]:   <features>
Nov 08 17:01:54 user nova-compute[74669]:     <acpi/>
Nov 08 17:01:54 user nova-compute[74669]:     <apic/>
Nov 08 17:01:54 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:01:54 user nova-compute[74669]:   </features>
Nov 08 17:01:54 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:01:54 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:01:54 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:01:54 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:01:54 user nova-compute[74669]:   </clock>
Nov 08 17:01:54 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:01:54 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:01:54 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:01:54 user nova-compute[74669]:   </cpu>
Nov 08 17:01:54 user nova-compute[74669]:   <devices>
Nov 08 17:01:54 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:01:54 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:01:54 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk.rescue"/>
Nov 08 17:01:54 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:01:54 user nova-compute[74669]:     </disk>
Nov 08 17:01:54 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:01:54 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:01:54 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk"/>
Nov 08 17:01:54 user nova-compute[74669]:       <target dev="vdb" bus="virtio"/>
Nov 08 17:01:54 user nova-compute[74669]:     </disk>
Nov 08 17:01:54 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:01:54 user nova-compute[74669]:       <mac address="fa:16:3e:70:48:8f"/>
Nov 08 17:01:54 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:01:54 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:01:54 user nova-compute[74669]:       <target dev="tapf6c0ff3a-f7"/>
Nov 08 17:01:54 user nova-compute[74669]:     </interface>
Nov 08 17:01:54 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:01:54 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/console.log" append="off"/>
Nov 08 17:01:54 user nova-compute[74669]:     </serial>
Nov 08 17:01:54 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:01:54 user nova-compute[74669]:     <video>
Nov 08 17:01:54 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:01:54 user nova-compute[74669]:     </video>
Nov 08 17:01:54 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:01:54 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:01:54 user nova-compute[74669]:     </rng>
Nov 08 17:01:54 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:01:54 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:01:54 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:01:54 user nova-compute[74669]:     </memballoon>
Nov 08 17:01:54 user nova-compute[74669]:   </devices>
Nov 08 17:01:54 user nova-compute[74669]: </domain>
Nov 08 17:01:54 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:01:54 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Instance destroyed successfully.
Nov 08 17:01:54 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Instance destroyed successfully.
Nov 08 17:01:54 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Beginning cold snapshot process
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] No VIF found with MAC fa:16:3e:70:48:8f, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46df3fed-e88a-45ed-a05e-2fb2f1bf017c/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG nova.privsep.utils [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74669) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk /opt/stack/data/nova/instances/snapshots/tmpjruazk40/91c0412150554d1392ea91ac3a4145cd {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46df3fed-e88a-45ed-a05e-2fb2f1bf017c/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46df3fed-e88a-45ed-a05e-2fb2f1bf017c/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46df3fed-e88a-45ed-a05e-2fb2f1bf017c/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:55 user nova-compute[74669]: DEBUG nova.compute.manager [req-6df41b31-7eb0-4b27-a558-0acf376f1df2 req-a2bf9337-8bf8-471e-9330-ae7e0ddb0268 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6df41b31-7eb0-4b27-a558-0acf376f1df2 req-a2bf9337-8bf8-471e-9330-ae7e0ddb0268 service nova] Acquiring lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6df41b31-7eb0-4b27-a558-0acf376f1df2 req-a2bf9337-8bf8-471e-9330-ae7e0ddb0268 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6df41b31-7eb0-4b27-a558-0acf376f1df2 req-a2bf9337-8bf8-471e-9330-ae7e0ddb0268 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:55 user nova-compute[74669]: DEBUG nova.compute.manager [req-6df41b31-7eb0-4b27-a558-0acf376f1df2 req-a2bf9337-8bf8-471e-9330-ae7e0ddb0268 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] No waiting events found dispatching network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:55 user nova-compute[74669]: WARNING nova.compute.manager [req-6df41b31-7eb0-4b27-a558-0acf376f1df2 req-a2bf9337-8bf8-471e-9330-ae7e0ddb0268 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received unexpected event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 for instance with vm_state active and task_state rescuing.
Nov 08 17:01:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.343s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Acquiring lock "b68038d5-a01a-49a2-bd73-80cec03e68f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:55 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:01:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk /opt/stack/data/nova/instances/snapshots/tmpjruazk40/91c0412150554d1392ea91ac3a4145cd" returned: 0 in 1.141s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:55 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Snapshot extracted, beginning image upload
Nov 08 17:01:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:01:56 user nova-compute[74669]: INFO nova.compute.claims [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Claim successful on node user
Nov 08 17:01:56 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Refreshing inventories for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 17:01:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:56 user nova-compute[74669]: DEBUG nova.compute.manager [req-11b9986c-9570-4f2a-993f-2edec4f5f330 req-40bcb1ef-c1e8-48a8-a150-a510bec3486d service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Received event network-vif-plugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-11b9986c-9570-4f2a-993f-2edec4f5f330 req-40bcb1ef-c1e8-48a8-a150-a510bec3486d service nova] Acquiring lock "55c67717-eb46-4617-9165-28531360e5d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-11b9986c-9570-4f2a-993f-2edec4f5f330 req-40bcb1ef-c1e8-48a8-a150-a510bec3486d service nova] Lock "55c67717-eb46-4617-9165-28531360e5d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-11b9986c-9570-4f2a-993f-2edec4f5f330 req-40bcb1ef-c1e8-48a8-a150-a510bec3486d service nova] Lock "55c67717-eb46-4617-9165-28531360e5d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:56 user nova-compute[74669]: DEBUG nova.compute.manager [req-11b9986c-9570-4f2a-993f-2edec4f5f330 req-40bcb1ef-c1e8-48a8-a150-a510bec3486d service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] No waiting events found dispatching network-vif-plugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:56 user nova-compute[74669]: WARNING nova.compute.manager [req-11b9986c-9570-4f2a-993f-2edec4f5f330 req-40bcb1ef-c1e8-48a8-a150-a510bec3486d service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Received unexpected event network-vif-plugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb for instance with vm_state active and task_state shelving_image_uploading.
Nov 08 17:01:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:56 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Updating ProviderTree inventory for provider ce26964b-e55b-43d2-801a-7221ff1fe64b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 17:01:56 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Updating inventory in ProviderTree for provider ce26964b-e55b-43d2-801a-7221ff1fe64b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 17:01:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:56 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Refreshing aggregate associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, aggregates: None {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 17:01:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:56 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Refreshing trait associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, traits: HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 17:01:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:01:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:01:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-1d02400a-9c85-4025-a934-0f63e98cdb64 req-b6783911-fadf-408e-82a9-07d13074f232 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1d02400a-9c85-4025-a934-0f63e98cdb64 req-b6783911-fadf-408e-82a9-07d13074f232 service nova] Acquiring lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1d02400a-9c85-4025-a934-0f63e98cdb64 req-b6783911-fadf-408e-82a9-07d13074f232 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1d02400a-9c85-4025-a934-0f63e98cdb64 req-b6783911-fadf-408e-82a9-07d13074f232 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-1d02400a-9c85-4025-a934-0f63e98cdb64 req-b6783911-fadf-408e-82a9-07d13074f232 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] No waiting events found dispatching network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:59 user nova-compute[74669]: WARNING nova.compute.manager [req-1d02400a-9c85-4025-a934-0f63e98cdb64 req-b6783911-fadf-408e-82a9-07d13074f232 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received unexpected event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 for instance with vm_state active and task_state rescuing.
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-1d02400a-9c85-4025-a934-0f63e98cdb64 req-b6783911-fadf-408e-82a9-07d13074f232 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1d02400a-9c85-4025-a934-0f63e98cdb64 req-b6783911-fadf-408e-82a9-07d13074f232 service nova] Acquiring lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1d02400a-9c85-4025-a934-0f63e98cdb64 req-b6783911-fadf-408e-82a9-07d13074f232 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1d02400a-9c85-4025-a934-0f63e98cdb64 req-b6783911-fadf-408e-82a9-07d13074f232 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-1d02400a-9c85-4025-a934-0f63e98cdb64 req-b6783911-fadf-408e-82a9-07d13074f232 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] No waiting events found dispatching network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:01:59 user nova-compute[74669]: WARNING nova.compute.manager [req-1d02400a-9c85-4025-a934-0f63e98cdb64 req-b6783911-fadf-408e-82a9-07d13074f232 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received unexpected event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 for instance with vm_state active and task_state rescuing.
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.manager [None req-6a97cb4a-d687-4226-a37f-cdcb4db2c513 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:01:59 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:01:59 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=7443MB free_disk=25.423343658447266GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:01:59 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Snapshot image upload complete
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.manager [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:01:59 user nova-compute[74669]: INFO nova.compute.manager [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Shelve offloading
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:01:59 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Instance destroyed successfully.
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.manager [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "refresh_cache-55c67717-eb46-4617-9165-28531360e5d7" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquired lock "refresh_cache-55c67717-eb46-4617-9165-28531360e5d7" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.621s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.225s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.network.neutron [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:01:59 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.policy [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb1e2a8affb74c439d6e9b077d0e9fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da115791fd6d49ae84005c6f47dc1e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0ce9072b-e003-4921-83bc-8f3449c09e14 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7b335462-0d93-4899-a223-5c2e36932578 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b663cd16-12b5-48fc-886d-0a7d160faea5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 55c67717-eb46-4617-9165-28531360e5d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance c20b4c52-94b1-4aed-98f0-ae228df81175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b8bfb971-094b-46cf-b8bd-ba3df8994e7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 46df3fed-e88a-45ed-a05e-2fb2f1bf017c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance d91eaa51-6bf4-40eb-9f36-f8e838501373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance ee7af599-1f24-4828-913f-5ba3687619df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b68038d5-a01a-49a2-bd73-80cec03e68f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:01:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:01:59 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Creating image(s)
Nov 08 17:02:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Acquiring lock "/opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "/opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "/opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.199s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Updating instance_info_cache with network_info: [{"id": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "address": "fa:16:3e:79:63:9e", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e437d3e-12", "ovs_interfaceid": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Releasing lock "refresh_cache-55c67717-eb46-4617-9165-28531360e5d7" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.204s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk 1073741824" returned: 0 in 0.070s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.959s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] There are 0 instances to clean {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.238s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:00 user nova-compute[74669]: DEBUG nova.network.neutron [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Successfully created port: aa24248f-00c5-4dd2-b439-b1d63068d37f {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Cannot resize image /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Ensure instance console log exists: /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:01 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Instance destroyed successfully.
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.objects.instance [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lazy-loading 'resources' on Instance uuid 55c67717-eb46-4617-9165-28531360e5d7 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-fd0fbe71-fb9c-4ef4-91b1-b5b8e1cd62a4 req-2e87dfdc-25a4-42f2-9687-fdf0b57284ab service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Received event network-changed-8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-fd0fbe71-fb9c-4ef4-91b1-b5b8e1cd62a4 req-2e87dfdc-25a4-42f2-9687-fdf0b57284ab service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Refreshing instance network info cache due to event network-changed-8e437d3e-12dd-4bec-aa76-2951dc03b5eb. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-fd0fbe71-fb9c-4ef4-91b1-b5b8e1cd62a4 req-2e87dfdc-25a4-42f2-9687-fdf0b57284ab service nova] Acquiring lock "refresh_cache-55c67717-eb46-4617-9165-28531360e5d7" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-fd0fbe71-fb9c-4ef4-91b1-b5b8e1cd62a4 req-2e87dfdc-25a4-42f2-9687-fdf0b57284ab service nova] Acquired lock "refresh_cache-55c67717-eb46-4617-9165-28531360e5d7" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.network.neutron [req-fd0fbe71-fb9c-4ef4-91b1-b5b8e1cd62a4 req-2e87dfdc-25a4-42f2-9687-fdf0b57284ab service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Refreshing network info cache for port 8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:59:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-287785015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-287785015',id=17,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqTEGMrhgsJerp3F07Qjp9lZ3WIFCasSJwyynJzvn5F9IQ6K479N2ZxX951BDCBv5rK5xSEBYvlpUodpv7Vp0m4MieCBpJEx9IDLx1wyhScDRdXhBk/8ggJAZZ7b45+jg==',key_name='tempest-keypair-185784068',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:00:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9f1e9778e17a4e0fa1aa1f41d323a88c',ramdisk_id='',reservation_id='r-fr2itb4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-317302826',owner_user_name='tempest-AttachVolumeShelveTestJSON-317302826-project-member',shelved_at='2023-11-08T17:01:59.492442',shelved_host='user',shelved_image_id='464ef1b3-4425-44d4-b651-2425c07b9469'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:01:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8bcb0586bce42a3a1a59b2cbc99f846',uuid=55c67717-eb46-4617-9165-28531360e5d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "address": "fa:16:3e:79:63:9e", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e437d3e-12", "ovs_interfaceid": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converting VIF {"id": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "address": "fa:16:3e:79:63:9e", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e437d3e-12", "ovs_interfaceid": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:63:9e,bridge_name='br-int',has_traffic_filtering=True,id=8e437d3e-12dd-4bec-aa76-2951dc03b5eb,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e437d3e-12') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG os_vif [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:63:9e,bridge_name='br-int',has_traffic_filtering=True,id=8e437d3e-12dd-4bec-aa76-2951dc03b5eb,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e437d3e-12') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e437d3e-12, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18f9d2ca-9dff-47b1-9f2d-be3e321c3b32) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:02:01 user nova-compute[74669]: INFO os_vif [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:63:9e,bridge_name='br-int',has_traffic_filtering=True,id=8e437d3e-12dd-4bec-aa76-2951dc03b5eb,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e437d3e-12')
Nov 08 17:02:01 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Deleting instance files /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7_del
Nov 08 17:02:01 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Deletion of /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7_del complete
Nov 08 17:02:01 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Deleted allocations for instance 55c67717-eb46-4617-9165-28531360e5d7
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.objects.instance [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lazy-loading 'numa_topology' on Instance uuid 55c67717-eb46-4617-9165-28531360e5d7 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.objects.base [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Object Instance<55c67717-eb46-4617-9165-28531360e5d7> lazy-loaded attributes: resources,numa_topology {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.objects.instance [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lazy-loading 'flavor' on Instance uuid b8bfb971-094b-46cf-b8bd-ba3df8994e7a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.108s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.network.neutron [req-fd0fbe71-fb9c-4ef4-91b1-b5b8e1cd62a4 req-2e87dfdc-25a4-42f2-9687-fdf0b57284ab service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Updated VIF entry in instance network info cache for port 8e437d3e-12dd-4bec-aa76-2951dc03b5eb. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.network.neutron [req-fd0fbe71-fb9c-4ef4-91b1-b5b8e1cd62a4 req-2e87dfdc-25a4-42f2-9687-fdf0b57284ab service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Updating instance_info_cache with network_info: [{"id": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "address": "fa:16:3e:79:63:9e", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8e437d3e-12", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-fd0fbe71-fb9c-4ef4-91b1-b5b8e1cd62a4 req-2e87dfdc-25a4-42f2-9687-fdf0b57284ab service nova] Releasing lock "refresh_cache-55c67717-eb46-4617-9165-28531360e5d7" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:01 user nova-compute[74669]: INFO nova.compute.manager [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Attaching volume 3869521d-313b-4af0-b0c0-d58d213ec41f to /dev/vdb
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Successfully updated port: aa24248f-00c5-4dd2-b439-b1d63068d37f {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.512s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Acquiring lock "refresh_cache-b68038d5-a01a-49a2-bd73-80cec03e68f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Acquired lock "refresh_cache-b68038d5-a01a-49a2-bd73-80cec03e68f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-44ab5bc6-e11b-4f77-88ec-28d943ef959b req-d5585e5c-a325-46ff-b5f5-53a777dce6ae service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Received event network-changed-aa24248f-00c5-4dd2-b439-b1d63068d37f {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-44ab5bc6-e11b-4f77-88ec-28d943ef959b req-d5585e5c-a325-46ff-b5f5-53a777dce6ae service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Refreshing instance network info cache due to event network-changed-aa24248f-00c5-4dd2-b439-b1d63068d37f. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-44ab5bc6-e11b-4f77-88ec-28d943ef959b req-d5585e5c-a325-46ff-b5f5-53a777dce6ae service nova] Acquiring lock "refresh_cache-b68038d5-a01a-49a2-bd73-80cec03e68f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG os_brick.utils [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3c75e1b1-3118-40e1-8de6-403404ed9a7c tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "55c67717-eb46-4617-9165-28531360e5d7" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.736s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cc5321-b11f-4146-b865-eca8192107a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9268382-c84e-4b49-b46e-205e5a4cb664]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3104ade-8231-4406-b44c-03dc93965b5f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23c608d-b380-4392-99c7-b6020c4c476e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:02:02 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:02:02 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ecf7fd-1b64-4241-b395-6975192b9b62]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG os_brick.utils [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Updating existing volume attachment record: 684c68d8-7f83-4089-978d-45db02b169f1 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.network.neutron [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Updating instance_info_cache with network_info: [{"id": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "address": "fa:16:3e:ef:37:d8", "network": {"id": "5e97ae50-3f68-4098-a5c8-f17afb8a7366", "bridge": "br-int", "label": "tempest-TestVolumeSwap-200033215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da115791fd6d49ae84005c6f47dc1e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa24248f-00", "ovs_interfaceid": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Releasing lock "refresh_cache-b68038d5-a01a-49a2-bd73-80cec03e68f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Instance network_info: |[{"id": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "address": "fa:16:3e:ef:37:d8", "network": {"id": "5e97ae50-3f68-4098-a5c8-f17afb8a7366", "bridge": "br-int", "label": "tempest-TestVolumeSwap-200033215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da115791fd6d49ae84005c6f47dc1e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa24248f-00", "ovs_interfaceid": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-44ab5bc6-e11b-4f77-88ec-28d943ef959b req-d5585e5c-a325-46ff-b5f5-53a777dce6ae service nova] Acquired lock "refresh_cache-b68038d5-a01a-49a2-bd73-80cec03e68f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.network.neutron [req-44ab5bc6-e11b-4f77-88ec-28d943ef959b req-d5585e5c-a325-46ff-b5f5-53a777dce6ae service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Refreshing network info cache for port aa24248f-00c5-4dd2-b439-b1d63068d37f {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Start _get_guest_xml network_info=[{"id": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "address": "fa:16:3e:ef:37:d8", "network": {"id": "5e97ae50-3f68-4098-a5c8-f17afb8a7366", "bridge": "br-int", "label": "tempest-TestVolumeSwap-200033215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da115791fd6d49ae84005c6f47dc1e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa24248f-00", "ovs_interfaceid": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:02:02 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:02:02 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-819829494',display_name='tempest-TestVolumeSwap-server-819829494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-819829494',id=23,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOp+1Xxtd2umxV0btTGf/ErEe0g7D9x/a0isLC3fe0FGF5/TfATkP8vuqZOhsmylgLt8hudXcIDjk9reZZMKNfH71JzktHC/oQkDcqxQD980+M3FToSlLBzh5quuKllT9A==',key_name='tempest-keypair-2144222695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da115791fd6d49ae84005c6f47dc1e6f',ramdisk_id='',reservation_id='r-wrtbgyyo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-96286036',owner_user_name='tempest-TestVolumeSwap-96286036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:02:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb1e2a8affb74c439d6e9b077d0e9fe4',uuid=b68038d5-a01a-49a2-bd73-80cec03e68f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "address": "fa:16:3e:ef:37:d8", "network": {"id": "5e97ae50-3f68-4098-a5c8-f17afb8a7366", "bridge": "br-int", "label": "tempest-TestVolumeSwap-200033215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da115791fd6d49ae84005c6f47dc1e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa24248f-00", "ovs_interfaceid": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Converting VIF {"id": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "address": "fa:16:3e:ef:37:d8", "network": {"id": "5e97ae50-3f68-4098-a5c8-f17afb8a7366", "bridge": "br-int", "label": "tempest-TestVolumeSwap-200033215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da115791fd6d49ae84005c6f47dc1e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa24248f-00", "ovs_interfaceid": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:37:d8,bridge_name='br-int',has_traffic_filtering=True,id=aa24248f-00c5-4dd2-b439-b1d63068d37f,network=Network(5e97ae50-3f68-4098-a5c8-f17afb8a7366),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa24248f-00') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.objects.instance [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lazy-loading 'pci_devices' on Instance uuid b68038d5-a01a-49a2-bd73-80cec03e68f9 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Updating instance_info_cache with network_info: [{"id": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "address": "fa:16:3e:e6:99:99", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bfc353f-1f", "ovs_interfaceid": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:02:02 user nova-compute[74669]:   <uuid>b68038d5-a01a-49a2-bd73-80cec03e68f9</uuid>
Nov 08 17:02:02 user nova-compute[74669]:   <name>instance-00000017</name>
Nov 08 17:02:02 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:02:02 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:02:02 user nova-compute[74669]:   <metadata>
Nov 08 17:02:02 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:02:02 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:02:02 user nova-compute[74669]:       <nova:name>tempest-TestVolumeSwap-server-819829494</nova:name>
Nov 08 17:02:02 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:02:02</nova:creationTime>
Nov 08 17:02:02 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:02:02 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:02:02 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:02:02 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:02:02 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:02:02 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:02:02 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:02:02 user nova-compute[74669]:       <nova:owner>
Nov 08 17:02:02 user nova-compute[74669]:         <nova:user uuid="eb1e2a8affb74c439d6e9b077d0e9fe4">tempest-TestVolumeSwap-96286036-project-member</nova:user>
Nov 08 17:02:02 user nova-compute[74669]:         <nova:project uuid="da115791fd6d49ae84005c6f47dc1e6f">tempest-TestVolumeSwap-96286036</nova:project>
Nov 08 17:02:02 user nova-compute[74669]:       </nova:owner>
Nov 08 17:02:02 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:02:02 user nova-compute[74669]:       <nova:ports>
Nov 08 17:02:02 user nova-compute[74669]:         <nova:port uuid="aa24248f-00c5-4dd2-b439-b1d63068d37f">
Nov 08 17:02:02 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 17:02:02 user nova-compute[74669]:         </nova:port>
Nov 08 17:02:02 user nova-compute[74669]:       </nova:ports>
Nov 08 17:02:02 user nova-compute[74669]:     </nova:instance>
Nov 08 17:02:02 user nova-compute[74669]:   </metadata>
Nov 08 17:02:02 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:02:02 user nova-compute[74669]:     <system>
Nov 08 17:02:02 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:02:02 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:02:02 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:02:02 user nova-compute[74669]:       <entry name="serial">b68038d5-a01a-49a2-bd73-80cec03e68f9</entry>
Nov 08 17:02:02 user nova-compute[74669]:       <entry name="uuid">b68038d5-a01a-49a2-bd73-80cec03e68f9</entry>
Nov 08 17:02:02 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:02:02 user nova-compute[74669]:     </system>
Nov 08 17:02:02 user nova-compute[74669]:   </sysinfo>
Nov 08 17:02:02 user nova-compute[74669]:   <os>
Nov 08 17:02:02 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:02:02 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:02:02 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:02:02 user nova-compute[74669]:   </os>
Nov 08 17:02:02 user nova-compute[74669]:   <features>
Nov 08 17:02:02 user nova-compute[74669]:     <acpi/>
Nov 08 17:02:02 user nova-compute[74669]:     <apic/>
Nov 08 17:02:02 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:02:02 user nova-compute[74669]:   </features>
Nov 08 17:02:02 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:02:02 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:02:02 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:02:02 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:02:02 user nova-compute[74669]:   </clock>
Nov 08 17:02:02 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:02:02 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:02:02 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:02:02 user nova-compute[74669]:   </cpu>
Nov 08 17:02:02 user nova-compute[74669]:   <devices>
Nov 08 17:02:02 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:02:02 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:02:02 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk"/>
Nov 08 17:02:02 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:02:02 user nova-compute[74669]:     </disk>
Nov 08 17:02:02 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:02:02 user nova-compute[74669]:       <mac address="fa:16:3e:ef:37:d8"/>
Nov 08 17:02:02 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:02:02 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:02:02 user nova-compute[74669]:       <target dev="tapaa24248f-00"/>
Nov 08 17:02:02 user nova-compute[74669]:     </interface>
Nov 08 17:02:02 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:02:02 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/console.log" append="off"/>
Nov 08 17:02:02 user nova-compute[74669]:     </serial>
Nov 08 17:02:02 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:02:02 user nova-compute[74669]:     <video>
Nov 08 17:02:02 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:02:02 user nova-compute[74669]:     </video>
Nov 08 17:02:02 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:02:02 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:02:02 user nova-compute[74669]:     </rng>
Nov 08 17:02:02 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:02:02 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:02:02 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:02:02 user nova-compute[74669]:     </memballoon>
Nov 08 17:02:02 user nova-compute[74669]:   </devices>
Nov 08 17:02:02 user nova-compute[74669]: </domain>
Nov 08 17:02:02 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-819829494',display_name='tempest-TestVolumeSwap-server-819829494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-819829494',id=23,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOp+1Xxtd2umxV0btTGf/ErEe0g7D9x/a0isLC3fe0FGF5/TfATkP8vuqZOhsmylgLt8hudXcIDjk9reZZMKNfH71JzktHC/oQkDcqxQD980+M3FToSlLBzh5quuKllT9A==',key_name='tempest-keypair-2144222695',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da115791fd6d49ae84005c6f47dc1e6f',ramdisk_id='',reservation_id='r-wrtbgyyo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-96286036',owner_user_name='tempest-TestVolumeSwap-96286036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:02:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb1e2a8affb74c439d6e9b077d0e9fe4',uuid=b68038d5-a01a-49a2-bd73-80cec03e68f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "address": "fa:16:3e:ef:37:d8", "network": {"id": "5e97ae50-3f68-4098-a5c8-f17afb8a7366", "bridge": "br-int", "label": "tempest-TestVolumeSwap-200033215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da115791fd6d49ae84005c6f47dc1e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa24248f-00", "ovs_interfaceid": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Converting VIF {"id": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "address": "fa:16:3e:ef:37:d8", "network": {"id": "5e97ae50-3f68-4098-a5c8-f17afb8a7366", "bridge": "br-int", "label": "tempest-TestVolumeSwap-200033215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da115791fd6d49ae84005c6f47dc1e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa24248f-00", "ovs_interfaceid": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:37:d8,bridge_name='br-int',has_traffic_filtering=True,id=aa24248f-00c5-4dd2-b439-b1d63068d37f,network=Network(5e97ae50-3f68-4098-a5c8-f17afb8a7366),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa24248f-00') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG os_vif [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:37:d8,bridge_name='br-int',has_traffic_filtering=True,id=aa24248f-00c5-4dd2-b439-b1d63068d37f,network=Network(5e97ae50-3f68-4098-a5c8-f17afb8a7366),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa24248f-00') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '590889c1-00fb-5789-a40f-14baa6f8cc97', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa24248f-00, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa24248f-00, col_values=(('qos', UUID('9716f606-8053-4624-9247-06f2ecaceff8')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa24248f-00, col_values=(('external_ids', {'iface-id': 'aa24248f-00c5-4dd2-b439-b1d63068d37f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:37:d8', 'vm-uuid': 'b68038d5-a01a-49a2-bd73-80cec03e68f9'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:02 user nova-compute[74669]: INFO os_vif [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:37:d8,bridge_name='br-int',has_traffic_filtering=True,id=aa24248f-00c5-4dd2-b439-b1d63068d37f,network=Network(5e97ae50-3f68-4098-a5c8-f17afb8a7366),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa24248f-00')
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] No VIF found with MAC fa:16:3e:ef:37:d8, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.network.neutron [req-44ab5bc6-e11b-4f77-88ec-28d943ef959b req-d5585e5c-a325-46ff-b5f5-53a777dce6ae service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Updated VIF entry in instance network info cache for port aa24248f-00c5-4dd2-b439-b1d63068d37f. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG nova.network.neutron [req-44ab5bc6-e11b-4f77-88ec-28d943ef959b req-d5585e5c-a325-46ff-b5f5-53a777dce6ae service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Updating instance_info_cache with network_info: [{"id": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "address": "fa:16:3e:ef:37:d8", "network": {"id": "5e97ae50-3f68-4098-a5c8-f17afb8a7366", "bridge": "br-int", "label": "tempest-TestVolumeSwap-200033215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da115791fd6d49ae84005c6f47dc1e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa24248f-00", "ovs_interfaceid": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:02:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-44ab5bc6-e11b-4f77-88ec-28d943ef959b req-d5585e5c-a325-46ff-b5f5-53a777dce6ae service nova] Releasing lock "refresh_cache-b68038d5-a01a-49a2-bd73-80cec03e68f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:02:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:04 user nova-compute[74669]: DEBUG nova.compute.manager [req-3b1e4ff1-0894-482d-8026-808b67c58e83 req-4ff0a1a9-c3ad-4bc3-95bc-7dadcaaf58b3 service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Received event network-vif-plugged-aa24248f-00c5-4dd2-b439-b1d63068d37f {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:02:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3b1e4ff1-0894-482d-8026-808b67c58e83 req-4ff0a1a9-c3ad-4bc3-95bc-7dadcaaf58b3 service nova] Acquiring lock "b68038d5-a01a-49a2-bd73-80cec03e68f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3b1e4ff1-0894-482d-8026-808b67c58e83 req-4ff0a1a9-c3ad-4bc3-95bc-7dadcaaf58b3 service nova] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3b1e4ff1-0894-482d-8026-808b67c58e83 req-4ff0a1a9-c3ad-4bc3-95bc-7dadcaaf58b3 service nova] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:04 user nova-compute[74669]: DEBUG nova.compute.manager [req-3b1e4ff1-0894-482d-8026-808b67c58e83 req-4ff0a1a9-c3ad-4bc3-95bc-7dadcaaf58b3 service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] No waiting events found dispatching network-vif-plugged-aa24248f-00c5-4dd2-b439-b1d63068d37f {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:02:04 user nova-compute[74669]: WARNING nova.compute.manager [req-3b1e4ff1-0894-482d-8026-808b67c58e83 req-4ff0a1a9-c3ad-4bc3-95bc-7dadcaaf58b3 service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Received unexpected event network-vif-plugged-aa24248f-00c5-4dd2-b439-b1d63068d37f for instance with vm_state building and task_state spawning.
Nov 08 17:02:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:02:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:02:06 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Instance spawned successfully.
Nov 08 17:02:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:02:06 user nova-compute[74669]: DEBUG nova.compute.manager [req-f2a4a0ee-298e-47ed-81e3-4eaa72a3050e req-82474b97-4b54-4164-a508-ea490130622b service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Received event network-vif-plugged-aa24248f-00c5-4dd2-b439-b1d63068d37f {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:02:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f2a4a0ee-298e-47ed-81e3-4eaa72a3050e req-82474b97-4b54-4164-a508-ea490130622b service nova] Acquiring lock "b68038d5-a01a-49a2-bd73-80cec03e68f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f2a4a0ee-298e-47ed-81e3-4eaa72a3050e req-82474b97-4b54-4164-a508-ea490130622b service nova] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f2a4a0ee-298e-47ed-81e3-4eaa72a3050e req-82474b97-4b54-4164-a508-ea490130622b service nova] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:06 user nova-compute[74669]: DEBUG nova.compute.manager [req-f2a4a0ee-298e-47ed-81e3-4eaa72a3050e req-82474b97-4b54-4164-a508-ea490130622b service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] No waiting events found dispatching network-vif-plugged-aa24248f-00c5-4dd2-b439-b1d63068d37f {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:02:06 user nova-compute[74669]: WARNING nova.compute.manager [req-f2a4a0ee-298e-47ed-81e3-4eaa72a3050e req-82474b97-4b54-4164-a508-ea490130622b service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Received unexpected event network-vif-plugged-aa24248f-00c5-4dd2-b439-b1d63068d37f for instance with vm_state building and task_state spawning.
Nov 08 17:02:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:02:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:02:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:02:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:02:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:02:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:02:06 user nova-compute[74669]: INFO nova.compute.manager [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Took 6.48 seconds to spawn the instance on the hypervisor.
Nov 08 17:02:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:02:06 user nova-compute[74669]: INFO nova.compute.manager [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Took 10.73 seconds to build instance.
Nov 08 17:02:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0de7e60a-6848-4224-99b9-5c7898176fc1 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.937s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:08 user nova-compute[74669]: INFO nova.compute.manager [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] [instance: 0ce9072b-e003-4921-83bc-8f3449c09e14] Took 35.19 seconds to detach 3 volumes for instance.
Nov 08 17:02:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Acquiring lock "46df3fed-e88a-45ed-a05e-2fb2f1bf017c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Lock "46df3fed-e88a-45ed-a05e-2fb2f1bf017c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Acquiring lock "46df3fed-e88a-45ed-a05e-2fb2f1bf017c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Lock "46df3fed-e88a-45ed-a05e-2fb2f1bf017c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Lock "46df3fed-e88a-45ed-a05e-2fb2f1bf017c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:08 user nova-compute[74669]: INFO nova.compute.manager [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Terminating instance
Nov 08 17:02:08 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:02:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:08 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:02:09 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:02:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.609s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:09 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Deleted allocations for instance 0ce9072b-e003-4921-83bc-8f3449c09e14
Nov 08 17:02:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-66e9d2cd-6f7f-433c-9702-de8ea3bb56b4 req-963eebf3-97d4-445e-a466-772c83c813de service nova] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Received event network-vif-unplugged-4f341664-0a50-41a2-8f1d-9732a3a77907 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:02:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-66e9d2cd-6f7f-433c-9702-de8ea3bb56b4 req-963eebf3-97d4-445e-a466-772c83c813de service nova] Acquiring lock "46df3fed-e88a-45ed-a05e-2fb2f1bf017c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-66e9d2cd-6f7f-433c-9702-de8ea3bb56b4 req-963eebf3-97d4-445e-a466-772c83c813de service nova] Lock "46df3fed-e88a-45ed-a05e-2fb2f1bf017c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-66e9d2cd-6f7f-433c-9702-de8ea3bb56b4 req-963eebf3-97d4-445e-a466-772c83c813de service nova] Lock "46df3fed-e88a-45ed-a05e-2fb2f1bf017c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-66e9d2cd-6f7f-433c-9702-de8ea3bb56b4 req-963eebf3-97d4-445e-a466-772c83c813de service nova] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] No waiting events found dispatching network-vif-unplugged-4f341664-0a50-41a2-8f1d-9732a3a77907 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:02:09 user nova-compute[74669]: DEBUG nova.compute.manager [req-66e9d2cd-6f7f-433c-9702-de8ea3bb56b4 req-963eebf3-97d4-445e-a466-772c83c813de service nova] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Received event network-vif-unplugged-4f341664-0a50-41a2-8f1d-9732a3a77907 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:02:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0dd96aa0-8649-4d10-a35a-afd0e1905549 tempest-TaggedBootDevicesTest-1066904042 tempest-TaggedBootDevicesTest-1066904042-project-member] Lock "0ce9072b-e003-4921-83bc-8f3449c09e14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 43.818s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:09 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Instance destroyed successfully.
Nov 08 17:02:09 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Lazy-loading 'resources' on Instance uuid 46df3fed-e88a-45ed-a05e-2fb2f1bf017c {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:02:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:00:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-450773641',display_name='tempest-VolumesNegativeTest-instance-450773641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-450773641',id=20,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:00:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af8f4d7d37534880972312430acb9807',ramdisk_id='',reservation_id='r-l590iw2t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1242653964',owner_user_name='tempest-VolumesNegativeTest-1242653964-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:00:26Z,user_data=None,user_id='e485d1d0937e45c2850f98520b208756',uuid=46df3fed-e88a-45ed-a05e-2fb2f1bf017c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f341664-0a50-41a2-8f1d-9732a3a77907", "address": "fa:16:3e:c5:5b:d8", "network": {"id": "2f4a5a1d-142b-4985-a492-a6c78609683a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "79496da39fb84da59931e2879cd9367e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f341664-0a", "ovs_interfaceid": "4f341664-0a50-41a2-8f1d-9732a3a77907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:02:09 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Converting VIF {"id": "4f341664-0a50-41a2-8f1d-9732a3a77907", "address": "fa:16:3e:c5:5b:d8", "network": {"id": "2f4a5a1d-142b-4985-a492-a6c78609683a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "79496da39fb84da59931e2879cd9367e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f341664-0a", "ovs_interfaceid": "4f341664-0a50-41a2-8f1d-9732a3a77907", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:02:09 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:5b:d8,bridge_name='br-int',has_traffic_filtering=True,id=4f341664-0a50-41a2-8f1d-9732a3a77907,network=Network(2f4a5a1d-142b-4985-a492-a6c78609683a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f341664-0a') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:02:09 user nova-compute[74669]: DEBUG os_vif [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:5b:d8,bridge_name='br-int',has_traffic_filtering=True,id=4f341664-0a50-41a2-8f1d-9732a3a77907,network=Network(2f4a5a1d-142b-4985-a492-a6c78609683a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f341664-0a') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:02:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f341664-0a, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:02:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e9b78f3-3120-4df1-9369-2f672c6a775c) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:02:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:02:09 user nova-compute[74669]: INFO os_vif [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:5b:d8,bridge_name='br-int',has_traffic_filtering=True,id=4f341664-0a50-41a2-8f1d-9732a3a77907,network=Network(2f4a5a1d-142b-4985-a492-a6c78609683a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f341664-0a')
Nov 08 17:02:09 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Deleting instance files /opt/stack/data/nova/instances/46df3fed-e88a-45ed-a05e-2fb2f1bf017c_del
Nov 08 17:02:09 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Deletion of /opt/stack/data/nova/instances/46df3fed-e88a-45ed-a05e-2fb2f1bf017c_del complete
Nov 08 17:02:09 user nova-compute[74669]: INFO nova.compute.manager [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 08 17:02:09 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:02:09 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:02:09 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:02:10 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:02:10 user nova-compute[74669]: DEBUG nova.compute.manager [req-e3ea0314-d66a-4724-aa03-455fccb6441f req-f0889397-9684-4dcc-85d1-0c7c0553729c service nova] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Received event network-vif-deleted-4f341664-0a50-41a2-8f1d-9732a3a77907 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:02:10 user nova-compute[74669]: INFO nova.compute.manager [req-e3ea0314-d66a-4724-aa03-455fccb6441f req-f0889397-9684-4dcc-85d1-0c7c0553729c service nova] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Neutron deleted interface 4f341664-0a50-41a2-8f1d-9732a3a77907; detaching it from the instance and deleting it from the info cache
Nov 08 17:02:10 user nova-compute[74669]: DEBUG nova.network.neutron [req-e3ea0314-d66a-4724-aa03-455fccb6441f req-f0889397-9684-4dcc-85d1-0c7c0553729c service nova] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:02:10 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Took 0.81 seconds to deallocate network for instance.
Nov 08 17:02:10 user nova-compute[74669]: DEBUG nova.compute.manager [req-e3ea0314-d66a-4724-aa03-455fccb6441f req-f0889397-9684-4dcc-85d1-0c7c0553729c service nova] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Detach interface failed, port_id=4f341664-0a50-41a2-8f1d-9732a3a77907, reason: Instance 46df3fed-e88a-45ed-a05e-2fb2f1bf017c could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 17:02:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:10 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:02:10 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:02:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:11 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Deleted allocations for instance 46df3fed-e88a-45ed-a05e-2fb2f1bf017c
Nov 08 17:02:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d33be7cf-9d4c-44d2-8ffa-14babe25f37c tempest-VolumesNegativeTest-1242653964 tempest-VolumesNegativeTest-1242653964-project-member] Lock "46df3fed-e88a-45ed-a05e-2fb2f1bf017c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.523s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:11 user nova-compute[74669]: DEBUG nova.compute.manager [req-fdf158c0-a50b-42de-b72d-653a1b3b94ca req-a2e68950-312c-4307-bfc1-25939760ea27 service nova] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Received event network-vif-plugged-4f341664-0a50-41a2-8f1d-9732a3a77907 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:02:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-fdf158c0-a50b-42de-b72d-653a1b3b94ca req-a2e68950-312c-4307-bfc1-25939760ea27 service nova] Acquiring lock "46df3fed-e88a-45ed-a05e-2fb2f1bf017c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-fdf158c0-a50b-42de-b72d-653a1b3b94ca req-a2e68950-312c-4307-bfc1-25939760ea27 service nova] Lock "46df3fed-e88a-45ed-a05e-2fb2f1bf017c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-fdf158c0-a50b-42de-b72d-653a1b3b94ca req-a2e68950-312c-4307-bfc1-25939760ea27 service nova] Lock "46df3fed-e88a-45ed-a05e-2fb2f1bf017c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:11 user nova-compute[74669]: DEBUG nova.compute.manager [req-fdf158c0-a50b-42de-b72d-653a1b3b94ca req-a2e68950-312c-4307-bfc1-25939760ea27 service nova] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] No waiting events found dispatching network-vif-plugged-4f341664-0a50-41a2-8f1d-9732a3a77907 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:02:11 user nova-compute[74669]: WARNING nova.compute.manager [req-fdf158c0-a50b-42de-b72d-653a1b3b94ca req-a2e68950-312c-4307-bfc1-25939760ea27 service nova] [instance: 46df3fed-e88a-45ed-a05e-2fb2f1bf017c] Received unexpected event network-vif-plugged-4f341664-0a50-41a2-8f1d-9732a3a77907 for instance with vm_state deleted and task_state None.
Nov 08 17:02:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxGuTvRm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:02:27 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:02:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:02:27 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:02:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:02:27 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5042676-70ba-42ce-a104-a1b3518623cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:02:27 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0573de-6e00-44e8-a40c-8d39985e25fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f] added
Nov 08 17:02:27 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e4f65c-fad3-4b6b-9720-36edd3280d52]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed2e32c-f573-46c3-96a2-37858efe512a]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XxGuTvRm {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XxGuTvRm" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[86060556-5d1f-4ea2-872e-82aa7e339c7e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XxGuTvRm'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4da33d2-e483-4b83-92e5-59cc6bf6b375]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0791f8-4ebd-4c23-966c-8c482398c136]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:02:27 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:02:27 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3141251-52fa-474f-ba2b-faa0776e492d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f, portal: 172.16.0.220,3260]
Nov 08 17:02:27 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f, portal: 172.16.0.220,3260] successful.
Nov 08 17:02:27 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[950e9f4c-837f-4c8f-896e-430a13d8fd45]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ad5f61-9c2b-4734-a97f-7985bee7746c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:02:27 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:02:27 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:02:27 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:02:27 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8b4e2e-bf9b-444f-a657-4b734e5a6fba]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:27 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: None {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:02:28 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:02:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxGuTvRm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:02:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:02:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23264306631383831', 'path': '/dev/sdc'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:02:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264306631383831', 'path': '/dev/sdc'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:02:28 user nova-compute[74669]: DEBUG nova.objects.instance [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lazy-loading 'flavor' on Instance uuid b8bfb971-094b-46cf-b8bd-ba3df8994e7a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:02:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 17:02:28 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:02:28 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 17:02:28 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:02:28 user nova-compute[74669]:   <serial>3869521d-313b-4af0-b0c0-d58d213ec41f</serial>
Nov 08 17:02:28 user nova-compute[74669]: </disk>
Nov 08 17:02:28 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 17:02:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:02:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:02:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] No VIF found with MAC fa:16:3e:93:f5:4a, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:02:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6a8cbd05-3661-4096-ba10-5c3a7c644c0b tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.416s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:31 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:32 user nova-compute[74669]: DEBUG nova.compute.manager [req-09dbb841-7ca4-48fa-8019-e82d048075bb req-63dbcdcb-6a7e-4b00-b5a1-31601680acef service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Received event network-changed-6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:02:32 user nova-compute[74669]: DEBUG nova.compute.manager [req-09dbb841-7ca4-48fa-8019-e82d048075bb req-63dbcdcb-6a7e-4b00-b5a1-31601680acef service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Refreshing instance network info cache due to event network-changed-6582b38d-2366-43fe-9a2b-6990e7bc165b. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:02:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-09dbb841-7ca4-48fa-8019-e82d048075bb req-63dbcdcb-6a7e-4b00-b5a1-31601680acef service nova] Acquiring lock "refresh_cache-b8bfb971-094b-46cf-b8bd-ba3df8994e7a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:02:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-09dbb841-7ca4-48fa-8019-e82d048075bb req-63dbcdcb-6a7e-4b00-b5a1-31601680acef service nova] Acquired lock "refresh_cache-b8bfb971-094b-46cf-b8bd-ba3df8994e7a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:02:32 user nova-compute[74669]: DEBUG nova.network.neutron [req-09dbb841-7ca4-48fa-8019-e82d048075bb req-63dbcdcb-6a7e-4b00-b5a1-31601680acef service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Refreshing network info cache for port 6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG nova.compute.manager [req-453405db-64b3-4d9e-a616-f21e1caf9220 req-72c66763-d18c-431b-8496-a9b49f4caef3 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Received event network-changed-cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG nova.compute.manager [req-453405db-64b3-4d9e-a616-f21e1caf9220 req-72c66763-d18c-431b-8496-a9b49f4caef3 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Refreshing instance network info cache due to event network-changed-cd57159a-b86e-4130-ad82-ddaa0fb63501. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-453405db-64b3-4d9e-a616-f21e1caf9220 req-72c66763-d18c-431b-8496-a9b49f4caef3 service nova] Acquiring lock "refresh_cache-d91eaa51-6bf4-40eb-9f36-f8e838501373" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-453405db-64b3-4d9e-a616-f21e1caf9220 req-72c66763-d18c-431b-8496-a9b49f4caef3 service nova] Acquired lock "refresh_cache-d91eaa51-6bf4-40eb-9f36-f8e838501373" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG nova.network.neutron [req-453405db-64b3-4d9e-a616-f21e1caf9220 req-72c66763-d18c-431b-8496-a9b49f4caef3 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Refreshing network info cache for port cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG nova.network.neutron [req-09dbb841-7ca4-48fa-8019-e82d048075bb req-63dbcdcb-6a7e-4b00-b5a1-31601680acef service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Updated VIF entry in instance network info cache for port 6582b38d-2366-43fe-9a2b-6990e7bc165b. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG nova.network.neutron [req-09dbb841-7ca4-48fa-8019-e82d048075bb req-63dbcdcb-6a7e-4b00-b5a1-31601680acef service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Updating instance_info_cache with network_info: [{"id": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "address": "fa:16:3e:93:f5:4a", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6582b38d-23", "ovs_interfaceid": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-09dbb841-7ca4-48fa-8019-e82d048075bb req-63dbcdcb-6a7e-4b00-b5a1-31601680acef service nova] Releasing lock "refresh_cache-b8bfb971-094b-46cf-b8bd-ba3df8994e7a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "d91eaa51-6bf4-40eb-9f36-f8e838501373" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG nova.objects.instance [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lazy-loading 'flavor' on Instance uuid d91eaa51-6bf4-40eb-9f36-f8e838501373 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG nova.network.neutron [req-453405db-64b3-4d9e-a616-f21e1caf9220 req-72c66763-d18c-431b-8496-a9b49f4caef3 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Updated VIF entry in instance network info cache for port cd57159a-b86e-4130-ad82-ddaa0fb63501. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG nova.network.neutron [req-453405db-64b3-4d9e-a616-f21e1caf9220 req-72c66763-d18c-431b-8496-a9b49f4caef3 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Updating instance_info_cache with network_info: [{"id": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "address": "fa:16:3e:96:ba:06", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd57159a-b8", "ovs_interfaceid": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-453405db-64b3-4d9e-a616-f21e1caf9220 req-72c66763-d18c-431b-8496-a9b49f4caef3 service nova] Releasing lock "refresh_cache-d91eaa51-6bf4-40eb-9f36-f8e838501373" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "d91eaa51-6bf4-40eb-9f36-f8e838501373" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:33 user nova-compute[74669]: INFO nova.compute.manager [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Attaching volume 401a6af6-7e53-4335-86e5-d8ed8671b7e6 to /dev/vdb
Nov 08 17:02:33 user nova-compute[74669]: DEBUG os_brick.utils [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b81f42d-30d0-4245-9858-36059306c3ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[110afcdc-ed70-42f1-a99b-0b69df02703d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc2ea74-6f7d-4c07-9fd3-0dff6a2a3bfb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c4a287-dd91-47af-94da-ca47502943ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:02:33 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:02:33 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0cc7a4-05a4-4776-8589-6fe1bf116fb9]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG os_brick.utils [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:02:33 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Updating existing volume attachment record: 38b31878-04eb-440b-86cb-61ac5637f1fb {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:02:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:35 user nova-compute[74669]: DEBUG nova.compute.manager [req-1982b3f8-fae6-4c31-8af8-11b38d31e26c req-fd32674a-5c1e-4bb3-8f7c-7a9d57edde8e service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Received event network-changed-6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:02:35 user nova-compute[74669]: DEBUG nova.compute.manager [req-1982b3f8-fae6-4c31-8af8-11b38d31e26c req-fd32674a-5c1e-4bb3-8f7c-7a9d57edde8e service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Refreshing instance network info cache due to event network-changed-6582b38d-2366-43fe-9a2b-6990e7bc165b. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:02:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1982b3f8-fae6-4c31-8af8-11b38d31e26c req-fd32674a-5c1e-4bb3-8f7c-7a9d57edde8e service nova] Acquiring lock "refresh_cache-b8bfb971-094b-46cf-b8bd-ba3df8994e7a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:02:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1982b3f8-fae6-4c31-8af8-11b38d31e26c req-fd32674a-5c1e-4bb3-8f7c-7a9d57edde8e service nova] Acquired lock "refresh_cache-b8bfb971-094b-46cf-b8bd-ba3df8994e7a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:02:35 user nova-compute[74669]: DEBUG nova.network.neutron [req-1982b3f8-fae6-4c31-8af8-11b38d31e26c req-fd32674a-5c1e-4bb3-8f7c-7a9d57edde8e service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Refreshing network info cache for port 6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:02:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-99703af3-6ae1-4de0-8eb3-9aa3a0416db4 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-99703af3-6ae1-4de0-8eb3-9aa3a0416db4 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:36 user nova-compute[74669]: INFO nova.compute.manager [None req-99703af3-6ae1-4de0-8eb3-9aa3a0416db4 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Rebooting instance
Nov 08 17:02:36 user nova-compute[74669]: DEBUG nova.network.neutron [req-1982b3f8-fae6-4c31-8af8-11b38d31e26c req-fd32674a-5c1e-4bb3-8f7c-7a9d57edde8e service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Updated VIF entry in instance network info cache for port 6582b38d-2366-43fe-9a2b-6990e7bc165b. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:02:36 user nova-compute[74669]: DEBUG nova.network.neutron [req-1982b3f8-fae6-4c31-8af8-11b38d31e26c req-fd32674a-5c1e-4bb3-8f7c-7a9d57edde8e service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Updating instance_info_cache with network_info: [{"id": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "address": "fa:16:3e:93:f5:4a", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6582b38d-23", "ovs_interfaceid": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:02:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1982b3f8-fae6-4c31-8af8-11b38d31e26c req-fd32674a-5c1e-4bb3-8f7c-7a9d57edde8e service nova] Releasing lock "refresh_cache-b8bfb971-094b-46cf-b8bd-ba3df8994e7a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:02:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-99703af3-6ae1-4de0-8eb3-9aa3a0416db4 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "refresh_cache-b8bfb971-094b-46cf-b8bd-ba3df8994e7a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:02:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-99703af3-6ae1-4de0-8eb3-9aa3a0416db4 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquired lock "refresh_cache-b8bfb971-094b-46cf-b8bd-ba3df8994e7a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:02:36 user nova-compute[74669]: DEBUG nova.network.neutron [None req-99703af3-6ae1-4de0-8eb3-9aa3a0416db4 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:02:37 user nova-compute[74669]: DEBUG nova.network.neutron [None req-99703af3-6ae1-4de0-8eb3-9aa3a0416db4 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Updating instance_info_cache with network_info: [{"id": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "address": "fa:16:3e:93:f5:4a", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6582b38d-23", "ovs_interfaceid": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:02:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-99703af3-6ae1-4de0-8eb3-9aa3a0416db4 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Releasing lock "refresh_cache-b8bfb971-094b-46cf-b8bd-ba3df8994e7a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:02:37 user nova-compute[74669]: DEBUG nova.compute.manager [None req-99703af3-6ae1-4de0-8eb3-9aa3a0416db4 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:02:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:40 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-99703af3-6ae1-4de0-8eb3-9aa3a0416db4 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Instance shutdown successfully.
Nov 08 17:02:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:44 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Instance running successfully.
Nov 08 17:02:44 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-99703af3-6ae1-4de0-8eb3-9aa3a0416db4 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Instance soft rebooted successfully.
Nov 08 17:02:44 user nova-compute[74669]: DEBUG nova.compute.manager [None req-99703af3-6ae1-4de0-8eb3-9aa3a0416db4 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:02:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-99703af3-6ae1-4de0-8eb3-9aa3a0416db4 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.454s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:45 user nova-compute[74669]: DEBUG nova.compute.manager [req-12de8819-ea51-4d68-b1d4-65bcee779833 req-3e241305-5511-4692-8691-af05e6b65c2b service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Received event network-vif-unplugged-6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:02:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-12de8819-ea51-4d68-b1d4-65bcee779833 req-3e241305-5511-4692-8691-af05e6b65c2b service nova] Acquiring lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-12de8819-ea51-4d68-b1d4-65bcee779833 req-3e241305-5511-4692-8691-af05e6b65c2b service nova] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-12de8819-ea51-4d68-b1d4-65bcee779833 req-3e241305-5511-4692-8691-af05e6b65c2b service nova] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:45 user nova-compute[74669]: DEBUG nova.compute.manager [req-12de8819-ea51-4d68-b1d4-65bcee779833 req-3e241305-5511-4692-8691-af05e6b65c2b service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] No waiting events found dispatching network-vif-unplugged-6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:02:45 user nova-compute[74669]: WARNING nova.compute.manager [req-12de8819-ea51-4d68-b1d4-65bcee779833 req-3e241305-5511-4692-8691-af05e6b65c2b service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Received unexpected event network-vif-unplugged-6582b38d-2366-43fe-9a2b-6990e7bc165b for instance with vm_state active and task_state None.
Nov 08 17:02:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-62750d98-69ac-4442-9d91-f19395372c48 req-7512f94f-1d3e-4519-9388-993fff976f5f service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Received event network-vif-plugged-6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:02:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-62750d98-69ac-4442-9d91-f19395372c48 req-7512f94f-1d3e-4519-9388-993fff976f5f service nova] Acquiring lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-62750d98-69ac-4442-9d91-f19395372c48 req-7512f94f-1d3e-4519-9388-993fff976f5f service nova] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-62750d98-69ac-4442-9d91-f19395372c48 req-7512f94f-1d3e-4519-9388-993fff976f5f service nova] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-62750d98-69ac-4442-9d91-f19395372c48 req-7512f94f-1d3e-4519-9388-993fff976f5f service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] No waiting events found dispatching network-vif-plugged-6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:02:47 user nova-compute[74669]: WARNING nova.compute.manager [req-62750d98-69ac-4442-9d91-f19395372c48 req-7512f94f-1d3e-4519-9388-993fff976f5f service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Received unexpected event network-vif-plugged-6582b38d-2366-43fe-9a2b-6990e7bc165b for instance with vm_state active and task_state None.
Nov 08 17:02:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-62750d98-69ac-4442-9d91-f19395372c48 req-7512f94f-1d3e-4519-9388-993fff976f5f service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Received event network-vif-plugged-6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:02:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-62750d98-69ac-4442-9d91-f19395372c48 req-7512f94f-1d3e-4519-9388-993fff976f5f service nova] Acquiring lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-62750d98-69ac-4442-9d91-f19395372c48 req-7512f94f-1d3e-4519-9388-993fff976f5f service nova] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-62750d98-69ac-4442-9d91-f19395372c48 req-7512f94f-1d3e-4519-9388-993fff976f5f service nova] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-62750d98-69ac-4442-9d91-f19395372c48 req-7512f94f-1d3e-4519-9388-993fff976f5f service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] No waiting events found dispatching network-vif-plugged-6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:02:47 user nova-compute[74669]: WARNING nova.compute.manager [req-62750d98-69ac-4442-9d91-f19395372c48 req-7512f94f-1d3e-4519-9388-993fff976f5f service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Received unexpected event network-vif-plugged-6582b38d-2366-43fe-9a2b-6990e7bc165b for instance with vm_state active and task_state None.
Nov 08 17:02:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-62750d98-69ac-4442-9d91-f19395372c48 req-7512f94f-1d3e-4519-9388-993fff976f5f service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Received event network-vif-plugged-6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:02:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-62750d98-69ac-4442-9d91-f19395372c48 req-7512f94f-1d3e-4519-9388-993fff976f5f service nova] Acquiring lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-62750d98-69ac-4442-9d91-f19395372c48 req-7512f94f-1d3e-4519-9388-993fff976f5f service nova] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-62750d98-69ac-4442-9d91-f19395372c48 req-7512f94f-1d3e-4519-9388-993fff976f5f service nova] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-62750d98-69ac-4442-9d91-f19395372c48 req-7512f94f-1d3e-4519-9388-993fff976f5f service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] No waiting events found dispatching network-vif-plugged-6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:02:47 user nova-compute[74669]: WARNING nova.compute.manager [req-62750d98-69ac-4442-9d91-f19395372c48 req-7512f94f-1d3e-4519-9388-993fff976f5f service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Received unexpected event network-vif-plugged-6582b38d-2366-43fe-9a2b-6990e7bc165b for instance with vm_state active and task_state None.
Nov 08 17:02:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:50 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:02:50 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:02:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:02:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:02:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:02:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:51 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:02:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:02:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:02:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rnVoAlum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:02:57 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:02:57 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:02:57 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:02:57 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:02:57 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:02:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=7437MB free_disk=25.359447479248047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7d5535-ed4f-4f12-b935-c048a734c094]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:02:57 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[813bd73f-6a98-4651-9104-52843def4c59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4] added
Nov 08 17:02:57 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1db01e-90ae-4cc2-874a-872c4802e68b]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3a5c3c-587f-4cb9-8faf-45ca6a3cfed7]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rnVoAlum {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rnVoAlum" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59d6448-1f8c-4332-bc00-78c924b01a75]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rnVoAlum'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6c2234-5903-4de9-adf0-b2ba80728996]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7b335462-0d93-4899-a223-5c2e36932578 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b663cd16-12b5-48fc-886d-0a7d160faea5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance c20b4c52-94b1-4aed-98f0-ae228df81175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b8bfb971-094b-46cf-b8bd-ba3df8994e7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance d91eaa51-6bf4-40eb-9f36-f8e838501373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance ee7af599-1f24-4828-913f-5ba3687619df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b68038d5-a01a-49a2-bd73-80cec03e68f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[376e12a1-b83a-4ecd-b5fa-eafd590800bd]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:02:57 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:02:57 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:02:57 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:02:57 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fb88bc-212f-4533-a204-0ccfb048d7c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4, portal: 172.16.0.220,3260]
Nov 08 17:02:57 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4, portal: 172.16.0.220,3260] successful.
Nov 08 17:02:57 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a450d9-ff10-4cea-b47b-bd6f6ef036a6]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c4e7b9-19b0-45ad-9cd3-d40e3ebafe30]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:02:57 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:02:57 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:02:57 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:02:57 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:02:57 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:02:57 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54c84e1-3a27-4988-b42b-da286857f2c1]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rnVoAlum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:02:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:02:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23437623466623238', 'path': '/dev/sdd'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:02:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437623466623238', 'path': '/dev/sdd'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:02:58 user nova-compute[74669]: DEBUG nova.objects.instance [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lazy-loading 'flavor' on Instance uuid c20b4c52-94b1-4aed-98f0-ae228df81175 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:02:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 17:02:58 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:02:58 user nova-compute[74669]:   <source dev="/dev/sdd"/>
Nov 08 17:02:58 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:02:58 user nova-compute[74669]:   <serial>8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4</serial>
Nov 08 17:02:58 user nova-compute[74669]: </disk>
Nov 08 17:02:58 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 17:02:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:02:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:02:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] No VIF found with MAC fa:16:3e:62:af:a3, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:02:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b660041f-0e79-4526-80b1-2e750cfe3a6a tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 71.812s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:02:59 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:02:59 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:02:59 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:02:59 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:02:59 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 17:02:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:02:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:02:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:02:59 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:02:59 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lazy-loading 'info_cache' on Instance uuid e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:03:00 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Updating instance_info_cache with network_info: [{"id": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "address": "fa:16:3e:8f:9e:16", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b48f6d-e0", "ovs_interfaceid": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:03:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:03:00 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:03:00 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:03:00 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:03:00 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:03:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Acquiring lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:03:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:03:01 user nova-compute[74669]: INFO nova.compute.claims [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Claim successful on node user
Nov 08 17:03:02 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG nova.compute.manager [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG nova.compute.manager [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG nova.network.neutron [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:03:02 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:03:02 user nova-compute[74669]: DEBUG nova.compute.manager [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG nova.policy [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b443fd16646495790682d8ad338df57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5706466a59c34a878f3eafcebee088d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:03:02 user nova-compute[74669]: INFO nova.virt.block_device [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Booting with volume 27fd5c1d-4793-43c2-8ebf-f021e25b5a79 at /dev/vda
Nov 08 17:03:02 user nova-compute[74669]: DEBUG os_brick.utils [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a280481c-2576-4601-bae3-8c1e4b92922d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62bebf3-5178-4085-ba75-d2d863170504]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c13030f-b0d1-4585-a134-2f05cc193240]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7391fa3c-bcf2-46e0-a7d7-d2c85851da8f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:03:02 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:03:02 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e793cf-40c2-47cc-ac1c-0bb9576c44e0]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG os_brick.utils [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Updating existing volume attachment record: 44bbe2bc-58f8-46e7-b2b6-7d1d9be23a8b {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Acquiring lock "c20b4c52-94b1-4aed-98f0-ae228df81175" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG nova.objects.instance [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lazy-loading 'flavor' on Instance uuid c20b4c52-94b1-4aed-98f0-ae228df81175 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:03:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG nova.network.neutron [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Successfully created port: 3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Acquiring lock "c20b4c52-94b1-4aed-98f0-ae228df81175" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:03 user nova-compute[74669]: INFO nova.compute.manager [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Attaching volume 64cddd8a-22b3-4f43-b56e-d4fee84a13f8 to /dev/vdc
Nov 08 17:03:03 user nova-compute[74669]: DEBUG os_brick.utils [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[01510bbd-f571-494e-861a-52a808b64f16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[993304e5-8e35-40b8-b3c8-c375ecf0d28d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[529c9c00-5167-48c0-b1b2-9aabe9532da4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce930179-7724-43ab-b44e-f80665c351b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:03:03 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:03:03 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba8baec-94e0-4240-a012-80329f818b45]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG os_brick.utils [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:03:03 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Updating existing volume attachment record: 6cd42c15-0f43-4f5c-94d9-34fb4dc4a41b {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:03:04 user nova-compute[74669]: DEBUG nova.network.neutron [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Successfully updated port: 3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:03:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Acquiring lock "refresh_cache-5575cb2b-b93d-4048-bb96-c4cd7f19ee1d" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:03:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Acquired lock "refresh_cache-5575cb2b-b93d-4048-bb96-c4cd7f19ee1d" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:03:04 user nova-compute[74669]: DEBUG nova.network.neutron [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:03:04 user nova-compute[74669]: DEBUG nova.compute.manager [req-68900547-7234-400c-88a6-462dc6b7c131 req-8d9a08e9-eba8-4fac-aa2c-ecc7fd054917 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Received event network-changed-3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:03:04 user nova-compute[74669]: DEBUG nova.compute.manager [req-68900547-7234-400c-88a6-462dc6b7c131 req-8d9a08e9-eba8-4fac-aa2c-ecc7fd054917 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Refreshing instance network info cache due to event network-changed-3021424c-2541-449d-b3f8-ffca35fdb364. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:03:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-68900547-7234-400c-88a6-462dc6b7c131 req-8d9a08e9-eba8-4fac-aa2c-ecc7fd054917 service nova] Acquiring lock "refresh_cache-5575cb2b-b93d-4048-bb96-c4cd7f19ee1d" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:03:04 user nova-compute[74669]: DEBUG nova.network.neutron [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:03:04 user nova-compute[74669]: DEBUG nova.network.neutron [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Updating instance_info_cache with network_info: [{"id": "3021424c-2541-449d-b3f8-ffca35fdb364", "address": "fa:16:3e:6f:e9:d8", "network": {"id": "2b28db73-56c6-4cc7-95de-75ec297a7809", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-839594529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5706466a59c34a878f3eafcebee088d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3021424c-25", "ovs_interfaceid": "3021424c-2541-449d-b3f8-ffca35fdb364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:03:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Releasing lock "refresh_cache-5575cb2b-b93d-4048-bb96-c4cd7f19ee1d" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:03:04 user nova-compute[74669]: DEBUG nova.compute.manager [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Instance network_info: |[{"id": "3021424c-2541-449d-b3f8-ffca35fdb364", "address": "fa:16:3e:6f:e9:d8", "network": {"id": "2b28db73-56c6-4cc7-95de-75ec297a7809", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-839594529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5706466a59c34a878f3eafcebee088d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3021424c-25", "ovs_interfaceid": "3021424c-2541-449d-b3f8-ffca35fdb364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:03:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-68900547-7234-400c-88a6-462dc6b7c131 req-8d9a08e9-eba8-4fac-aa2c-ecc7fd054917 service nova] Acquired lock "refresh_cache-5575cb2b-b93d-4048-bb96-c4cd7f19ee1d" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:03:04 user nova-compute[74669]: DEBUG nova.network.neutron [req-68900547-7234-400c-88a6-462dc6b7c131 req-8d9a08e9-eba8-4fac-aa2c-ecc7fd054917 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Refreshing network info cache for port 3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:03:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:04 user nova-compute[74669]: DEBUG nova.network.neutron [req-68900547-7234-400c-88a6-462dc6b7c131 req-8d9a08e9-eba8-4fac-aa2c-ecc7fd054917 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Updated VIF entry in instance network info cache for port 3021424c-2541-449d-b3f8-ffca35fdb364. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:03:04 user nova-compute[74669]: DEBUG nova.network.neutron [req-68900547-7234-400c-88a6-462dc6b7c131 req-8d9a08e9-eba8-4fac-aa2c-ecc7fd054917 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Updating instance_info_cache with network_info: [{"id": "3021424c-2541-449d-b3f8-ffca35fdb364", "address": "fa:16:3e:6f:e9:d8", "network": {"id": "2b28db73-56c6-4cc7-95de-75ec297a7809", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-839594529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5706466a59c34a878f3eafcebee088d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3021424c-25", "ovs_interfaceid": "3021424c-2541-449d-b3f8-ffca35fdb364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:03:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-68900547-7234-400c-88a6-462dc6b7c131 req-8d9a08e9-eba8-4fac-aa2c-ecc7fd054917 service nova] Releasing lock "refresh_cache-5575cb2b-b93d-4048-bb96-c4cd7f19ee1d" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:03:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egGBAMYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:03:19 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:03:19 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:03:19 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc27fef-2978-48a9-be5f-4bcd0539a9a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:03:19 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[becb70a6-fdf6-407b-99a8-3f7c03c4f11d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6] added
Nov 08 17:03:19 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0cbdfb-2b70-499d-ab5f-d9ac8a1440c0]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b2b706-d70d-4998-9f2f-6b48423215f7]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v egGBAMYT {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v egGBAMYT" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[533a5946-00dd-4a7a-b1e8-0a8e83660132]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'egGBAMYT'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eebd59d-0e9e-4327-bfde-a1fe090a227a]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9266dcf6-4385-4ad7-8bb5-acaf4831e8db]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:03:19 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:03:19 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:03:19 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:03:19 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:03:19 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:03:19 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8667270d-df4f-4858-8113-c445a725b72c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6, portal: 172.16.0.220,3260]
Nov 08 17:03:19 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6, portal: 172.16.0.220,3260] successful.
Nov 08 17:03:19 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a23423b-44fd-4bca-b922-44c8d1c9c2e9]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9112f1-d726-48ab-b1a9-27d427269bdf]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:03:19 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:03:19 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:03:19 user nova-compute[74669]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 (non-flash)
Nov 08 17:03:19 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:03:19 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:03:19 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:03:19 user nova-compute[74669]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 (non-flash)
Nov 08 17:03:19 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22af890-46f0-46dd-9869-4283486f3644]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egGBAMYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:03:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:03:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23533616633343865', 'path': '/dev/sde'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:03:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533616633343865', 'path': '/dev/sde'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:03:20 user nova-compute[74669]: DEBUG nova.objects.instance [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lazy-loading 'flavor' on Instance uuid d91eaa51-6bf4-40eb-9f36-f8e838501373 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:03:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 17:03:20 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:03:20 user nova-compute[74669]:   <source dev="/dev/sde"/>
Nov 08 17:03:20 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:03:20 user nova-compute[74669]:   <serial>401a6af6-7e53-4335-86e5-d8ed8671b7e6</serial>
Nov 08 17:03:20 user nova-compute[74669]: </disk>
Nov 08 17:03:20 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 17:03:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:03:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:03:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] No VIF found with MAC fa:16:3e:96:ba:06, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:03:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a9b7b03f-7ca9-4a1a-9a44-bd263856a194 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 47.617s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "d91eaa51-6bf4-40eb-9f36-f8e838501373" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:23 user nova-compute[74669]: INFO nova.compute.manager [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Detaching volume 401a6af6-7e53-4335-86e5-d8ed8671b7e6
Nov 08 17:03:23 user nova-compute[74669]: INFO nova.virt.block_device [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Attempting to driver detach volume 401a6af6-7e53-4335-86e5-d8ed8671b7e6 from mountpoint /dev/vdb
Nov 08 17:03:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Attempting to detach device vdb from instance d91eaa51-6bf4-40eb-9f36-f8e838501373 from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 17:03:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:03:23 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:03:23 user nova-compute[74669]:   <source dev="/dev/sde"/>
Nov 08 17:03:23 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:03:23 user nova-compute[74669]:   <serial>401a6af6-7e53-4335-86e5-d8ed8671b7e6</serial>
Nov 08 17:03:23 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:03:23 user nova-compute[74669]: </disk>
Nov 08 17:03:23 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:03:23 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Successfully detached device vdb from instance d91eaa51-6bf4-40eb-9f36-f8e838501373 from the persistent domain config.
Nov 08 17:03:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d91eaa51-6bf4-40eb-9f36-f8e838501373 from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 17:03:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:03:23 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:03:23 user nova-compute[74669]:   <source dev="/dev/sde"/>
Nov 08 17:03:23 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:03:23 user nova-compute[74669]:   <serial>401a6af6-7e53-4335-86e5-d8ed8671b7e6</serial>
Nov 08 17:03:23 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:03:23 user nova-compute[74669]: </disk>
Nov 08 17:03:23 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:03:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d91eaa51-6bf4-40eb-9f36-f8e838501373 {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 17:03:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-64a3514c-5f14-4f51-900c-20d86c1e31ff req-47bdbd11-e427-4d9b-93b8-5dfb5fa93a4d service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Received event network-changed-ec94ef8c-0c4b-4578-99cd-a00aab4aa569 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:03:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-64a3514c-5f14-4f51-900c-20d86c1e31ff req-47bdbd11-e427-4d9b-93b8-5dfb5fa93a4d service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Refreshing instance network info cache due to event network-changed-ec94ef8c-0c4b-4578-99cd-a00aab4aa569. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:03:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-64a3514c-5f14-4f51-900c-20d86c1e31ff req-47bdbd11-e427-4d9b-93b8-5dfb5fa93a4d service nova] Acquiring lock "refresh_cache-ee7af599-1f24-4828-913f-5ba3687619df" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:03:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-64a3514c-5f14-4f51-900c-20d86c1e31ff req-47bdbd11-e427-4d9b-93b8-5dfb5fa93a4d service nova] Acquired lock "refresh_cache-ee7af599-1f24-4828-913f-5ba3687619df" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:03:28 user nova-compute[74669]: DEBUG nova.network.neutron [req-64a3514c-5f14-4f51-900c-20d86c1e31ff req-47bdbd11-e427-4d9b-93b8-5dfb5fa93a4d service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Refreshing network info cache for port ec94ef8c-0c4b-4578-99cd-a00aab4aa569 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:03:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-283a02b2-ab7f-4e6b-a479-c7a4c205e8ab tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "ee7af599-1f24-4828-913f-5ba3687619df" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-283a02b2-ab7f-4e6b-a479-c7a4c205e8ab tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "ee7af599-1f24-4828-913f-5ba3687619df" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:29 user nova-compute[74669]: DEBUG nova.objects.instance [None req-283a02b2-ab7f-4e6b-a479-c7a4c205e8ab tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lazy-loading 'flavor' on Instance uuid ee7af599-1f24-4828-913f-5ba3687619df {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:03:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-283a02b2-ab7f-4e6b-a479-c7a4c205e8ab tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "ee7af599-1f24-4828-913f-5ba3687619df" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:29 user nova-compute[74669]: DEBUG nova.network.neutron [req-64a3514c-5f14-4f51-900c-20d86c1e31ff req-47bdbd11-e427-4d9b-93b8-5dfb5fa93a4d service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Updated VIF entry in instance network info cache for port ec94ef8c-0c4b-4578-99cd-a00aab4aa569. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:03:29 user nova-compute[74669]: DEBUG nova.network.neutron [req-64a3514c-5f14-4f51-900c-20d86c1e31ff req-47bdbd11-e427-4d9b-93b8-5dfb5fa93a4d service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Updating instance_info_cache with network_info: [{"id": "ec94ef8c-0c4b-4578-99cd-a00aab4aa569", "address": "fa:16:3e:4e:de:98", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec94ef8c-0c", "ovs_interfaceid": "ec94ef8c-0c4b-4578-99cd-a00aab4aa569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:03:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-64a3514c-5f14-4f51-900c-20d86c1e31ff req-47bdbd11-e427-4d9b-93b8-5dfb5fa93a4d service nova] Releasing lock "refresh_cache-ee7af599-1f24-4828-913f-5ba3687619df" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:03:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-283a02b2-ab7f-4e6b-a479-c7a4c205e8ab tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "ee7af599-1f24-4828-913f-5ba3687619df" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-283a02b2-ab7f-4e6b-a479-c7a4c205e8ab tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "ee7af599-1f24-4828-913f-5ba3687619df" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:29 user nova-compute[74669]: INFO nova.compute.manager [None req-283a02b2-ab7f-4e6b-a479-c7a4c205e8ab tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Attaching volume 7cbcefa3-d07e-4d66-a0e2-24d1d47630af to /dev/vdb
Nov 08 17:03:29 user nova-compute[74669]: DEBUG os_brick.utils [None req-283a02b2-ab7f-4e6b-a479-c7a4c205e8ab tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:03:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[31be9d73-8073-48e3-bb87-2856ff2d2771]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d810bc-e80c-478e-bd26-895a98850ca4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c588381-7bf5-423a-8290-5811f746d0ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bd7313-ce53-4b9b-9f5c-31d56822711b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-283a02b2-ab7f-4e6b-a479-c7a4c205e8ab tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-283a02b2-ab7f-4e6b-a479-c7a4c205e8ab tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:03:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-283a02b2-ab7f-4e6b-a479-c7a4c205e8ab tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:03:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:03:30 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:03:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4df684-f90f-41bb-82ab-8dae1a4aa1ba]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-283a02b2-ab7f-4e6b-a479-c7a4c205e8ab tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:03:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-283a02b2-ab7f-4e6b-a479-c7a4c205e8ab tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:03:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-283a02b2-ab7f-4e6b-a479-c7a4c205e8ab tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:03:30 user nova-compute[74669]: DEBUG os_brick.utils [None req-283a02b2-ab7f-4e6b-a479-c7a4c205e8ab tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:03:30 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-283a02b2-ab7f-4e6b-a479-c7a4c205e8ab tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Updating existing volume attachment record: a325a990-d238-432c-9519-7d0cab69e7ed {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:03:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:37 user nova-compute[74669]: DEBUG nova.compute.manager [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:03:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:03:38 user nova-compute[74669]: INFO nova.compute.claims [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Claim successful on node user
Nov 08 17:03:38 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:03:38 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:03:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:03:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:03:38 user nova-compute[74669]: DEBUG nova.network.neutron [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:03:38 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:03:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:03:38 user nova-compute[74669]: DEBUG nova.policy [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80fd41a7ea7943e6a913c211f6ea2d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7febf2b00147cfb989380452aba869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:03:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:03:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:03:38 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Creating image(s)
Nov 08 17:03:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "/opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "/opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "/opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.185s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.195s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk 1073741824" returned: 0 in 0.057s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG nova.network.neutron [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Successfully created port: d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.193s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Cannot resize image /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Ensure instance console log exists: /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG nova.network.neutron [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Successfully updated port: d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "refresh_cache-af8b58ff-90d5-4a04-844a-ac0534a7e413" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquired lock "refresh_cache-af8b58ff-90d5-4a04-844a-ac0534a7e413" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG nova.network.neutron [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG nova.compute.manager [req-5857b154-f38f-4f04-8dbe-91bff15674d6 req-b993c166-85ad-4987-93c3-ec75f421ddfa service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received event network-changed-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG nova.compute.manager [req-5857b154-f38f-4f04-8dbe-91bff15674d6 req-b993c166-85ad-4987-93c3-ec75f421ddfa service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Refreshing instance network info cache due to event network-changed-d0dc10aa-3fca-4242-8895-241190da8780. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5857b154-f38f-4f04-8dbe-91bff15674d6 req-b993c166-85ad-4987-93c3-ec75f421ddfa service nova] Acquiring lock "refresh_cache-af8b58ff-90d5-4a04-844a-ac0534a7e413" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:03:39 user nova-compute[74669]: DEBUG nova.network.neutron [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.network.neutron [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Updating instance_info_cache with network_info: [{"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Releasing lock "refresh_cache-af8b58ff-90d5-4a04-844a-ac0534a7e413" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.compute.manager [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Instance network_info: |[{"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5857b154-f38f-4f04-8dbe-91bff15674d6 req-b993c166-85ad-4987-93c3-ec75f421ddfa service nova] Acquired lock "refresh_cache-af8b58ff-90d5-4a04-844a-ac0534a7e413" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.network.neutron [req-5857b154-f38f-4f04-8dbe-91bff15674d6 req-b993c166-85ad-4987-93c3-ec75f421ddfa service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Refreshing network info cache for port d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Start _get_guest_xml network_info=[{"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:03:40 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:03:40 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:03:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-546386835',display_name='tempest-AttachVolumeTestJSON-server-546386835',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-546386835',id=25,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXViWU/BdYxMm5+lemyfZcP7+TCdB2OaD+dWs6IPD7DtEkJGE2tx2z335cOHjRlBjCNb0QrrgNRKB9Cr8JI7YWfGi7dauKEckz8JkFarm7hJu+kJ/zQZH4rAL4xDCaMWg==',key_name='tempest-keypair-1427520299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a7febf2b00147cfb989380452aba869',ramdisk_id='',reservation_id='r-l53uvaaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-275457186',owner_user_name='tempest-AttachVolumeTestJSON-275457186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:03:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fd41a7ea7943e6a913c211f6ea2d52',uuid=af8b58ff-90d5-4a04-844a-ac0534a7e413,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converting VIF {"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2d:67,bridge_name='br-int',has_traffic_filtering=True,id=d0dc10aa-3fca-4242-8895-241190da8780,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dc10aa-3f') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.objects.instance [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'pci_devices' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:03:40 user nova-compute[74669]:   <uuid>af8b58ff-90d5-4a04-844a-ac0534a7e413</uuid>
Nov 08 17:03:40 user nova-compute[74669]:   <name>instance-00000019</name>
Nov 08 17:03:40 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:03:40 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:03:40 user nova-compute[74669]:   <metadata>
Nov 08 17:03:40 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:03:40 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:03:40 user nova-compute[74669]:       <nova:name>tempest-AttachVolumeTestJSON-server-546386835</nova:name>
Nov 08 17:03:40 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:03:40</nova:creationTime>
Nov 08 17:03:40 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:03:40 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:03:40 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:03:40 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:03:40 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:03:40 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:03:40 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:03:40 user nova-compute[74669]:       <nova:owner>
Nov 08 17:03:40 user nova-compute[74669]:         <nova:user uuid="80fd41a7ea7943e6a913c211f6ea2d52">tempest-AttachVolumeTestJSON-275457186-project-member</nova:user>
Nov 08 17:03:40 user nova-compute[74669]:         <nova:project uuid="5a7febf2b00147cfb989380452aba869">tempest-AttachVolumeTestJSON-275457186</nova:project>
Nov 08 17:03:40 user nova-compute[74669]:       </nova:owner>
Nov 08 17:03:40 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:03:40 user nova-compute[74669]:       <nova:ports>
Nov 08 17:03:40 user nova-compute[74669]:         <nova:port uuid="d0dc10aa-3fca-4242-8895-241190da8780">
Nov 08 17:03:40 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 17:03:40 user nova-compute[74669]:         </nova:port>
Nov 08 17:03:40 user nova-compute[74669]:       </nova:ports>
Nov 08 17:03:40 user nova-compute[74669]:     </nova:instance>
Nov 08 17:03:40 user nova-compute[74669]:   </metadata>
Nov 08 17:03:40 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:03:40 user nova-compute[74669]:     <system>
Nov 08 17:03:40 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:03:40 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:03:40 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:03:40 user nova-compute[74669]:       <entry name="serial">af8b58ff-90d5-4a04-844a-ac0534a7e413</entry>
Nov 08 17:03:40 user nova-compute[74669]:       <entry name="uuid">af8b58ff-90d5-4a04-844a-ac0534a7e413</entry>
Nov 08 17:03:40 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:03:40 user nova-compute[74669]:     </system>
Nov 08 17:03:40 user nova-compute[74669]:   </sysinfo>
Nov 08 17:03:40 user nova-compute[74669]:   <os>
Nov 08 17:03:40 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:03:40 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:03:40 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:03:40 user nova-compute[74669]:   </os>
Nov 08 17:03:40 user nova-compute[74669]:   <features>
Nov 08 17:03:40 user nova-compute[74669]:     <acpi/>
Nov 08 17:03:40 user nova-compute[74669]:     <apic/>
Nov 08 17:03:40 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:03:40 user nova-compute[74669]:   </features>
Nov 08 17:03:40 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:03:40 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:03:40 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:03:40 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:03:40 user nova-compute[74669]:   </clock>
Nov 08 17:03:40 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:03:40 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:03:40 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:03:40 user nova-compute[74669]:   </cpu>
Nov 08 17:03:40 user nova-compute[74669]:   <devices>
Nov 08 17:03:40 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:03:40 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:03:40 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk"/>
Nov 08 17:03:40 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:03:40 user nova-compute[74669]:     </disk>
Nov 08 17:03:40 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:03:40 user nova-compute[74669]:       <mac address="fa:16:3e:4d:2d:67"/>
Nov 08 17:03:40 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:03:40 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:03:40 user nova-compute[74669]:       <target dev="tapd0dc10aa-3f"/>
Nov 08 17:03:40 user nova-compute[74669]:     </interface>
Nov 08 17:03:40 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:03:40 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/console.log" append="off"/>
Nov 08 17:03:40 user nova-compute[74669]:     </serial>
Nov 08 17:03:40 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:03:40 user nova-compute[74669]:     <video>
Nov 08 17:03:40 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:03:40 user nova-compute[74669]:     </video>
Nov 08 17:03:40 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:03:40 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:03:40 user nova-compute[74669]:     </rng>
Nov 08 17:03:40 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:03:40 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:03:40 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:03:40 user nova-compute[74669]:     </memballoon>
Nov 08 17:03:40 user nova-compute[74669]:   </devices>
Nov 08 17:03:40 user nova-compute[74669]: </domain>
Nov 08 17:03:40 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:03:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-546386835',display_name='tempest-AttachVolumeTestJSON-server-546386835',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-546386835',id=25,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXViWU/BdYxMm5+lemyfZcP7+TCdB2OaD+dWs6IPD7DtEkJGE2tx2z335cOHjRlBjCNb0QrrgNRKB9Cr8JI7YWfGi7dauKEckz8JkFarm7hJu+kJ/zQZH4rAL4xDCaMWg==',key_name='tempest-keypair-1427520299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a7febf2b00147cfb989380452aba869',ramdisk_id='',reservation_id='r-l53uvaaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-275457186',owner_user_name='tempest-AttachVolumeTestJSON-275457186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:03:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fd41a7ea7943e6a913c211f6ea2d52',uuid=af8b58ff-90d5-4a04-844a-ac0534a7e413,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converting VIF {"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2d:67,bridge_name='br-int',has_traffic_filtering=True,id=d0dc10aa-3fca-4242-8895-241190da8780,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dc10aa-3f') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG os_vif [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2d:67,bridge_name='br-int',has_traffic_filtering=True,id=d0dc10aa-3fca-4242-8895-241190da8780,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dc10aa-3f') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7bec5e43-b5a9-5f52-9259-a92ac9f34e2a', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0dc10aa-3f, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0dc10aa-3f, col_values=(('qos', UUID('44b64867-629f-487f-a8bc-99f52c01e306')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0dc10aa-3f, col_values=(('external_ids', {'iface-id': 'd0dc10aa-3fca-4242-8895-241190da8780', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:2d:67', 'vm-uuid': 'af8b58ff-90d5-4a04-844a-ac0534a7e413'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:40 user nova-compute[74669]: INFO os_vif [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2d:67,bridge_name='br-int',has_traffic_filtering=True,id=d0dc10aa-3fca-4242-8895-241190da8780,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dc10aa-3f')
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] No VIF found with MAC fa:16:3e:4d:2d:67, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.network.neutron [req-5857b154-f38f-4f04-8dbe-91bff15674d6 req-b993c166-85ad-4987-93c3-ec75f421ddfa service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Updated VIF entry in instance network info cache for port d0dc10aa-3fca-4242-8895-241190da8780. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG nova.network.neutron [req-5857b154-f38f-4f04-8dbe-91bff15674d6 req-b993c166-85ad-4987-93c3-ec75f421ddfa service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Updating instance_info_cache with network_info: [{"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:03:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5857b154-f38f-4f04-8dbe-91bff15674d6 req-b993c166-85ad-4987-93c3-ec75f421ddfa service nova] Releasing lock "refresh_cache-af8b58ff-90d5-4a04-844a-ac0534a7e413" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:03:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-971b8d05-1e5c-4b1a-b7ee-fa0a485bf88e req-497c98c1-b07d-48fd-a363-ec798c630f1e service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received event network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:03:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-971b8d05-1e5c-4b1a-b7ee-fa0a485bf88e req-497c98c1-b07d-48fd-a363-ec798c630f1e service nova] Acquiring lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-971b8d05-1e5c-4b1a-b7ee-fa0a485bf88e req-497c98c1-b07d-48fd-a363-ec798c630f1e service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-971b8d05-1e5c-4b1a-b7ee-fa0a485bf88e req-497c98c1-b07d-48fd-a363-ec798c630f1e service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-971b8d05-1e5c-4b1a-b7ee-fa0a485bf88e req-497c98c1-b07d-48fd-a363-ec798c630f1e service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] No waiting events found dispatching network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:03:42 user nova-compute[74669]: WARNING nova.compute.manager [req-971b8d05-1e5c-4b1a-b7ee-fa0a485bf88e req-497c98c1-b07d-48fd-a363-ec798c630f1e service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received unexpected event network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 for instance with vm_state building and task_state spawning.
Nov 08 17:03:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.volume.cinder [None req-283a02b2-ab7f-4e6b-a479-c7a4c205e8ab tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Update attachment failed for attachment a325a990-d238-432c-9519-7d0cab69e7ed. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d70f6a8f-367a-489f-87e4-941800bcc56e) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d70f6a8f-367a-489f-87e4-941800bcc56e)
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [None req-283a02b2-ab7f-4e6b-a479-c7a4c205e8ab tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Failed to attach 7cbcefa3-d07e-4d66-a0e2-24d1d47630af at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d70f6a8f-367a-489f-87e4-941800bcc56e)
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df] Traceback (most recent call last):
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]     self._do_attach(context, instance, volume, volume_api,
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]     self._volume_attach(context, volume, connector, instance,
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]     connection_info = volume_api.attachment_update(
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]     res = method(self, ctx, *args, **kwargs)
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]     with excutils.save_and_reraise_exception():
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]     self.force_reraise()
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]     raise self.value
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]     return method.func(obj, *args, **kwargs)
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]     resp = self._update('/attachments/%s' % id, body)
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]     return self.request(url, method, **kwargs)
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df]     raise exceptions.from_response(resp, body)
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d70f6a8f-367a-489f-87e4-941800bcc56e)
Nov 08 17:03:43 user nova-compute[74669]: ERROR nova.compute.manager [instance: ee7af599-1f24-4828-913f-5ba3687619df] 
Nov 08 17:03:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-283a02b2-ab7f-4e6b-a479-c7a4c205e8ab tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "ee7af599-1f24-4828-913f-5ba3687619df" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.252s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:44 user nova-compute[74669]: INFO nova.compute.manager [None req-3ad4deab-174d-4d85-9ed4-e2f220c1fe12 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Unrescuing
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3ad4deab-174d-4d85-9ed4-e2f220c1fe12 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3ad4deab-174d-4d85-9ed4-e2f220c1fe12 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquired lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3ad4deab-174d-4d85-9ed4-e2f220c1fe12 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server [None req-283a02b2-ab7f-4e6b-a479-c7a4c205e8ab tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d70f6a8f-367a-489f-87e4-941800bcc56e)
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d70f6a8f-367a-489f-87e4-941800bcc56e)
Nov 08 17:03:44 user nova-compute[74669]: ERROR oslo_messaging.rpc.server 
Nov 08 17:03:44 user nova-compute[74669]: DEBUG nova.compute.manager [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-d0682793-b001-426e-ac96-aff61da7fa47 req-a5222365-5260-45b9-bec1-a885379455a9 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received event network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d0682793-b001-426e-ac96-aff61da7fa47 req-a5222365-5260-45b9-bec1-a885379455a9 service nova] Acquiring lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d0682793-b001-426e-ac96-aff61da7fa47 req-a5222365-5260-45b9-bec1-a885379455a9 service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d0682793-b001-426e-ac96-aff61da7fa47 req-a5222365-5260-45b9-bec1-a885379455a9 service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-d0682793-b001-426e-ac96-aff61da7fa47 req-a5222365-5260-45b9-bec1-a885379455a9 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] No waiting events found dispatching network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:03:44 user nova-compute[74669]: WARNING nova.compute.manager [req-d0682793-b001-426e-ac96-aff61da7fa47 req-a5222365-5260-45b9-bec1-a885379455a9 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received unexpected event network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 for instance with vm_state building and task_state spawning.
Nov 08 17:03:44 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Instance spawned successfully.
Nov 08 17:03:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:03:44 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d91eaa51-6bf4-40eb-9f36-f8e838501373 is timed out.
Nov 08 17:03:44 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Successfully detached device vdb from instance d91eaa51-6bf4-40eb-9f36-f8e838501373 from the live domain config.
Nov 08 17:03:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egGBAMYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:03:44 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:03:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[22df6254-257d-4033-b32f-4b6e7062f916]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:03:44 user nova-compute[74669]: No targets found.
Nov 08 17:03:44 user nova-compute[74669]: iSNS:
Nov 08 17:03:44 user nova-compute[74669]: No targets found.
Nov 08 17:03:44 user nova-compute[74669]: STATIC:
Nov 08 17:03:44 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6
Nov 08 17:03:44 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:03:44 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:03:44 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f
Nov 08 17:03:44 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:03:44 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:03:44 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4
Nov 08 17:03:44 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:03:44 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:03:44 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2
Nov 08 17:03:44 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:03:44 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:03:44 user nova-compute[74669]: FIRMWARE:
Nov 08 17:03:44 user nova-compute[74669]: No targets found.
Nov 08 17:03:44 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:03:44 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:03:44 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[962022bb-400d-459b-b7ed-b2b15150b730]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:44 user nova-compute[74669]: INFO nova.compute.manager [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 08 17:03:44 user nova-compute[74669]: DEBUG nova.compute.manager [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd9e3a6-72d5-4bc4-81be-d55dfe5f952e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:03:44 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:03:44 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:03:44 user nova-compute[74669]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 (non-flash)
Nov 08 17:03:44 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:03:44 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:03:44 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:03:44 user nova-compute[74669]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 (non-flash)
Nov 08 17:03:44 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd984586f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6'): ({'sde'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Removing single pathed devices sde {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[850aa35d-23a3-46be-b121-765653d21072]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5bd742-ad98-4059-8579-d9f37630b65f]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Flushing IO for device /dev/sde {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1b6b59-91ad-4a47-8d80-137edc0e8bcb]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:44 user nova-compute[74669]: INFO nova.compute.manager [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Took 6.53 seconds to build instance.
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5771918f-4f7b-4a6e-8292-9210c3a37d69]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2d42ec0e-47c2-43b1-a6ff-114d34c357c3 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.644s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] SCSI volumes sde have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4cc94a-f07c-4603-99a8-e05115c50a7e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3ad4deab-174d-4d85-9ed4-e2f220c1fe12 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Updating instance_info_cache with network_info: [{"id": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "address": "fa:16:3e:70:48:8f", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c0ff3a-f7", "ovs_interfaceid": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3ad4deab-174d-4d85-9ed4-e2f220c1fe12 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Releasing lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG nova.objects.instance [None req-3ad4deab-174d-4d85-9ed4-e2f220c1fe12 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'flavor' on Instance uuid b663cd16-12b5-48fc-886d-0a7d160faea5 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecf7c86-a765-464a-91f1-341a23736a1b]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6, portal: 172.16.0.220,3260]
Nov 08 17:03:44 user nova-compute[74669]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6, portal: 172.16.0.220,3260] successful.
Nov 08 17:03:44 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:401a6af6-7e53-4335-86e5-d8ed8671b7e6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7016e1-35f4-42aa-908a-7489a6f93749]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] <== disconnect_volume: return (402ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:45 user nova-compute[74669]: DEBUG nova.compute.manager [req-93b9e9ac-c217-4f02-8eed-ed4b9bdd263f req-68d24b96-a4a5-4e2b-a40d-cb365abd8781 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received event network-vif-unplugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:03:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-93b9e9ac-c217-4f02-8eed-ed4b9bdd263f req-68d24b96-a4a5-4e2b-a40d-cb365abd8781 service nova] Acquiring lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-93b9e9ac-c217-4f02-8eed-ed4b9bdd263f req-68d24b96-a4a5-4e2b-a40d-cb365abd8781 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-93b9e9ac-c217-4f02-8eed-ed4b9bdd263f req-68d24b96-a4a5-4e2b-a40d-cb365abd8781 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:45 user nova-compute[74669]: DEBUG nova.compute.manager [req-93b9e9ac-c217-4f02-8eed-ed4b9bdd263f req-68d24b96-a4a5-4e2b-a40d-cb365abd8781 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] No waiting events found dispatching network-vif-unplugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:03:45 user nova-compute[74669]: WARNING nova.compute.manager [req-93b9e9ac-c217-4f02-8eed-ed4b9bdd263f req-68d24b96-a4a5-4e2b-a40d-cb365abd8781 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received unexpected event network-vif-unplugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 for instance with vm_state rescued and task_state unrescuing.
Nov 08 17:03:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:45 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Instance destroyed successfully.
Nov 08 17:03:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG nova.objects.instance [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lazy-loading 'flavor' on Instance uuid d91eaa51-6bf4-40eb-9f36-f8e838501373 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1e1ab4bd-214d-4ee1-b78e-aa36de008934 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.436s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG nova.compute.manager [req-e3cb5b96-2956-4e2d-a075-2c410e7ce890 req-ce88dc1d-a53b-442e-a14e-b97bb161cd24 service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Received event network-changed-aa24248f-00c5-4dd2-b439-b1d63068d37f {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG nova.compute.manager [req-e3cb5b96-2956-4e2d-a075-2c410e7ce890 req-ce88dc1d-a53b-442e-a14e-b97bb161cd24 service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Refreshing instance network info cache due to event network-changed-aa24248f-00c5-4dd2-b439-b1d63068d37f. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e3cb5b96-2956-4e2d-a075-2c410e7ce890 req-ce88dc1d-a53b-442e-a14e-b97bb161cd24 service nova] Acquiring lock "refresh_cache-b68038d5-a01a-49a2-bd73-80cec03e68f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e3cb5b96-2956-4e2d-a075-2c410e7ce890 req-ce88dc1d-a53b-442e-a14e-b97bb161cd24 service nova] Acquired lock "refresh_cache-b68038d5-a01a-49a2-bd73-80cec03e68f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG nova.network.neutron [req-e3cb5b96-2956-4e2d-a075-2c410e7ce890 req-ce88dc1d-a53b-442e-a14e-b97bb161cd24 service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Refreshing network info cache for port aa24248f-00c5-4dd2-b439-b1d63068d37f {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "55c67717-eb46-4617-9165-28531360e5d7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "55c67717-eb46-4617-9165-28531360e5d7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:46 user nova-compute[74669]: INFO nova.compute.manager [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Unshelving
Nov 08 17:03:46 user nova-compute[74669]: INFO nova.virt.block_device [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Booting with volume e8124213-75fd-4ac0-bd18-e69f14601fc3 at /dev/vdc
Nov 08 17:03:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Acquiring lock "b68038d5-a01a-49a2-bd73-80cec03e68f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG nova.objects.instance [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lazy-loading 'flavor' on Instance uuid b68038d5-a01a-49a2-bd73-80cec03e68f9 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG os_brick.utils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b29765-4fc2-4831-bae1-05417b1a08cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4e905a-d7f2-439e-a8df-04d60a1d9a90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.038s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb3ed22-4902-49a4-8331-2f6d6ace383e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[263f2221-f645-4bab-9f16-5b60ff7856f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:03:47 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:03:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4e47bf-e169-4fea-a251-520e997901d2]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG os_brick.utils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] <== get_connector_properties: return (201ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Updating existing volume attachment record: 96082ff8-347f-4f7b-92dc-5a77010e3f7a {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG nova.network.neutron [req-e3cb5b96-2956-4e2d-a075-2c410e7ce890 req-ce88dc1d-a53b-442e-a14e-b97bb161cd24 service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Updated VIF entry in instance network info cache for port aa24248f-00c5-4dd2-b439-b1d63068d37f. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG nova.network.neutron [req-e3cb5b96-2956-4e2d-a075-2c410e7ce890 req-ce88dc1d-a53b-442e-a14e-b97bb161cd24 service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Updating instance_info_cache with network_info: [{"id": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "address": "fa:16:3e:ef:37:d8", "network": {"id": "5e97ae50-3f68-4098-a5c8-f17afb8a7366", "bridge": "br-int", "label": "tempest-TestVolumeSwap-200033215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da115791fd6d49ae84005c6f47dc1e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa24248f-00", "ovs_interfaceid": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] Acquiring lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] No waiting events found dispatching network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:03:47 user nova-compute[74669]: WARNING nova.compute.manager [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received unexpected event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 for instance with vm_state rescued and task_state unrescuing.
Nov 08 17:03:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] Acquiring lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] No waiting events found dispatching network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:03:47 user nova-compute[74669]: WARNING nova.compute.manager [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received unexpected event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 for instance with vm_state rescued and task_state unrescuing.
Nov 08 17:03:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] Acquiring lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] No waiting events found dispatching network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:03:47 user nova-compute[74669]: WARNING nova.compute.manager [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received unexpected event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 for instance with vm_state rescued and task_state unrescuing.
Nov 08 17:03:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received event network-vif-unplugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] Acquiring lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] No waiting events found dispatching network-vif-unplugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:03:47 user nova-compute[74669]: WARNING nova.compute.manager [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received unexpected event network-vif-unplugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 for instance with vm_state rescued and task_state unrescuing.
Nov 08 17:03:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] Acquiring lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] No waiting events found dispatching network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:03:47 user nova-compute[74669]: WARNING nova.compute.manager [req-f75fb357-78bd-4854-9f41-eeb4c33bb221 req-195549ca-9dac-4282-b5ab-b7a90e406e54 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received unexpected event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 for instance with vm_state rescued and task_state unrescuing.
Nov 08 17:03:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e3cb5b96-2956-4e2d-a075-2c410e7ce890 req-ce88dc1d-a53b-442e-a14e-b97bb161cd24 service nova] Releasing lock "refresh_cache-b68038d5-a01a-49a2-bd73-80cec03e68f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Acquiring lock "b68038d5-a01a-49a2-bd73-80cec03e68f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:47 user nova-compute[74669]: INFO nova.compute.manager [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Attaching volume 48158446-e642-4723-98ce-bc2d5ae13de6 to /dev/vdb
Nov 08 17:03:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:49 user nova-compute[74669]: DEBUG nova.compute.manager [req-6887e671-016a-4e0c-98ad-61d6c4e2c678 req-176bf4b1-7798-4689-8a67-11e513395af9 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:03:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6887e671-016a-4e0c-98ad-61d6c4e2c678 req-176bf4b1-7798-4689-8a67-11e513395af9 service nova] Acquiring lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6887e671-016a-4e0c-98ad-61d6c4e2c678 req-176bf4b1-7798-4689-8a67-11e513395af9 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6887e671-016a-4e0c-98ad-61d6c4e2c678 req-176bf4b1-7798-4689-8a67-11e513395af9 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:49 user nova-compute[74669]: DEBUG nova.compute.manager [req-6887e671-016a-4e0c-98ad-61d6c4e2c678 req-176bf4b1-7798-4689-8a67-11e513395af9 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] No waiting events found dispatching network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:03:49 user nova-compute[74669]: WARNING nova.compute.manager [req-6887e671-016a-4e0c-98ad-61d6c4e2c678 req-176bf4b1-7798-4689-8a67-11e513395af9 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received unexpected event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 for instance with vm_state rescued and task_state unrescuing.
Nov 08 17:03:49 user nova-compute[74669]: DEBUG nova.compute.manager [req-6887e671-016a-4e0c-98ad-61d6c4e2c678 req-176bf4b1-7798-4689-8a67-11e513395af9 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:03:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6887e671-016a-4e0c-98ad-61d6c4e2c678 req-176bf4b1-7798-4689-8a67-11e513395af9 service nova] Acquiring lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6887e671-016a-4e0c-98ad-61d6c4e2c678 req-176bf4b1-7798-4689-8a67-11e513395af9 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6887e671-016a-4e0c-98ad-61d6c4e2c678 req-176bf4b1-7798-4689-8a67-11e513395af9 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:49 user nova-compute[74669]: DEBUG nova.compute.manager [req-6887e671-016a-4e0c-98ad-61d6c4e2c678 req-176bf4b1-7798-4689-8a67-11e513395af9 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] No waiting events found dispatching network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:03:49 user nova-compute[74669]: WARNING nova.compute.manager [req-6887e671-016a-4e0c-98ad-61d6c4e2c678 req-176bf4b1-7798-4689-8a67-11e513395af9 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received unexpected event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 for instance with vm_state rescued and task_state unrescuing.
Nov 08 17:03:49 user nova-compute[74669]: DEBUG nova.compute.manager [None req-3ad4deab-174d-4d85-9ed4-e2f220c1fe12 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:03:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:50 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:03:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:03:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:03:52 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:03:52 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:03:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:52 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:03:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:03:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iuJSLOtK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:03:55 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:03:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:03:55 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:03:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:03:55 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[405e695e-0c71-4d27-a9d5-ca1dd02646a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:03:55 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.035s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[055a0b88-5bf6-45d0-944b-7b8f1a55e3fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8] added
Nov 08 17:03:55 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.047s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a594d44a-5827-46df-a7d4-568447247b08]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2bea6c-c375-482e-a51b-38d6ef323fe5]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iuJSLOtK {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iuJSLOtK" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c43d63f-79bc-4815-89c2-050cf4025a00]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG os_brick.utils [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iuJSLOtK'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe400889-e896-4e59-9562-9c752a05d1a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8891caf3-d032-471f-95d8-550f8158bbe7]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[703ea67e-812d-4c7d-8e62-8b65b31874e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[574e2d04-7716-4a23-9e5f-df186d806504]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:03:55 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:03:55 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:03:55 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:03:55 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:03:55 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:03:55 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[46565328-1ed3-4237-b0b3-cc607b577dc3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a45163-22de-41a1-adaa-36b2f043023c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG nova.compute.manager [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:03:55 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Creating image(s)
Nov 08 17:03:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Did not create local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Ensure instance console log exists: /opt/stack/data/nova/instances/5575cb2b-b93d-4048-bb96-c4cd7f19ee1d/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Start _get_guest_xml network_info=[{"id": "3021424c-2541-449d-b3f8-ffca35fdb364", "address": "fa:16:3e:6f:e9:d8", "network": {"id": "2b28db73-56c6-4cc7-95de-75ec297a7809", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-839594529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5706466a59c34a878f3eafcebee088d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3021424c-25", "ovs_interfaceid": "3021424c-2541-449d-b3f8-ffca35fdb364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '44bbe2bc-58f8-46e7-b2b6-7d1d9be23a8b', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOWSyBVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5575cb2b-b93d-4048-bb96-c4cd7f19ee1d', 'attached_at': '', 'detached_at': '', 'volume_id': '27fd5c1d-4793-43c2-8ebf-f021e25b5a79', 'serial': '27fd5c1d-4793-43c2-8ebf-f021e25b5a79'}, 'guest_format': None, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49e8df2-1e0c-495a-95cf-06f12e17e0c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:03:55 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cfe50e-26fd-4c76-b0fe-07a4d258c511]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8, portal: 172.16.0.220,3260]
Nov 08 17:03:55 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8, portal: 172.16.0.220,3260] successful.
Nov 08 17:03:55 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG os_brick.utils [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] <== get_connector_properties: return (198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Updating existing volume attachment record: cf13bdbb-c1b8-451d-8e4a-151d721bdcf4 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[193f7f49-2320-44a6-99e1-45c410a6e565]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bdfbd4-90b9-4d1e-afba-dcbaa3bf9519]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:03:56 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:03:56 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:03:56 user nova-compute[74669]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 (non-flash)
Nov 08 17:03:56 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:03:56 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:03:56 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:03:56 user nova-compute[74669]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 (non-flash)
Nov 08 17:03:56 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.606s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:03:56 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:03:56 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:03:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOWSyBVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:03:56 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:03:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.037s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[107573c0-bfba-425b-9824-6f60b5c0fc25]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iuJSLOtK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.724s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] <== connect_volume: return (1730ms) {'type': 'block', 'scsi_wwn': '23865663137313831', 'path': '/dev/sde'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865663137313831', 'path': '/dev/sde'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.055s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:03:57 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:03:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:03:57 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG nova.objects.instance [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lazy-loading 'flavor' on Instance uuid c20b4c52-94b1-4aed-98f0-ae228df81175 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6204138e-8f66-47ca-b3d8-94dbcf5d6b96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:03:57 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 17:03:57 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:03:57 user nova-compute[74669]:   <source dev="/dev/sde"/>
Nov 08 17:03:57 user nova-compute[74669]:   <target dev="vdc" bus="virtio"/>
Nov 08 17:03:57 user nova-compute[74669]:   <serial>64cddd8a-22b3-4f43-b56e-d4fee84a13f8</serial>
Nov 08 17:03:57 user nova-compute[74669]: </disk>
Nov 08 17:03:57 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.038s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[12966f62-313a-4314-80c0-fb6dc2dc42fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79] added
Nov 08 17:03:57 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf4bc72-55f6-404b-93bd-f6060768e44d]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a94fdfd-a0e1-4672-b770-ec36d590ddc8]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LOWSyBVP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LOWSyBVP" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2d7c4a-1b68-4aec-9682-9d1a12c3f54c]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LOWSyBVP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a41a7e-2488-4d78-9125-6eeb2c792e9b]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d913791-e8e8-4485-b9da-fed32d67321e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:03:57 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:03:57 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:03:57 user nova-compute[74669]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 (non-flash)
Nov 08 17:03:57 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:03:57 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:03:57 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:03:57 user nova-compute[74669]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 (non-flash)
Nov 08 17:03:57 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd25d80-bb7b-4160-a7e4-dde92a5997c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79, portal: 172.16.0.220,3260]
Nov 08 17:03:57 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79, portal: 172.16.0.220,3260] successful.
Nov 08 17:03:57 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc796daa-ecc9-44bb-90f3-424b02069974]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[598dbf77-af3f-4d11-adad-601c1f47418c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:03:57 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:03:57 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:03:57 user nova-compute[74669]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 (non-flash)
Nov 08 17:03:57 user nova-compute[74669]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:03:57 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:03:57 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:03:57 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:03:57 user nova-compute[74669]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 (non-flash)
Nov 08 17:03:57 user nova-compute[74669]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:03:57 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.498s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] HCTL ('37', '-', '-', 0) found on session 25 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c542bc-bc47-47c3-bda9-30f717abd4d9]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Searching for a device in session 25 and hctl ['37', '*', '*', 0] yield: None {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:03:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:03:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:03:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] No VIF found with MAC fa:16:3e:62:af:a3, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:03:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:03:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b4ec578d-25af-4253-b876-82c342c385f8 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 54.763s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:03:58 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Searching for a device in session 25 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:03:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOWSyBVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:03:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.689s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:03:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] <== connect_volume: return (2745ms) {'type': 'block', 'scsi_wwn': '26534383330633965', 'path': '/dev/sdf'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:03:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534383330633965', 'path': '/dev/sdf'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:03:58 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:03:58 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:03:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=7497MB free_disk=25.344924926757812GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:03:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:03:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-638839753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-638839753',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgUCl1WLcb59V3Q5jCPwB0FEUGaJcnditDCK4NsYCVn5HJLFzTT3spZBJc6w7p9cbfNoX8cf7k8DGPcXuUOV2irdcP0AhcWgDxOJyANKtp67p0tg/YP8TSLWl4B1A/hJw==',key_name='tempest-keypair-1263187494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5706466a59c34a878f3eafcebee088d0',ramdisk_id='',reservation_id='r-bl0nidls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-494820798',owner_user_name='tempest-ServerActionsV293TestJSON-494820798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:03:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b443fd16646495790682d8ad338df57',uuid=5575cb2b-b93d-4048-bb96-c4cd7f19ee1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3021424c-2541-449d-b3f8-ffca35fdb364", "address": "fa:16:3e:6f:e9:d8", "network": {"id": "2b28db73-56c6-4cc7-95de-75ec297a7809", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-839594529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5706466a59c34a878f3eafcebee088d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3021424c-25", "ovs_interfaceid": "3021424c-2541-449d-b3f8-ffca35fdb364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Converting VIF {"id": "3021424c-2541-449d-b3f8-ffca35fdb364", "address": "fa:16:3e:6f:e9:d8", "network": {"id": "2b28db73-56c6-4cc7-95de-75ec297a7809", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-839594529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5706466a59c34a878f3eafcebee088d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3021424c-25", "ovs_interfaceid": "3021424c-2541-449d-b3f8-ffca35fdb364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:e9:d8,bridge_name='br-int',has_traffic_filtering=True,id=3021424c-2541-449d-b3f8-ffca35fdb364,network=Network(2b28db73-56c6-4cc7-95de-75ec297a7809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3021424c-25') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.objects.instance [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lazy-loading 'pci_devices' on Instance uuid 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:03:59 user nova-compute[74669]:   <uuid>5575cb2b-b93d-4048-bb96-c4cd7f19ee1d</uuid>
Nov 08 17:03:59 user nova-compute[74669]:   <name>instance-00000018</name>
Nov 08 17:03:59 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:03:59 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:03:59 user nova-compute[74669]:   <metadata>
Nov 08 17:03:59 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:03:59 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:03:59 user nova-compute[74669]:       <nova:name>tempest-ServerActionsV293TestJSON-server-638839753</nova:name>
Nov 08 17:03:59 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:03:56</nova:creationTime>
Nov 08 17:03:59 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:03:59 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:03:59 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:03:59 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:03:59 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:03:59 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:03:59 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:03:59 user nova-compute[74669]:       <nova:owner>
Nov 08 17:03:59 user nova-compute[74669]:         <nova:user uuid="3b443fd16646495790682d8ad338df57">tempest-ServerActionsV293TestJSON-494820798-project-member</nova:user>
Nov 08 17:03:59 user nova-compute[74669]:         <nova:project uuid="5706466a59c34a878f3eafcebee088d0">tempest-ServerActionsV293TestJSON-494820798</nova:project>
Nov 08 17:03:59 user nova-compute[74669]:       </nova:owner>
Nov 08 17:03:59 user nova-compute[74669]:       <nova:ports>
Nov 08 17:03:59 user nova-compute[74669]:         <nova:port uuid="3021424c-2541-449d-b3f8-ffca35fdb364">
Nov 08 17:03:59 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 17:03:59 user nova-compute[74669]:         </nova:port>
Nov 08 17:03:59 user nova-compute[74669]:       </nova:ports>
Nov 08 17:03:59 user nova-compute[74669]:     </nova:instance>
Nov 08 17:03:59 user nova-compute[74669]:   </metadata>
Nov 08 17:03:59 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:03:59 user nova-compute[74669]:     <system>
Nov 08 17:03:59 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:03:59 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:03:59 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:03:59 user nova-compute[74669]:       <entry name="serial">5575cb2b-b93d-4048-bb96-c4cd7f19ee1d</entry>
Nov 08 17:03:59 user nova-compute[74669]:       <entry name="uuid">5575cb2b-b93d-4048-bb96-c4cd7f19ee1d</entry>
Nov 08 17:03:59 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:03:59 user nova-compute[74669]:     </system>
Nov 08 17:03:59 user nova-compute[74669]:   </sysinfo>
Nov 08 17:03:59 user nova-compute[74669]:   <os>
Nov 08 17:03:59 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:03:59 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:03:59 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:03:59 user nova-compute[74669]:   </os>
Nov 08 17:03:59 user nova-compute[74669]:   <features>
Nov 08 17:03:59 user nova-compute[74669]:     <acpi/>
Nov 08 17:03:59 user nova-compute[74669]:     <apic/>
Nov 08 17:03:59 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:03:59 user nova-compute[74669]:   </features>
Nov 08 17:03:59 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:03:59 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:03:59 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:03:59 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:03:59 user nova-compute[74669]:   </clock>
Nov 08 17:03:59 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:03:59 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:03:59 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:03:59 user nova-compute[74669]:   </cpu>
Nov 08 17:03:59 user nova-compute[74669]:   <devices>
Nov 08 17:03:59 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 17:03:59 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:03:59 user nova-compute[74669]:       <source dev="/dev/sdf"/>
Nov 08 17:03:59 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:03:59 user nova-compute[74669]:       <serial>27fd5c1d-4793-43c2-8ebf-f021e25b5a79</serial>
Nov 08 17:03:59 user nova-compute[74669]:     </disk>
Nov 08 17:03:59 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:03:59 user nova-compute[74669]:       <mac address="fa:16:3e:6f:e9:d8"/>
Nov 08 17:03:59 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:03:59 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:03:59 user nova-compute[74669]:       <target dev="tap3021424c-25"/>
Nov 08 17:03:59 user nova-compute[74669]:     </interface>
Nov 08 17:03:59 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:03:59 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/5575cb2b-b93d-4048-bb96-c4cd7f19ee1d/console.log" append="off"/>
Nov 08 17:03:59 user nova-compute[74669]:     </serial>
Nov 08 17:03:59 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:03:59 user nova-compute[74669]:     <video>
Nov 08 17:03:59 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:03:59 user nova-compute[74669]:     </video>
Nov 08 17:03:59 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:03:59 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:03:59 user nova-compute[74669]:     </rng>
Nov 08 17:03:59 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:03:59 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:03:59 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:03:59 user nova-compute[74669]:     </memballoon>
Nov 08 17:03:59 user nova-compute[74669]:   </devices>
Nov 08 17:03:59 user nova-compute[74669]: </domain>
Nov 08 17:03:59 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:03:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-638839753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-638839753',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgUCl1WLcb59V3Q5jCPwB0FEUGaJcnditDCK4NsYCVn5HJLFzTT3spZBJc6w7p9cbfNoX8cf7k8DGPcXuUOV2irdcP0AhcWgDxOJyANKtp67p0tg/YP8TSLWl4B1A/hJw==',key_name='tempest-keypair-1263187494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5706466a59c34a878f3eafcebee088d0',ramdisk_id='',reservation_id='r-bl0nidls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-494820798',owner_user_name='tempest-ServerActionsV293TestJSON-494820798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:03:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b443fd16646495790682d8ad338df57',uuid=5575cb2b-b93d-4048-bb96-c4cd7f19ee1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3021424c-2541-449d-b3f8-ffca35fdb364", "address": "fa:16:3e:6f:e9:d8", "network": {"id": "2b28db73-56c6-4cc7-95de-75ec297a7809", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-839594529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5706466a59c34a878f3eafcebee088d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3021424c-25", "ovs_interfaceid": "3021424c-2541-449d-b3f8-ffca35fdb364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Converting VIF {"id": "3021424c-2541-449d-b3f8-ffca35fdb364", "address": "fa:16:3e:6f:e9:d8", "network": {"id": "2b28db73-56c6-4cc7-95de-75ec297a7809", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-839594529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5706466a59c34a878f3eafcebee088d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3021424c-25", "ovs_interfaceid": "3021424c-2541-449d-b3f8-ffca35fdb364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:e9:d8,bridge_name='br-int',has_traffic_filtering=True,id=3021424c-2541-449d-b3f8-ffca35fdb364,network=Network(2b28db73-56c6-4cc7-95de-75ec297a7809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3021424c-25') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG os_vif [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:e9:d8,bridge_name='br-int',has_traffic_filtering=True,id=3021424c-2541-449d-b3f8-ffca35fdb364,network=Network(2b28db73-56c6-4cc7-95de-75ec297a7809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3021424c-25') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d6f9952-162b-5e54-9a57-d57e0996e34f', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3021424c-25, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3021424c-25, col_values=(('qos', UUID('72a1d057-ee1f-45b0-bb59-d6c21e929aa7')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3021424c-25, col_values=(('external_ids', {'iface-id': '3021424c-2541-449d-b3f8-ffca35fdb364', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:e9:d8', 'vm-uuid': '5575cb2b-b93d-4048-bb96-c4cd7f19ee1d'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:03:59 user nova-compute[74669]: INFO os_vif [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:e9:d8,bridge_name='br-int',has_traffic_filtering=True,id=3021424c-2541-449d-b3f8-ffca35fdb364,network=Network(2b28db73-56c6-4cc7-95de-75ec297a7809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3021424c-25')
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7b335462-0d93-4899-a223-5c2e36932578 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b663cd16-12b5-48fc-886d-0a7d160faea5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance c20b4c52-94b1-4aed-98f0-ae228df81175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b8bfb971-094b-46cf-b8bd-ba3df8994e7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance d91eaa51-6bf4-40eb-9f36-f8e838501373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance ee7af599-1f24-4828-913f-5ba3687619df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b68038d5-a01a-49a2-bd73-80cec03e68f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance af8b58ff-90d5-4a04-844a-ac0534a7e413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] No VIF found with MAC fa:16:3e:6f:e9:d8, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 55c67717-eb46-4617-9165-28531360e5d7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Acquiring lock "c20b4c52-94b1-4aed-98f0-ae228df81175" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:03:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.939s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:03:59 user nova-compute[74669]: INFO nova.compute.manager [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Detaching volume 64cddd8a-22b3-4f43-b56e-d4fee84a13f8
Nov 08 17:04:00 user nova-compute[74669]: INFO nova.virt.block_device [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Attempting to driver detach volume 64cddd8a-22b3-4f43-b56e-d4fee84a13f8 from mountpoint /dev/vdc
Nov 08 17:04:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Attempting to detach device vdc from instance c20b4c52-94b1-4aed-98f0-ae228df81175 from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 17:04:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:04:00 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:04:00 user nova-compute[74669]:   <source dev="/dev/sde"/>
Nov 08 17:04:00 user nova-compute[74669]:   <target dev="vdc" bus="virtio"/>
Nov 08 17:04:00 user nova-compute[74669]:   <serial>64cddd8a-22b3-4f43-b56e-d4fee84a13f8</serial>
Nov 08 17:04:00 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 17:04:00 user nova-compute[74669]: </disk>
Nov 08 17:04:00 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:04:00 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Successfully detached device vdc from instance c20b4c52-94b1-4aed-98f0-ae228df81175 from the persistent domain config.
Nov 08 17:04:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c20b4c52-94b1-4aed-98f0-ae228df81175 from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 17:04:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:04:00 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:04:00 user nova-compute[74669]:   <source dev="/dev/sde"/>
Nov 08 17:04:00 user nova-compute[74669]:   <target dev="vdc" bus="virtio"/>
Nov 08 17:04:00 user nova-compute[74669]:   <serial>64cddd8a-22b3-4f43-b56e-d4fee84a13f8</serial>
Nov 08 17:04:00 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 17:04:00 user nova-compute[74669]: </disk>
Nov 08 17:04:00 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:04:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c20b4c52-94b1-4aed-98f0-ae228df81175 {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 17:04:00 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:04:00 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:04:00 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:04:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:04:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:04:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:04:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Updating instance_info_cache with network_info: [{"id": "525ba5da-155c-4f87-9fae-8db52836f73e", "address": "fa:16:3e:7b:7c:e2", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525ba5da-15", "ovs_interfaceid": "525ba5da-155c-4f87-9fae-8db52836f73e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:04:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:04:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:04:01 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:04:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-ca08558d-7bbf-4d5f-a571-29ae2e2e1b49 req-0af50a58-d9bb-4ced-82da-f1223d3fcfc9 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Received event network-vif-plugged-3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:04:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ca08558d-7bbf-4d5f-a571-29ae2e2e1b49 req-0af50a58-d9bb-4ced-82da-f1223d3fcfc9 service nova] Acquiring lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:04:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ca08558d-7bbf-4d5f-a571-29ae2e2e1b49 req-0af50a58-d9bb-4ced-82da-f1223d3fcfc9 service nova] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:04:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ca08558d-7bbf-4d5f-a571-29ae2e2e1b49 req-0af50a58-d9bb-4ced-82da-f1223d3fcfc9 service nova] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-ca08558d-7bbf-4d5f-a571-29ae2e2e1b49 req-0af50a58-d9bb-4ced-82da-f1223d3fcfc9 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] No waiting events found dispatching network-vif-plugged-3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:04:01 user nova-compute[74669]: WARNING nova.compute.manager [req-ca08558d-7bbf-4d5f-a571-29ae2e2e1b49 req-0af50a58-d9bb-4ced-82da-f1223d3fcfc9 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Received unexpected event network-vif-plugged-3021424c-2541-449d-b3f8-ffca35fdb364 for instance with vm_state building and task_state spawning.
Nov 08 17:04:01 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:04:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:04:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:03 user nova-compute[74669]: DEBUG nova.compute.manager [req-e56edf23-cb2f-4f29-bfab-111f4e035736 req-334bc096-6a31-4e9b-90e2-13259d575378 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Received event network-vif-plugged-3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:04:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e56edf23-cb2f-4f29-bfab-111f4e035736 req-334bc096-6a31-4e9b-90e2-13259d575378 service nova] Acquiring lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:04:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e56edf23-cb2f-4f29-bfab-111f4e035736 req-334bc096-6a31-4e9b-90e2-13259d575378 service nova] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:04:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e56edf23-cb2f-4f29-bfab-111f4e035736 req-334bc096-6a31-4e9b-90e2-13259d575378 service nova] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:03 user nova-compute[74669]: DEBUG nova.compute.manager [req-e56edf23-cb2f-4f29-bfab-111f4e035736 req-334bc096-6a31-4e9b-90e2-13259d575378 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] No waiting events found dispatching network-vif-plugged-3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:04:03 user nova-compute[74669]: WARNING nova.compute.manager [req-e56edf23-cb2f-4f29-bfab-111f4e035736 req-334bc096-6a31-4e9b-90e2-13259d575378 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Received unexpected event network-vif-plugged-3021424c-2541-449d-b3f8-ffca35fdb364 for instance with vm_state building and task_state spawning.
Nov 08 17:04:03 user nova-compute[74669]: DEBUG nova.compute.manager [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:04:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:04:03 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Instance spawned successfully.
Nov 08 17:04:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:04:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:04:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:04:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:04:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:04:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:04:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:04:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:04 user nova-compute[74669]: INFO nova.compute.manager [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Took 8.25 seconds to spawn the instance on the hypervisor.
Nov 08 17:04:04 user nova-compute[74669]: DEBUG nova.compute.manager [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:04:04 user nova-compute[74669]: INFO nova.compute.manager [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Took 62.61 seconds to build instance.
Nov 08 17:04:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bd31b670-9fa6-4114-9e4f-178ac3a30123 tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 62.728s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:20 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance c20b4c52-94b1-4aed-98f0-ae228df81175 is timed out.
Nov 08 17:04:20 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Successfully detached device vdc from instance c20b4c52-94b1-4aed-98f0-ae228df81175 from the live domain config.
Nov 08 17:04:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iuJSLOtK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:04:20 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:04:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e027393-1297-4af2-a8b3-69b31f437958]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:04:20 user nova-compute[74669]: No targets found.
Nov 08 17:04:20 user nova-compute[74669]: iSNS:
Nov 08 17:04:20 user nova-compute[74669]: No targets found.
Nov 08 17:04:20 user nova-compute[74669]: STATIC:
Nov 08 17:04:20 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f
Nov 08 17:04:20 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:04:20 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:04:20 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8
Nov 08 17:04:20 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:04:20 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:04:20 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4
Nov 08 17:04:20 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:04:20 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:04:20 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2
Nov 08 17:04:20 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:04:20 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:04:20 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79
Nov 08 17:04:20 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:04:20 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:04:20 user nova-compute[74669]: FIRMWARE:
Nov 08 17:04:20 user nova-compute[74669]: No targets found.
Nov 08 17:04:20 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:04:20 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:04:20 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[27906499-1259-429a-9f66-726318136809]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bd4e73-24ba-4f72-872f-b89f10f87a61]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:04:20 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:04:20 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:04:20 user nova-compute[74669]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 (non-flash)
Nov 08 17:04:20 user nova-compute[74669]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:04:20 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:04:20 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:04:20 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:04:20 user nova-compute[74669]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 (non-flash)
Nov 08 17:04:20 user nova-compute[74669]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:04:20 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd984586440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8'): ({'sde'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Removing single pathed devices sde {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.088s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ef0d02-2be4-4617-a415-ee1b2abc8a4d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[261d6251-bf2c-453e-96e4-762842d3cf2a]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Flushing IO for device /dev/sde {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:04:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.055s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[95aad646-1c21-4c2d-9cb1-e45a7305ee46]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[39704dc0-161d-4504-b79f-15ae333d562e]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] SCSI volumes sde have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ea3fcc-e68a-4dda-bdc1-0d1ea44d02d3]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fa80b5-6052-4dbf-815e-0ace4a01de4a]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8, portal: 172.16.0.220,3260]
Nov 08 17:04:21 user nova-compute[74669]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8, portal: 172.16.0.220,3260] successful.
Nov 08 17:04:21 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cddd8a-22b3-4f43-b56e-d4fee84a13f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2463578-2b94-4854-b523-295aec49ebc7]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] <== disconnect_volume: return (445ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:04:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:04:22 user nova-compute[74669]: DEBUG nova.objects.instance [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lazy-loading 'flavor' on Instance uuid c20b4c52-94b1-4aed-98f0-ae228df81175 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:04:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0161bf98-48bc-41a2-9a78-72f37f9bab0e tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.282s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:26 user nova-compute[74669]: DEBUG nova.compute.manager [None req-563ca3f2-873d-4581-8d30-4f430ba2cc10 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:04:26 user nova-compute[74669]: INFO nova.compute.manager [None req-563ca3f2-873d-4581-8d30-4f430ba2cc10 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] instance snapshotting
Nov 08 17:04:26 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-563ca3f2-873d-4581-8d30-4f430ba2cc10 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Beginning live snapshot process
Nov 08 17:04:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-563ca3f2-873d-4581-8d30-4f430ba2cc10 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json -f qcow2 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-563ca3f2-873d-4581-8d30-4f430ba2cc10 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-563ca3f2-873d-4581-8d30-4f430ba2cc10 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json -f qcow2 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-563ca3f2-873d-4581-8d30-4f430ba2cc10 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json -f qcow2" returned: 0 in 0.214s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-563ca3f2-873d-4581-8d30-4f430ba2cc10 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-563ca3f2-873d-4581-8d30-4f430ba2cc10 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.214s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-563ca3f2-873d-4581-8d30-4f430ba2cc10 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8qqu73_k/a02c52cd073941c6bdae4494616831d8.delta 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-563ca3f2-873d-4581-8d30-4f430ba2cc10 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8qqu73_k/a02c52cd073941c6bdae4494616831d8.delta 1073741824" returned: 0 in 0.072s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:27 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-563ca3f2-873d-4581-8d30-4f430ba2cc10 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 17:04:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rRecaDLq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:04:28 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:04:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:04:28 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:04:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:04:28 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6404eb7b-e8c8-4577-93ca-683e5b5bfe5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:04:28 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c4cf7f-57ca-4a3f-9573-03c20278fa19]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6] added
Nov 08 17:04:28 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d09fbb-e372-4279-912c-b21524d1ab04]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f294e61c-6727-41cd-b06f-36faead4b070]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rRecaDLq {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rRecaDLq" returned: 0 in 0.029s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7098f1-f96e-4c09-9668-6e7aec8e5146]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rRecaDLq'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-563ca3f2-873d-4581-8d30-4f430ba2cc10 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74669) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d072a2eb-d280-4a41-9461-be9dff8e08e4]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd786eb8-a898-45a8-af25-6de22a8d8bd1]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:04:28 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:04:28 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:04:28 user nova-compute[74669]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:04:28 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:04:28 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:04:28 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:04:28 user nova-compute[74669]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:04:28 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-563ca3f2-873d-4581-8d30-4f430ba2cc10 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74669) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 17:04:28 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-563ca3f2-873d-4581-8d30-4f430ba2cc10 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 17:04:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-c2f1ca4a-0e73-40fe-8227-7f81ffa0028f req-3d5745b1-6e60-4279-831c-7c902e5a8eb4 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Received event network-changed-6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-c2f1ca4a-0e73-40fe-8227-7f81ffa0028f req-3d5745b1-6e60-4279-831c-7c902e5a8eb4 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Refreshing instance network info cache due to event network-changed-6582b38d-2366-43fe-9a2b-6990e7bc165b. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c2f1ca4a-0e73-40fe-8227-7f81ffa0028f req-3d5745b1-6e60-4279-831c-7c902e5a8eb4 service nova] Acquiring lock "refresh_cache-b8bfb971-094b-46cf-b8bd-ba3df8994e7a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c2f1ca4a-0e73-40fe-8227-7f81ffa0028f req-3d5745b1-6e60-4279-831c-7c902e5a8eb4 service nova] Acquired lock "refresh_cache-b8bfb971-094b-46cf-b8bd-ba3df8994e7a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG nova.network.neutron [req-c2f1ca4a-0e73-40fe-8227-7f81ffa0028f req-3d5745b1-6e60-4279-831c-7c902e5a8eb4 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Refreshing network info cache for port 6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG nova.privsep.utils [None req-563ca3f2-873d-4581-8d30-4f430ba2cc10 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74669) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 17:04:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-563ca3f2-873d-4581-8d30-4f430ba2cc10 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8qqu73_k/a02c52cd073941c6bdae4494616831d8.delta /opt/stack/data/nova/instances/snapshots/tmp8qqu73_k/a02c52cd073941c6bdae4494616831d8 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-563ca3f2-873d-4581-8d30-4f430ba2cc10 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8qqu73_k/a02c52cd073941c6bdae4494616831d8.delta /opt/stack/data/nova/instances/snapshots/tmp8qqu73_k/a02c52cd073941c6bdae4494616831d8" returned: 0 in 0.475s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:29 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-563ca3f2-873d-4581-8d30-4f430ba2cc10 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Snapshot extracted, beginning image upload
Nov 08 17:04:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 -p 172.16.0.220:3260 --login" returned: 0 in 1.077s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c89d27-00ef-4010-a8ff-32ae998b0090]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6, portal: 172.16.0.220,3260]
Nov 08 17:04:29 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6, portal: 172.16.0.220,3260] successful.
Nov 08 17:04:29 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG nova.network.neutron [req-c2f1ca4a-0e73-40fe-8227-7f81ffa0028f req-3d5745b1-6e60-4279-831c-7c902e5a8eb4 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Updated VIF entry in instance network info cache for port 6582b38d-2366-43fe-9a2b-6990e7bc165b. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG nova.network.neutron [req-c2f1ca4a-0e73-40fe-8227-7f81ffa0028f req-3d5745b1-6e60-4279-831c-7c902e5a8eb4 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Updating instance_info_cache with network_info: [{"id": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "address": "fa:16:3e:93:f5:4a", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6582b38d-23", "ovs_interfaceid": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a13ccf-a1c3-4961-94a1-6dfdb3814987]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c2f1ca4a-0e73-40fe-8227-7f81ffa0028f req-3d5745b1-6e60-4279-831c-7c902e5a8eb4 service nova] Releasing lock "refresh_cache-b8bfb971-094b-46cf-b8bd-ba3df8994e7a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dcbf7f-0af5-4d66-806a-2f445c4f1567]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:04:29 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:04:29 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:04:29 user nova-compute[74669]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:04:29 user nova-compute[74669]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:04:29 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:04:29 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:04:29 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:04:29 user nova-compute[74669]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:04:29 user nova-compute[74669]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:04:29 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.362s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e8c03a-258f-4f9f-82b1-755f70277841]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: None {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-da0141e6-891f-4928-9e4a-722dfb3c5e36 req-8fd213b2-8a47-4057-a48d-051bbbdeddef service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Received event network-changed-6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-da0141e6-891f-4928-9e4a-722dfb3c5e36 req-8fd213b2-8a47-4057-a48d-051bbbdeddef service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Refreshing instance network info cache due to event network-changed-6582b38d-2366-43fe-9a2b-6990e7bc165b. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-da0141e6-891f-4928-9e4a-722dfb3c5e36 req-8fd213b2-8a47-4057-a48d-051bbbdeddef service nova] Acquiring lock "refresh_cache-b8bfb971-094b-46cf-b8bd-ba3df8994e7a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-da0141e6-891f-4928-9e4a-722dfb3c5e36 req-8fd213b2-8a47-4057-a48d-051bbbdeddef service nova] Acquired lock "refresh_cache-b8bfb971-094b-46cf-b8bd-ba3df8994e7a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG nova.network.neutron [req-da0141e6-891f-4928-9e4a-722dfb3c5e36 req-8fd213b2-8a47-4057-a48d-051bbbdeddef service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Refreshing network info cache for port 6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:04:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:04:29 user nova-compute[74669]: INFO nova.compute.manager [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Detaching volume 3869521d-313b-4af0-b0c0-d58d213ec41f
Nov 08 17:04:29 user nova-compute[74669]: INFO nova.virt.block_device [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Attempting to driver detach volume 3869521d-313b-4af0-b0c0-d58d213ec41f from mountpoint /dev/vdb
Nov 08 17:04:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Attempting to detach device vdb from instance b8bfb971-094b-46cf-b8bd-ba3df8994e7a from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 17:04:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:04:30 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:04:30 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 17:04:30 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:04:30 user nova-compute[74669]:   <serial>3869521d-313b-4af0-b0c0-d58d213ec41f</serial>
Nov 08 17:04:30 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:04:30 user nova-compute[74669]: </disk>
Nov 08 17:04:30 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:04:30 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Successfully detached device vdb from instance b8bfb971-094b-46cf-b8bd-ba3df8994e7a from the persistent domain config.
Nov 08 17:04:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8bfb971-094b-46cf-b8bd-ba3df8994e7a from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 17:04:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:04:30 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:04:30 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 17:04:30 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:04:30 user nova-compute[74669]:   <serial>3869521d-313b-4af0-b0c0-d58d213ec41f</serial>
Nov 08 17:04:30 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:04:30 user nova-compute[74669]: </disk>
Nov 08 17:04:30 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:04:30 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:04:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rRecaDLq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:04:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.394s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:04:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] <== connect_volume: return (2397ms) {'type': 'block', 'scsi_wwn': '23865326430366539', 'path': '/dev/sde'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:04:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865326430366539', 'path': '/dev/sde'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:04:30 user nova-compute[74669]: DEBUG nova.objects.instance [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lazy-loading 'flavor' on Instance uuid b68038d5-a01a-49a2-bd73-80cec03e68f9 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:04:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 17:04:30 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:04:30 user nova-compute[74669]:   <source dev="/dev/sde"/>
Nov 08 17:04:30 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:04:30 user nova-compute[74669]:   <serial>48158446-e642-4723-98ce-bc2d5ae13de6</serial>
Nov 08 17:04:30 user nova-compute[74669]: </disk>
Nov 08 17:04:30 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 17:04:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8bfb971-094b-46cf-b8bd-ba3df8994e7a {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 17:04:30 user nova-compute[74669]: DEBUG nova.network.neutron [req-da0141e6-891f-4928-9e4a-722dfb3c5e36 req-8fd213b2-8a47-4057-a48d-051bbbdeddef service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Updated VIF entry in instance network info cache for port 6582b38d-2366-43fe-9a2b-6990e7bc165b. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:04:30 user nova-compute[74669]: DEBUG nova.network.neutron [req-da0141e6-891f-4928-9e4a-722dfb3c5e36 req-8fd213b2-8a47-4057-a48d-051bbbdeddef service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Updating instance_info_cache with network_info: [{"id": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "address": "fa:16:3e:93:f5:4a", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6582b38d-23", "ovs_interfaceid": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:04:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-da0141e6-891f-4928-9e4a-722dfb3c5e36 req-8fd213b2-8a47-4057-a48d-051bbbdeddef service nova] Releasing lock "refresh_cache-b8bfb971-094b-46cf-b8bd-ba3df8994e7a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:04:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:04:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:04:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] No VIF found with MAC fa:16:3e:ef:37:d8, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:04:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bac88973-2378-490f-82dc-ac5468e3b94b tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 44.055s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:32 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-563ca3f2-873d-4581-8d30-4f430ba2cc10 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Snapshot image upload complete
Nov 08 17:04:32 user nova-compute[74669]: INFO nova.compute.manager [None req-563ca3f2-873d-4581-8d30-4f430ba2cc10 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Took 5.83 seconds to snapshot the instance on the hypervisor.
Nov 08 17:04:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6af293a0-ec05-4e0b-a8fd-faf89fede284 tempest-TestVolumeSwap-1708497689 tempest-TestVolumeSwap-1708497689-project-admin] Acquiring lock "b68038d5-a01a-49a2-bd73-80cec03e68f9" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:04:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6af293a0-ec05-4e0b-a8fd-faf89fede284 tempest-TestVolumeSwap-1708497689 tempest-TestVolumeSwap-1708497689-project-admin] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:04:32 user nova-compute[74669]: DEBUG os_brick.utils [None req-6af293a0-ec05-4e0b-a8fd-faf89fede284 tempest-TestVolumeSwap-1708497689 tempest-TestVolumeSwap-1708497689-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:04:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9a1991-9122-44a0-8797-3e790d8a1788]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8b12a0-1344-4ce0-b866-d1a5c60f4c1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[73094042-fd96-4fcb-9c61-acca0918030e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12d956e-1213-49f0-a34f-204374ec12be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6af293a0-ec05-4e0b-a8fd-faf89fede284 tempest-TestVolumeSwap-1708497689 tempest-TestVolumeSwap-1708497689-project-admin] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6af293a0-ec05-4e0b-a8fd-faf89fede284 tempest-TestVolumeSwap-1708497689 tempest-TestVolumeSwap-1708497689-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:04:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6af293a0-ec05-4e0b-a8fd-faf89fede284 tempest-TestVolumeSwap-1708497689 tempest-TestVolumeSwap-1708497689-project-admin] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:04:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:04:32 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:04:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[df515e58-da0e-4301-aa5d-186bdf685bc1]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-6af293a0-ec05-4e0b-a8fd-faf89fede284 tempest-TestVolumeSwap-1708497689 tempest-TestVolumeSwap-1708497689-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:04:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-6af293a0-ec05-4e0b-a8fd-faf89fede284 tempest-TestVolumeSwap-1708497689 tempest-TestVolumeSwap-1708497689-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:04:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-6af293a0-ec05-4e0b-a8fd-faf89fede284 tempest-TestVolumeSwap-1708497689 tempest-TestVolumeSwap-1708497689-project-admin] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:04:32 user nova-compute[74669]: DEBUG os_brick.utils [None req-6af293a0-ec05-4e0b-a8fd-faf89fede284 tempest-TestVolumeSwap-1708497689 tempest-TestVolumeSwap-1708497689-project-admin] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:04:32 user nova-compute[74669]: INFO nova.compute.manager [None req-6af293a0-ec05-4e0b-a8fd-faf89fede284 tempest-TestVolumeSwap-1708497689 tempest-TestVolumeSwap-1708497689-project-admin] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Swapping volume 48158446-e642-4723-98ce-bc2d5ae13de6 for 8b839d95-ad13-4597-a96c-120d47dd04ba
Nov 08 17:04:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "84fac5e1-7ef0-417a-8888-955a7c9f8944" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:04:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:04:34 user nova-compute[74669]: DEBUG nova.compute.manager [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:04:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:04:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:04:34 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:04:34 user nova-compute[74669]: INFO nova.compute.claims [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Claim successful on node user
Nov 08 17:04:35 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:04:35 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:04:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.790s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:35 user nova-compute[74669]: DEBUG nova.compute.manager [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:04:35 user nova-compute[74669]: DEBUG nova.compute.manager [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:04:35 user nova-compute[74669]: DEBUG nova.network.neutron [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:04:35 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:04:35 user nova-compute[74669]: DEBUG nova.compute.manager [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:04:35 user nova-compute[74669]: DEBUG nova.policy [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '645f4df51c4240609e10a787918ddf41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f704465bf5a44db5aa573ec6546b16c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:04:35 user nova-compute[74669]: DEBUG nova.compute.manager [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:04:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:04:35 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Creating image(s)
Nov 08 17:04:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "/opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:04:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "/opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:04:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "/opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "9a07d57e344ec80286b298c4f319568ce0a5732a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:04:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "9a07d57e344ec80286b298c4f319568ce0a5732a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:04:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a07d57e344ec80286b298c4f319568ce0a5732a.part --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:36 user nova-compute[74669]: DEBUG nova.network.neutron [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Successfully created port: a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:04:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a07d57e344ec80286b298c4f319568ce0a5732a.part --force-share --output=json" returned: 0 in 0.207s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:36 user nova-compute[74669]: DEBUG nova.virt.images [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] d88ae2e1-abfc-4460-bd86-88fc8ddbc8a2 was qcow2, converting to raw {{(pid=74669) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 17:04:36 user nova-compute[74669]: DEBUG nova.privsep.utils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74669) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 17:04:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9a07d57e344ec80286b298c4f319568ce0a5732a.part /opt/stack/data/nova/instances/_base/9a07d57e344ec80286b298c4f319568ce0a5732a.converted {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9a07d57e344ec80286b298c4f319568ce0a5732a.part /opt/stack/data/nova/instances/_base/9a07d57e344ec80286b298c4f319568ce0a5732a.converted" returned: 0 in 0.877s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a07d57e344ec80286b298c4f319568ce0a5732a.converted --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:37 user nova-compute[74669]: DEBUG nova.network.neutron [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Successfully updated port: a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:04:37 user nova-compute[74669]: DEBUG nova.compute.manager [req-ff812399-7150-4e1b-81a5-1c0597b6cfb9 req-c17f1bb8-b795-4e79-8478-bd2b077e8a98 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Received event network-changed-a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:04:37 user nova-compute[74669]: DEBUG nova.compute.manager [req-ff812399-7150-4e1b-81a5-1c0597b6cfb9 req-c17f1bb8-b795-4e79-8478-bd2b077e8a98 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Refreshing instance network info cache due to event network-changed-a6d42001-e353-4460-9257-a9d4b0027672. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:04:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff812399-7150-4e1b-81a5-1c0597b6cfb9 req-c17f1bb8-b795-4e79-8478-bd2b077e8a98 service nova] Acquiring lock "refresh_cache-84fac5e1-7ef0-417a-8888-955a7c9f8944" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:04:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff812399-7150-4e1b-81a5-1c0597b6cfb9 req-c17f1bb8-b795-4e79-8478-bd2b077e8a98 service nova] Acquired lock "refresh_cache-84fac5e1-7ef0-417a-8888-955a7c9f8944" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:04:37 user nova-compute[74669]: DEBUG nova.network.neutron [req-ff812399-7150-4e1b-81a5-1c0597b6cfb9 req-c17f1bb8-b795-4e79-8478-bd2b077e8a98 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Refreshing network info cache for port a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:04:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "refresh_cache-84fac5e1-7ef0-417a-8888-955a7c9f8944" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:04:37 user nova-compute[74669]: DEBUG nova.network.neutron [req-ff812399-7150-4e1b-81a5-1c0597b6cfb9 req-c17f1bb8-b795-4e79-8478-bd2b077e8a98 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:04:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a07d57e344ec80286b298c4f319568ce0a5732a.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "9a07d57e344ec80286b298c4f319568ce0a5732a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.361s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a07d57e344ec80286b298c4f319568ce0a5732a --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:37 user nova-compute[74669]: DEBUG nova.network.neutron [req-ff812399-7150-4e1b-81a5-1c0597b6cfb9 req-c17f1bb8-b795-4e79-8478-bd2b077e8a98 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:04:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ff812399-7150-4e1b-81a5-1c0597b6cfb9 req-c17f1bb8-b795-4e79-8478-bd2b077e8a98 service nova] Releasing lock "refresh_cache-84fac5e1-7ef0-417a-8888-955a7c9f8944" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:04:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquired lock "refresh_cache-84fac5e1-7ef0-417a-8888-955a7c9f8944" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:04:37 user nova-compute[74669]: DEBUG nova.network.neutron [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:04:37 user nova-compute[74669]: DEBUG nova.network.neutron [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a07d57e344ec80286b298c4f319568ce0a5732a --force-share --output=json" returned: 0 in 0.220s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "9a07d57e344ec80286b298c4f319568ce0a5732a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "9a07d57e344ec80286b298c4f319568ce0a5732a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a07d57e344ec80286b298c4f319568ce0a5732a --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a07d57e344ec80286b298c4f319568ce0a5732a --force-share --output=json" returned: 0 in 0.195s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a07d57e344ec80286b298c4f319568ce0a5732a,backing_fmt=raw /opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a07d57e344ec80286b298c4f319568ce0a5732a,backing_fmt=raw /opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/disk 1073741824" returned: 0 in 0.054s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "9a07d57e344ec80286b298c4f319568ce0a5732a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a07d57e344ec80286b298c4f319568ce0a5732a --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.network.neutron [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Updating instance_info_cache with network_info: [{"id": "a6d42001-e353-4460-9257-a9d4b0027672", "address": "fa:16:3e:79:4f:aa", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d42001-e3", "ovs_interfaceid": "a6d42001-e353-4460-9257-a9d4b0027672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Releasing lock "refresh_cache-84fac5e1-7ef0-417a-8888-955a7c9f8944" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Instance network_info: |[{"id": "a6d42001-e353-4460-9257-a9d4b0027672", "address": "fa:16:3e:79:4f:aa", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d42001-e3", "ovs_interfaceid": "a6d42001-e353-4460-9257-a9d4b0027672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a07d57e344ec80286b298c4f319568ce0a5732a --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Ensure instance console log exists: /opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Start _get_guest_xml network_info=[{"id": "a6d42001-e353-4460-9257-a9d4b0027672", "address": "fa:16:3e:79:4f:aa", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d42001-e3", "ovs_interfaceid": "a6d42001-e353-4460-9257-a9d4b0027672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ea43841df3b8072457d3b289c7b21e84',container_format='bare',created_at=2023-11-08T17:04:26Z,direct_url=<?>,disk_format='qcow2',id=d88ae2e1-abfc-4460-bd86-88fc8ddbc8a2,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-963849959',owner='f704465bf5a44db5aa573ec6546b16c8',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T17:04:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'd88ae2e1-abfc-4460-bd86-88fc8ddbc8a2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:04:38 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:04:38 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ea43841df3b8072457d3b289c7b21e84',container_format='bare',created_at=2023-11-08T17:04:26Z,direct_url=<?>,disk_format='qcow2',id=d88ae2e1-abfc-4460-bd86-88fc8ddbc8a2,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-963849959',owner='f704465bf5a44db5aa573ec6546b16c8',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T17:04:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:04:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-661364798',display_name='tempest-TestStampPattern-server-661364798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-661364798',id=26,image_ref='d88ae2e1-abfc-4460-bd86-88fc8ddbc8a2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPDGzyFrH3MdZrG/tSqCKZcN7lhFYTpjgjac9mXXE01cRHOS7+HZPHOYTre5OIE1b16d2AzYSrfjX/N3IGTtTcXx8PnKlOincfS8vgaHln6XlhTSOcFKiwt6piilyaUFg==',key_name='tempest-TestStampPattern-1970291243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f704465bf5a44db5aa573ec6546b16c8',ramdisk_id='',reservation_id='r-kvryu3pr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d91eaa51-6bf4-40eb-9f36-f8e838501373',image_min_disk='1',image_min_ram='0',image_owner_id='f704465bf5a44db5aa573ec6546b16c8',image_owner_project_name='tempest-TestStampPattern-440069879',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-440069879-project-member',image_user_id='645f4df51c4240609e10a787918ddf41',network_allocated='True',owner_project_name='tempest-TestStampPattern-440069879',owner_user_name='tempest-TestStampPattern-440069879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:04:35Z,user_data=None,user_id='645f4df51c4240609e10a787918ddf41',uuid=84fac5e1-7ef0-417a-8888-955a7c9f8944,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6d42001-e353-4460-9257-a9d4b0027672", "address": "fa:16:3e:79:4f:aa", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d42001-e3", "ovs_interfaceid": "a6d42001-e353-4460-9257-a9d4b0027672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Converting VIF {"id": "a6d42001-e353-4460-9257-a9d4b0027672", "address": "fa:16:3e:79:4f:aa", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d42001-e3", "ovs_interfaceid": "a6d42001-e353-4460-9257-a9d4b0027672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:4f:aa,bridge_name='br-int',has_traffic_filtering=True,id=a6d42001-e353-4460-9257-a9d4b0027672,network=Network(1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d42001-e3') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.objects.instance [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lazy-loading 'pci_devices' on Instance uuid 84fac5e1-7ef0-417a-8888-955a7c9f8944 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:04:38 user nova-compute[74669]:   <uuid>84fac5e1-7ef0-417a-8888-955a7c9f8944</uuid>
Nov 08 17:04:38 user nova-compute[74669]:   <name>instance-0000001a</name>
Nov 08 17:04:38 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:04:38 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:04:38 user nova-compute[74669]:   <metadata>
Nov 08 17:04:38 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:04:38 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:04:38 user nova-compute[74669]:       <nova:name>tempest-TestStampPattern-server-661364798</nova:name>
Nov 08 17:04:38 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:04:38</nova:creationTime>
Nov 08 17:04:38 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:04:38 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:04:38 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:04:38 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:04:38 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:04:38 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:04:38 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:04:38 user nova-compute[74669]:       <nova:owner>
Nov 08 17:04:38 user nova-compute[74669]:         <nova:user uuid="645f4df51c4240609e10a787918ddf41">tempest-TestStampPattern-440069879-project-member</nova:user>
Nov 08 17:04:38 user nova-compute[74669]:         <nova:project uuid="f704465bf5a44db5aa573ec6546b16c8">tempest-TestStampPattern-440069879</nova:project>
Nov 08 17:04:38 user nova-compute[74669]:       </nova:owner>
Nov 08 17:04:38 user nova-compute[74669]:       <nova:root type="image" uuid="d88ae2e1-abfc-4460-bd86-88fc8ddbc8a2"/>
Nov 08 17:04:38 user nova-compute[74669]:       <nova:ports>
Nov 08 17:04:38 user nova-compute[74669]:         <nova:port uuid="a6d42001-e353-4460-9257-a9d4b0027672">
Nov 08 17:04:38 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 17:04:38 user nova-compute[74669]:         </nova:port>
Nov 08 17:04:38 user nova-compute[74669]:       </nova:ports>
Nov 08 17:04:38 user nova-compute[74669]:     </nova:instance>
Nov 08 17:04:38 user nova-compute[74669]:   </metadata>
Nov 08 17:04:38 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:04:38 user nova-compute[74669]:     <system>
Nov 08 17:04:38 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:04:38 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:04:38 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:04:38 user nova-compute[74669]:       <entry name="serial">84fac5e1-7ef0-417a-8888-955a7c9f8944</entry>
Nov 08 17:04:38 user nova-compute[74669]:       <entry name="uuid">84fac5e1-7ef0-417a-8888-955a7c9f8944</entry>
Nov 08 17:04:38 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:04:38 user nova-compute[74669]:     </system>
Nov 08 17:04:38 user nova-compute[74669]:   </sysinfo>
Nov 08 17:04:38 user nova-compute[74669]:   <os>
Nov 08 17:04:38 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:04:38 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:04:38 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:04:38 user nova-compute[74669]:   </os>
Nov 08 17:04:38 user nova-compute[74669]:   <features>
Nov 08 17:04:38 user nova-compute[74669]:     <acpi/>
Nov 08 17:04:38 user nova-compute[74669]:     <apic/>
Nov 08 17:04:38 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:04:38 user nova-compute[74669]:   </features>
Nov 08 17:04:38 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:04:38 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:04:38 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:04:38 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:04:38 user nova-compute[74669]:   </clock>
Nov 08 17:04:38 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:04:38 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:04:38 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:04:38 user nova-compute[74669]:   </cpu>
Nov 08 17:04:38 user nova-compute[74669]:   <devices>
Nov 08 17:04:38 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:04:38 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:04:38 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/disk"/>
Nov 08 17:04:38 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:04:38 user nova-compute[74669]:     </disk>
Nov 08 17:04:38 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:04:38 user nova-compute[74669]:       <mac address="fa:16:3e:79:4f:aa"/>
Nov 08 17:04:38 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:04:38 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:04:38 user nova-compute[74669]:       <target dev="tapa6d42001-e3"/>
Nov 08 17:04:38 user nova-compute[74669]:     </interface>
Nov 08 17:04:38 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:04:38 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/console.log" append="off"/>
Nov 08 17:04:38 user nova-compute[74669]:     </serial>
Nov 08 17:04:38 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:04:38 user nova-compute[74669]:     <video>
Nov 08 17:04:38 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:04:38 user nova-compute[74669]:     </video>
Nov 08 17:04:38 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:04:38 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:04:38 user nova-compute[74669]:     </rng>
Nov 08 17:04:38 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:04:38 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:04:38 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:04:38 user nova-compute[74669]:     </memballoon>
Nov 08 17:04:38 user nova-compute[74669]:   </devices>
Nov 08 17:04:38 user nova-compute[74669]: </domain>
Nov 08 17:04:38 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:04:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-661364798',display_name='tempest-TestStampPattern-server-661364798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-661364798',id=26,image_ref='d88ae2e1-abfc-4460-bd86-88fc8ddbc8a2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPDGzyFrH3MdZrG/tSqCKZcN7lhFYTpjgjac9mXXE01cRHOS7+HZPHOYTre5OIE1b16d2AzYSrfjX/N3IGTtTcXx8PnKlOincfS8vgaHln6XlhTSOcFKiwt6piilyaUFg==',key_name='tempest-TestStampPattern-1970291243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f704465bf5a44db5aa573ec6546b16c8',ramdisk_id='',reservation_id='r-kvryu3pr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d91eaa51-6bf4-40eb-9f36-f8e838501373',image_min_disk='1',image_min_ram='0',image_owner_id='f704465bf5a44db5aa573ec6546b16c8',image_owner_project_name='tempest-TestStampPattern-440069879',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-440069879-project-member',image_user_id='645f4df51c4240609e10a787918ddf41',network_allocated='True',owner_project_name='tempest-TestStampPattern-440069879',owner_user_name='tempest-TestStampPattern-440069879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:04:35Z,user_data=None,user_id='645f4df51c4240609e10a787918ddf41',uuid=84fac5e1-7ef0-417a-8888-955a7c9f8944,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6d42001-e353-4460-9257-a9d4b0027672", "address": "fa:16:3e:79:4f:aa", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d42001-e3", "ovs_interfaceid": "a6d42001-e353-4460-9257-a9d4b0027672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Converting VIF {"id": "a6d42001-e353-4460-9257-a9d4b0027672", "address": "fa:16:3e:79:4f:aa", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d42001-e3", "ovs_interfaceid": "a6d42001-e353-4460-9257-a9d4b0027672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:4f:aa,bridge_name='br-int',has_traffic_filtering=True,id=a6d42001-e353-4460-9257-a9d4b0027672,network=Network(1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d42001-e3') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG os_vif [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:4f:aa,bridge_name='br-int',has_traffic_filtering=True,id=a6d42001-e353-4460-9257-a9d4b0027672,network=Network(1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d42001-e3') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3027e9b1-dc0f-58d5-b745-6a1f5d56b061', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6d42001-e3, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6d42001-e3, col_values=(('qos', UUID('92147501-8b39-476c-9d6c-5a20e870db47')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6d42001-e3, col_values=(('external_ids', {'iface-id': 'a6d42001-e353-4460-9257-a9d4b0027672', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:4f:aa', 'vm-uuid': '84fac5e1-7ef0-417a-8888-955a7c9f8944'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:38 user nova-compute[74669]: INFO os_vif [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:4f:aa,bridge_name='br-int',has_traffic_filtering=True,id=a6d42001-e353-4460-9257-a9d4b0027672,network=Network(1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d42001-e3')
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:04:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] No VIF found with MAC fa:16:3e:79:4f:aa, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:04:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-e7cd982d-4a48-4fe0-aa87-4cbd94865e94 req-a6407968-2f61-4755-86f6-412af7b15b13 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Received event network-vif-plugged-a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:04:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e7cd982d-4a48-4fe0-aa87-4cbd94865e94 req-a6407968-2f61-4755-86f6-412af7b15b13 service nova] Acquiring lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:04:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e7cd982d-4a48-4fe0-aa87-4cbd94865e94 req-a6407968-2f61-4755-86f6-412af7b15b13 service nova] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:04:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e7cd982d-4a48-4fe0-aa87-4cbd94865e94 req-a6407968-2f61-4755-86f6-412af7b15b13 service nova] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-e7cd982d-4a48-4fe0-aa87-4cbd94865e94 req-a6407968-2f61-4755-86f6-412af7b15b13 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] No waiting events found dispatching network-vif-plugged-a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:04:40 user nova-compute[74669]: WARNING nova.compute.manager [req-e7cd982d-4a48-4fe0-aa87-4cbd94865e94 req-a6407968-2f61-4755-86f6-412af7b15b13 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Received unexpected event network-vif-plugged-a6d42001-e353-4460-9257-a9d4b0027672 for instance with vm_state building and task_state spawning.
Nov 08 17:04:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:42 user nova-compute[74669]: DEBUG nova.compute.manager [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:04:42 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:04:42 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Instance spawned successfully.
Nov 08 17:04:42 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:04:42 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:04:42 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:04:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-072001e0-42e6-414a-9e56-18d622e26c65 req-77031b6a-2acb-4fd7-8a05-49c5d8009651 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Received event network-vif-plugged-a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:04:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-072001e0-42e6-414a-9e56-18d622e26c65 req-77031b6a-2acb-4fd7-8a05-49c5d8009651 service nova] Acquiring lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:04:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-072001e0-42e6-414a-9e56-18d622e26c65 req-77031b6a-2acb-4fd7-8a05-49c5d8009651 service nova] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:04:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-072001e0-42e6-414a-9e56-18d622e26c65 req-77031b6a-2acb-4fd7-8a05-49c5d8009651 service nova] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-072001e0-42e6-414a-9e56-18d622e26c65 req-77031b6a-2acb-4fd7-8a05-49c5d8009651 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] No waiting events found dispatching network-vif-plugged-a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:04:42 user nova-compute[74669]: WARNING nova.compute.manager [req-072001e0-42e6-414a-9e56-18d622e26c65 req-77031b6a-2acb-4fd7-8a05-49c5d8009651 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Received unexpected event network-vif-plugged-a6d42001-e353-4460-9257-a9d4b0027672 for instance with vm_state building and task_state spawning.
Nov 08 17:04:42 user nova-compute[74669]: INFO nova.compute.manager [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Took 6.90 seconds to spawn the instance on the hypervisor.
Nov 08 17:04:42 user nova-compute[74669]: DEBUG nova.compute.manager [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:04:42 user nova-compute[74669]: INFO nova.compute.manager [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Took 8.09 seconds to build instance.
Nov 08 17:04:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-473625d1-6c03-42b4-9acf-8012153be052 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.200s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:04:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:04:43 user nova-compute[74669]: DEBUG nova.objects.instance [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lazy-loading 'pci_requests' on Instance uuid 55c67717-eb46-4617-9165-28531360e5d7 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:04:43 user nova-compute[74669]: DEBUG nova.objects.instance [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lazy-loading 'numa_topology' on Instance uuid 55c67717-eb46-4617-9165-28531360e5d7 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:04:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:04:43 user nova-compute[74669]: INFO nova.compute.claims [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Claim successful on node user
Nov 08 17:04:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:43 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:04:43 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:04:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.594s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:43 user nova-compute[74669]: INFO nova.network.neutron [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Updating port 8e437d3e-12dd-4bec-aa76-2951dc03b5eb with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 17:04:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "refresh_cache-55c67717-eb46-4617-9165-28531360e5d7" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:04:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquired lock "refresh_cache-55c67717-eb46-4617-9165-28531360e5d7" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:04:44 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:04:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-776f5ebf-cb3f-43d7-a354-04dd7b04f5e8 req-f9b7cdd7-e13d-4cf1-ac96-b04be269925a service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Received event network-changed-8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:04:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-776f5ebf-cb3f-43d7-a354-04dd7b04f5e8 req-f9b7cdd7-e13d-4cf1-ac96-b04be269925a service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Refreshing instance network info cache due to event network-changed-8e437d3e-12dd-4bec-aa76-2951dc03b5eb. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:04:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-776f5ebf-cb3f-43d7-a354-04dd7b04f5e8 req-f9b7cdd7-e13d-4cf1-ac96-b04be269925a service nova] Acquiring lock "refresh_cache-55c67717-eb46-4617-9165-28531360e5d7" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:04:44 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Updating instance_info_cache with network_info: [{"id": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "address": "fa:16:3e:79:63:9e", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e437d3e-12", "ovs_interfaceid": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:04:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Releasing lock "refresh_cache-55c67717-eb46-4617-9165-28531360e5d7" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:04:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:04:44 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Creating image(s)
Nov 08 17:04:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "/opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:04:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "/opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:04:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "/opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:44 user nova-compute[74669]: DEBUG nova.objects.instance [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lazy-loading 'trusted_certs' on Instance uuid 55c67717-eb46-4617-9165-28531360e5d7 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:04:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-776f5ebf-cb3f-43d7-a354-04dd7b04f5e8 req-f9b7cdd7-e13d-4cf1-ac96-b04be269925a service nova] Acquired lock "refresh_cache-55c67717-eb46-4617-9165-28531360e5d7" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:04:44 user nova-compute[74669]: DEBUG nova.network.neutron [req-776f5ebf-cb3f-43d7-a354-04dd7b04f5e8 req-f9b7cdd7-e13d-4cf1-ac96-b04be269925a service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Refreshing network info cache for port 8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:04:44 user nova-compute[74669]: DEBUG nova.objects.base [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Object Instance<55c67717-eb46-4617-9165-28531360e5d7> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:04:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:04:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:04:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e.part --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e.part --force-share --output=json" returned: 0 in 0.239s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:46 user nova-compute[74669]: DEBUG nova.virt.images [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] 464ef1b3-4425-44d4-b651-2425c07b9469 was qcow2, converting to raw {{(pid=74669) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 17:04:46 user nova-compute[74669]: DEBUG nova.privsep.utils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74669) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 17:04:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e.part /opt/stack/data/nova/instances/_base/ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e.converted {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:46 user nova-compute[74669]: DEBUG nova.network.neutron [req-776f5ebf-cb3f-43d7-a354-04dd7b04f5e8 req-f9b7cdd7-e13d-4cf1-ac96-b04be269925a service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Updated VIF entry in instance network info cache for port 8e437d3e-12dd-4bec-aa76-2951dc03b5eb. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:04:46 user nova-compute[74669]: DEBUG nova.network.neutron [req-776f5ebf-cb3f-43d7-a354-04dd7b04f5e8 req-f9b7cdd7-e13d-4cf1-ac96-b04be269925a service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Updating instance_info_cache with network_info: [{"id": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "address": "fa:16:3e:79:63:9e", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e437d3e-12", "ovs_interfaceid": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:04:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-776f5ebf-cb3f-43d7-a354-04dd7b04f5e8 req-f9b7cdd7-e13d-4cf1-ac96-b04be269925a service nova] Releasing lock "refresh_cache-55c67717-eb46-4617-9165-28531360e5d7" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:04:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e.part /opt/stack/data/nova/instances/_base/ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e.converted" returned: 0 in 0.280s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e.converted --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e.converted --force-share --output=json" returned: 0 in 0.243s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.674s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e --force-share --output=json" returned: 0 in 0.178s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:04:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:04:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e --force-share --output=json" returned: 0 in 0.208s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e,backing_fmt=raw /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e,backing_fmt=raw /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk 1073741824" returned: 0 in 0.063s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e --force-share --output=json" returned: 0 in 0.209s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:47 user nova-compute[74669]: DEBUG nova.objects.instance [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lazy-loading 'migration_context' on Instance uuid 55c67717-eb46-4617-9165-28531360e5d7 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:04:47 user nova-compute[74669]: DEBUG nova.objects.base [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Object Instance<55c67717-eb46-4617-9165-28531360e5d7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:04:47 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Rebasing disk image.
Nov 08 17:04:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.217s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 -F raw /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 -F raw /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk" returned: 0 in 2.617s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Ensure instance console log exists: /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Start _get_guest_xml network_info=[{"id": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "address": "fa:16:3e:79:63:9e", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e437d3e-12", "ovs_interfaceid": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='1c5fee0d48696002d62b324ecc0921db',container_format='bare',created_at=2023-11-08T17:01:53Z,direct_url=<?>,disk_format='qcow2',id=464ef1b3-4425-44d4-b651-2425c07b9469,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-287785015-shelved',owner='9f1e9778e17a4e0fa1aa1f41d323a88c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T17:01:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '96082ff8-347f-4f7b-92dc-5a77010e3f7a', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YPlxJAoV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '55c67717-eb46-4617-9165-28531360e5d7', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8124213-75fd-4ac0-bd18-e69f14601fc3', 'serial': 'e8124213-75fd-4ac0-bd18-e69f14601fc3'}, 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:04:50 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:04:50 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1c5fee0d48696002d62b324ecc0921db',container_format='bare',created_at=2023-11-08T17:01:53Z,direct_url=<?>,disk_format='qcow2',id=464ef1b3-4425-44d4-b651-2425c07b9469,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-287785015-shelved',owner='9f1e9778e17a4e0fa1aa1f41d323a88c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T17:01:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.objects.instance [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lazy-loading 'vcpu_model' on Instance uuid 55c67717-eb46-4617-9165-28531360e5d7 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.objects.base [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Object Instance<55c67717-eb46-4617-9165-28531360e5d7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YPlxJAoV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:04:50 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:04:50 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:04:50 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 -p 172.16.0.220:3260" returned: 21 in 0.066s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[08261ce3-b12c-4d7a-b114-56bf798736c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:04:50 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1653f63b-4e8e-4bc3-9018-bc5ac9a1b6db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3] added
Nov 08 17:04:50 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fff9d65-ce69-4429-9e58-ee0e30982ccb]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39185d5-1ba8-4756-bfa5-0fa017508cd9]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YPlxJAoV {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YPlxJAoV" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b58006-f315-4459-bdea-a344b242c5e2]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YPlxJAoV'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a571048-5021-49fb-be6c-c2a8720603f9]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1fd47d-ab26-400e-8055-d7df65996463]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:04:50 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:04:50 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:04:50 user nova-compute[74669]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:04:50 user nova-compute[74669]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:04:50 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:04:50 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:04:50 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:04:50 user nova-compute[74669]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:04:50 user nova-compute[74669]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:04:50 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c96afd-3fb3-43c8-adbf-964d382a5b45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3, portal: 172.16.0.220,3260]
Nov 08 17:04:50 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3, portal: 172.16.0.220,3260] successful.
Nov 08 17:04:50 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb9bb7d-6bd6-4e6a-8699-09fabfdd2bb7]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2103dd27-a5e4-4617-89de-5f6f19f49599]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:04:50 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:04:50 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:04:50 user nova-compute[74669]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:04:50 user nova-compute[74669]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:04:50 user nova-compute[74669]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)
Nov 08 17:04:50 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:04:50 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:04:50 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:04:50 user nova-compute[74669]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:04:50 user nova-compute[74669]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:04:50 user nova-compute[74669]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)
Nov 08 17:04:50 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.391s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] HCTL ('38', '-', '-', 0) found on session 27 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Acquiring lock "c20b4c52-94b1-4aed-98f0-ae228df81175" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:50 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b8bfb971-094b-46cf-b8bd-ba3df8994e7a is timed out.
Nov 08 17:04:50 user nova-compute[74669]: INFO nova.compute.manager [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Detaching volume 8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4
Nov 08 17:04:50 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Successfully detached device vdb from instance b8bfb971-094b-46cf-b8bd-ba3df8994e7a from the live domain config.
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxGuTvRm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:04:50 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.043s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac24f40-7402-4784-9dd0-330fdb3e3656]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Searching for a device in session 27 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YPlxJAoV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:04:50 user nova-compute[74669]: INFO nova.virt.block_device [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Attempting to driver detach volume 8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 from mountpoint /dev/vdb
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Attempting to detach device vdb from instance c20b4c52-94b1-4aed-98f0-ae228df81175 from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:04:50 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:04:50 user nova-compute[74669]:   <source dev="/dev/sdd"/>
Nov 08 17:04:50 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:04:50 user nova-compute[74669]:   <serial>8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4</serial>
Nov 08 17:04:50 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:04:50 user nova-compute[74669]: </disk>
Nov 08 17:04:50 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:04:50 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Successfully detached device vdb from instance c20b4c52-94b1-4aed-98f0-ae228df81175 from the persistent domain config.
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c20b4c52-94b1-4aed-98f0-ae228df81175 from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 17:04:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:04:50 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:04:50 user nova-compute[74669]:   <source dev="/dev/sdd"/>
Nov 08 17:04:50 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:04:50 user nova-compute[74669]:   <serial>8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4</serial>
Nov 08 17:04:50 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:04:50 user nova-compute[74669]: </disk>
Nov 08 17:04:50 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c20b4c52-94b1-4aed-98f0-ae228df81175 {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] <== connect_volume: return (1455ms) {'type': 'block', 'scsi_wwn': '23133613936323261', 'path': '/dev/sdg'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133613936323261', 'path': '/dev/sdg'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.014s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T16:59:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-287785015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-287785015',id=17,image_ref='464ef1b3-4425-44d4-b651-2425c07b9469',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-185784068',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:00:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9f1e9778e17a4e0fa1aa1f41d323a88c',ramdisk_id='',reservation_id='r-fr2itb4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-317302826',owner_user_name='tempest-AttachVolumeShelveTestJSON-317302826-project-member',shelved_at='2023-11-08T17:01:59.492442',shelved_host='user',shelved_image_id='464ef1b3-4425-44d4-b651-2425c07b9469'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:03:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8bcb0586bce42a3a1a59b2cbc99f846',uuid=55c67717-eb46-4617-9165-28531360e5d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "address": "fa:16:3e:79:63:9e", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e437d3e-12", "ovs_interfaceid": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converting VIF {"id": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "address": "fa:16:3e:79:63:9e", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e437d3e-12", "ovs_interfaceid": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:63:9e,bridge_name='br-int',has_traffic_filtering=True,id=8e437d3e-12dd-4bec-aa76-2951dc03b5eb,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e437d3e-12') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG nova.objects.instance [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lazy-loading 'pci_devices' on Instance uuid 55c67717-eb46-4617-9165-28531360e5d7 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93dfa44-c756-4e33-b3b4-1fa44641f47a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:04:51 user nova-compute[74669]: No targets found.
Nov 08 17:04:51 user nova-compute[74669]: iSNS:
Nov 08 17:04:51 user nova-compute[74669]: No targets found.
Nov 08 17:04:51 user nova-compute[74669]: STATIC:
Nov 08 17:04:51 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f
Nov 08 17:04:51 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:04:51 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:04:51 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3
Nov 08 17:04:51 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:04:51 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:04:51 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4
Nov 08 17:04:51 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:04:51 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:04:51 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2
Nov 08 17:04:51 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:04:51 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:04:51 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79
Nov 08 17:04:51 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:04:51 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:04:51 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6
Nov 08 17:04:51 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:04:51 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:04:51 user nova-compute[74669]: FIRMWARE:
Nov 08 17:04:51 user nova-compute[74669]: No targets found.
Nov 08 17:04:51 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:04:51 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:04:51 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG nova.objects.base [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Object Instance<55c67717-eb46-4617-9165-28531360e5d7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:04:51 user nova-compute[74669]:   <uuid>55c67717-eb46-4617-9165-28531360e5d7</uuid>
Nov 08 17:04:51 user nova-compute[74669]:   <name>instance-00000011</name>
Nov 08 17:04:51 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:04:51 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:04:51 user nova-compute[74669]:   <metadata>
Nov 08 17:04:51 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:04:51 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:04:51 user nova-compute[74669]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-287785015</nova:name>
Nov 08 17:04:51 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:04:50</nova:creationTime>
Nov 08 17:04:51 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:04:51 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:04:51 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:04:51 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:04:51 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:04:51 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:04:51 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:04:51 user nova-compute[74669]:       <nova:owner>
Nov 08 17:04:51 user nova-compute[74669]:         <nova:user uuid="d8bcb0586bce42a3a1a59b2cbc99f846">tempest-AttachVolumeShelveTestJSON-317302826-project-member</nova:user>
Nov 08 17:04:51 user nova-compute[74669]:         <nova:project uuid="9f1e9778e17a4e0fa1aa1f41d323a88c">tempest-AttachVolumeShelveTestJSON-317302826</nova:project>
Nov 08 17:04:51 user nova-compute[74669]:       </nova:owner>
Nov 08 17:04:51 user nova-compute[74669]:       <nova:root type="image" uuid="464ef1b3-4425-44d4-b651-2425c07b9469"/>
Nov 08 17:04:51 user nova-compute[74669]:       <nova:ports>
Nov 08 17:04:51 user nova-compute[74669]:         <nova:port uuid="8e437d3e-12dd-4bec-aa76-2951dc03b5eb">
Nov 08 17:04:51 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 17:04:51 user nova-compute[74669]:         </nova:port>
Nov 08 17:04:51 user nova-compute[74669]:       </nova:ports>
Nov 08 17:04:51 user nova-compute[74669]:     </nova:instance>
Nov 08 17:04:51 user nova-compute[74669]:   </metadata>
Nov 08 17:04:51 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:04:51 user nova-compute[74669]:     <system>
Nov 08 17:04:51 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:04:51 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:04:51 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:04:51 user nova-compute[74669]:       <entry name="serial">55c67717-eb46-4617-9165-28531360e5d7</entry>
Nov 08 17:04:51 user nova-compute[74669]:       <entry name="uuid">55c67717-eb46-4617-9165-28531360e5d7</entry>
Nov 08 17:04:51 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:04:51 user nova-compute[74669]:     </system>
Nov 08 17:04:51 user nova-compute[74669]:   </sysinfo>
Nov 08 17:04:51 user nova-compute[74669]:   <os>
Nov 08 17:04:51 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:04:51 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:04:51 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:04:51 user nova-compute[74669]:   </os>
Nov 08 17:04:51 user nova-compute[74669]:   <features>
Nov 08 17:04:51 user nova-compute[74669]:     <acpi/>
Nov 08 17:04:51 user nova-compute[74669]:     <apic/>
Nov 08 17:04:51 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:04:51 user nova-compute[74669]:   </features>
Nov 08 17:04:51 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:04:51 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:04:51 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:04:51 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:04:51 user nova-compute[74669]:   </clock>
Nov 08 17:04:51 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:04:51 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:04:51 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:04:51 user nova-compute[74669]:   </cpu>
Nov 08 17:04:51 user nova-compute[74669]:   <devices>
Nov 08 17:04:51 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:04:51 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:04:51 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk"/>
Nov 08 17:04:51 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:04:51 user nova-compute[74669]:     </disk>
Nov 08 17:04:51 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 17:04:51 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:04:51 user nova-compute[74669]:       <source dev="/dev/sdg"/>
Nov 08 17:04:51 user nova-compute[74669]:       <target dev="vdc" bus="virtio"/>
Nov 08 17:04:51 user nova-compute[74669]:       <serial>e8124213-75fd-4ac0-bd18-e69f14601fc3</serial>
Nov 08 17:04:51 user nova-compute[74669]:     </disk>
Nov 08 17:04:51 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:04:51 user nova-compute[74669]:       <mac address="fa:16:3e:79:63:9e"/>
Nov 08 17:04:51 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:04:51 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:04:51 user nova-compute[74669]:       <target dev="tap8e437d3e-12"/>
Nov 08 17:04:51 user nova-compute[74669]:     </interface>
Nov 08 17:04:51 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:04:51 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/console.log" append="off"/>
Nov 08 17:04:51 user nova-compute[74669]:     </serial>
Nov 08 17:04:51 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:04:51 user nova-compute[74669]:     <video>
Nov 08 17:04:51 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:04:51 user nova-compute[74669]:     </video>
Nov 08 17:04:51 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:04:51 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:04:51 user nova-compute[74669]:     </rng>
Nov 08 17:04:51 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:04:51 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:04:51 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:04:51 user nova-compute[74669]:     </memballoon>
Nov 08 17:04:51 user nova-compute[74669]:   </devices>
Nov 08 17:04:51 user nova-compute[74669]: </domain>
Nov 08 17:04:51 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T16:59:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-287785015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-287785015',id=17,image_ref='464ef1b3-4425-44d4-b651-2425c07b9469',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-185784068',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:00:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9f1e9778e17a4e0fa1aa1f41d323a88c',ramdisk_id='',reservation_id='r-fr2itb4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-317302826',owner_user_name='tempest-AttachVolumeShelveTestJSON-317302826-project-member',shelved_at='2023-11-08T17:01:59.492442',shelved_host='user',shelved_image_id='464ef1b3-4425-44d4-b651-2425c07b9469'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:03:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8bcb0586bce42a3a1a59b2cbc99f846',uuid=55c67717-eb46-4617-9165-28531360e5d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "address": "fa:16:3e:79:63:9e", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e437d3e-12", "ovs_interfaceid": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converting VIF {"id": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "address": "fa:16:3e:79:63:9e", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e437d3e-12", "ovs_interfaceid": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:63:9e,bridge_name='br-int',has_traffic_filtering=True,id=8e437d3e-12dd-4bec-aa76-2951dc03b5eb,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e437d3e-12') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG os_vif [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:63:9e,bridge_name='br-int',has_traffic_filtering=True,id=8e437d3e-12dd-4bec-aa76-2951dc03b5eb,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e437d3e-12') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[829382bb-dc09-4307-b31f-8f24c4ed0fe0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4723ce94-0e33-5085-bdc1-b9b01a450539', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e437d3e-12, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e437d3e-12, col_values=(('qos', UUID('e1c665a4-3b4c-439b-b370-7865b61f0641')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e437d3e-12, col_values=(('external_ids', {'iface-id': '8e437d3e-12dd-4bec-aa76-2951dc03b5eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:63:9e', 'vm-uuid': '55c67717-eb46-4617-9165-28531360e5d7'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:51 user nova-compute[74669]: INFO os_vif [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:63:9e,bridge_name='br-int',has_traffic_filtering=True,id=8e437d3e-12dd-4bec-aa76-2951dc03b5eb,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e437d3e-12')
Nov 08 17:04:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba1916e-acf8-44c3-a652-4ec861d60c32]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:04:51 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:04:51 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:04:51 user nova-compute[74669]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:04:51 user nova-compute[74669]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:04:51 user nova-compute[74669]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)
Nov 08 17:04:51 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:04:51 user nova-compute[74669]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f (non-flash)
Nov 08 17:04:51 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:04:51 user nova-compute[74669]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:04:51 user nova-compute[74669]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:04:51 user nova-compute[74669]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)
Nov 08 17:04:51 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9846920e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f'): ({'sdc'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Removing single pathed devices sdc {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ff6ffa-a184-494c-a87e-673f9566c80d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be06319-7f69-4f76-bb4d-8215d35993bb]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Flushing IO for device /dev/sdc {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] No VIF found with MAC fa:16:3e:79:63:9e, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7444e8-61ca-4acb-b66a-b2720fcab086]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:04:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[67586943-2645-4dee-af2f-a4ee8462dc90]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5dcfef-0769-4c52-8450-a33bc91318bc]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d429e9-e67c-4fce-97a7-01a0816a7fef]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f, portal: 172.16.0.220,3260]
Nov 08 17:04:52 user nova-compute[74669]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f, portal: 172.16.0.220,3260] successful.
Nov 08 17:04:52 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3869521d-313b-4af0-b0c0-d58d213ec41f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9709257-f511-4426-9b35-aef97f2408e9]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] <== disconnect_volume: return (1429ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:52 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:04:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-dcac72a0-b70b-40c9-b5b3-13e95e164eeb req-524a3e94-a100-434c-adf1-f0f381ee0e81 service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Received event network-vif-plugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:04:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-dcac72a0-b70b-40c9-b5b3-13e95e164eeb req-524a3e94-a100-434c-adf1-f0f381ee0e81 service nova] Acquiring lock "55c67717-eb46-4617-9165-28531360e5d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:04:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-dcac72a0-b70b-40c9-b5b3-13e95e164eeb req-524a3e94-a100-434c-adf1-f0f381ee0e81 service nova] Lock "55c67717-eb46-4617-9165-28531360e5d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:04:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-dcac72a0-b70b-40c9-b5b3-13e95e164eeb req-524a3e94-a100-434c-adf1-f0f381ee0e81 service nova] Lock "55c67717-eb46-4617-9165-28531360e5d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-dcac72a0-b70b-40c9-b5b3-13e95e164eeb req-524a3e94-a100-434c-adf1-f0f381ee0e81 service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] No waiting events found dispatching network-vif-plugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:04:54 user nova-compute[74669]: WARNING nova.compute.manager [req-dcac72a0-b70b-40c9-b5b3-13e95e164eeb req-524a3e94-a100-434c-adf1-f0f381ee0e81 service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Received unexpected event network-vif-plugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 17:04:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.242s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:56 user nova-compute[74669]: DEBUG nova.compute.manager [req-aabe70c2-de4a-46a0-9968-999d60171620 req-06162dc9-46ff-4f0b-b0df-6f8e8c784d28 service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Received event network-vif-plugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:04:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-aabe70c2-de4a-46a0-9968-999d60171620 req-06162dc9-46ff-4f0b-b0df-6f8e8c784d28 service nova] Acquiring lock "55c67717-eb46-4617-9165-28531360e5d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:04:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-aabe70c2-de4a-46a0-9968-999d60171620 req-06162dc9-46ff-4f0b-b0df-6f8e8c784d28 service nova] Lock "55c67717-eb46-4617-9165-28531360e5d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:04:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-aabe70c2-de4a-46a0-9968-999d60171620 req-06162dc9-46ff-4f0b-b0df-6f8e8c784d28 service nova] Lock "55c67717-eb46-4617-9165-28531360e5d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:56 user nova-compute[74669]: DEBUG nova.compute.manager [req-aabe70c2-de4a-46a0-9968-999d60171620 req-06162dc9-46ff-4f0b-b0df-6f8e8c784d28 service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] No waiting events found dispatching network-vif-plugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:04:56 user nova-compute[74669]: WARNING nova.compute.manager [req-aabe70c2-de4a-46a0-9968-999d60171620 req-06162dc9-46ff-4f0b-b0df-6f8e8c784d28 service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Received unexpected event network-vif-plugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 17:04:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:04:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:56 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:04:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:04:56 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Instance spawned successfully.
Nov 08 17:04:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:57 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:04:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ac806bdb-de50-44b7-8f63-611e5e1cae84 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "55c67717-eb46-4617-9165-28531360e5d7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 70.837s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:04:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:04:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:04:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:59 user nova-compute[74669]: DEBUG nova.objects.instance [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lazy-loading 'flavor' on Instance uuid b8bfb971-094b-46cf-b8bd-ba3df8994e7a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:04:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-66157e6a-c273-4c78-b38a-1eb6f2cedf70 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.221s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:04:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:04:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:04:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:05:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:00 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:05:00 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:05:00 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=7069MB free_disk=25.038238525390625GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:05:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7b335462-0d93-4899-a223-5c2e36932578 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b663cd16-12b5-48fc-886d-0a7d160faea5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance c20b4c52-94b1-4aed-98f0-ae228df81175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b8bfb971-094b-46cf-b8bd-ba3df8994e7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance d91eaa51-6bf4-40eb-9f36-f8e838501373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance ee7af599-1f24-4828-913f-5ba3687619df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b68038d5-a01a-49a2-bd73-80cec03e68f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance af8b58ff-90d5-4a04-844a-ac0534a7e413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 55c67717-eb46-4617-9165-28531360e5d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 84fac5e1-7ef0-417a-8888-955a7c9f8944 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:05:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:05:01 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:05:01 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:05:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:05:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.728s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:05:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:02 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:05:02 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:05:02 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:05:02 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:05:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:05:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:05:02 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:05:03 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Updating instance_info_cache with network_info: [{"id": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "address": "fa:16:3e:e6:99:99", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bfc353f-1f", "ovs_interfaceid": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:05:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:05:03 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:05:03 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:05:03 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:05:03 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:05:03 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.volume.cinder [None req-6af293a0-ec05-4e0b-a8fd-faf89fede284 tempest-TestVolumeSwap-1708497689 tempest-TestVolumeSwap-1708497689-project-admin] Update attachment failed for attachment 66f18736-a2a5-4576-a08f-319920571760. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-59d4aabe-31d0-4095-81a4-997cceb48526) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-59d4aabe-31d0-4095-81a4-997cceb48526)
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [None req-6af293a0-ec05-4e0b-a8fd-faf89fede284 tempest-TestVolumeSwap-1708497689 tempest-TestVolumeSwap-1708497689-project-admin] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Failed to connect to volume 8b839d95-ad13-4597-a96c-120d47dd04ba with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-59d4aabe-31d0-4095-81a4-997cceb48526)
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Traceback (most recent call last):
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]     new_cinfo = self.volume_api.attachment_update(
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]     res = method(self, ctx, *args, **kwargs)
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]     with excutils.save_and_reraise_exception():
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]     self.force_reraise()
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]     raise self.value
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]     return method.func(obj, *args, **kwargs)
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]     resp = self._update('/attachments/%s' % id, body)
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]     return self.request(url, method, **kwargs)
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9]     raise exceptions.from_response(resp, body)
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-59d4aabe-31d0-4095-81a4-997cceb48526)
Nov 08 17:05:03 user nova-compute[74669]: ERROR nova.compute.manager [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] 
Nov 08 17:05:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6af293a0-ec05-4e0b-a8fd-faf89fede284 tempest-TestVolumeSwap-1708497689 tempest-TestVolumeSwap-1708497689-project-admin] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 31.387s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server [None req-6af293a0-ec05-4e0b-a8fd-faf89fede284 tempest-TestVolumeSwap-1708497689 tempest-TestVolumeSwap-1708497689-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-59d4aabe-31d0-4095-81a4-997cceb48526)
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7903, in swap_volume
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7901, in _do_locked_swap_volume
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7945, in _do_swap_volume
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7794, in _swap_volume
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-59d4aabe-31d0-4095-81a4-997cceb48526)
Nov 08 17:05:03 user nova-compute[74669]: ERROR oslo_messaging.rpc.server 
Nov 08 17:05:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:11 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c20b4c52-94b1-4aed-98f0-ae228df81175 is timed out.
Nov 08 17:05:11 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Successfully detached device vdb from instance c20b4c52-94b1-4aed-98f0-ae228df81175 from the live domain config.
Nov 08 17:05:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rnVoAlum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:05:11 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:05:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0f2ede-11cd-4e7f-bd0b-e70de3ac92e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:05:11 user nova-compute[74669]: No targets found.
Nov 08 17:05:11 user nova-compute[74669]: iSNS:
Nov 08 17:05:11 user nova-compute[74669]: No targets found.
Nov 08 17:05:11 user nova-compute[74669]: STATIC:
Nov 08 17:05:11 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3
Nov 08 17:05:11 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:05:11 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:05:11 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4
Nov 08 17:05:11 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:05:11 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:05:11 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2
Nov 08 17:05:11 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:05:11 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:05:11 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79
Nov 08 17:05:11 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:05:11 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:05:11 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6
Nov 08 17:05:11 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:05:11 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:05:11 user nova-compute[74669]: FIRMWARE:
Nov 08 17:05:11 user nova-compute[74669]: No targets found.
Nov 08 17:05:11 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:05:11 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:05:11 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4dc090-3d6c-410a-a982-7e736b66645f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[093966f3-a01d-4b84-84af-ec82441c19a2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:05:11 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:05:11 user nova-compute[74669]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:05:11 user nova-compute[74669]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:05:11 user nova-compute[74669]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)
Nov 08 17:05:11 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:05:11 user nova-compute[74669]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 (non-flash)
Nov 08 17:05:11 user nova-compute[74669]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:05:11 user nova-compute[74669]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:05:11 user nova-compute[74669]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)
Nov 08 17:05:11 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9a8276b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4'): ({'sdd'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Removing single pathed devices sdd {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d71c49-fe29-4ac8-9c0e-0b68638f7542]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e1116f-a6a1-4459-bbb6-64473b789f65]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Flushing IO for device /dev/sdd {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3b387d-e954-46ff-b327-1eece2fd312d]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f154b9c-e52f-4389-a295-c9dbf9f74144]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] SCSI volumes sdd have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[009452eb-223b-40a6-9137-022942df67a9]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c0aa38-1349-4642-bf1e-b2ba5438eee2]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4, portal: 172.16.0.220,3260]
Nov 08 17:05:11 user nova-compute[74669]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4, portal: 172.16.0.220,3260] successful.
Nov 08 17:05:11 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fda05b2-951e-4ae4-8cc0-6fcfa51cb1f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[04730a87-05e2-47d2-9903-d2440b640b6e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] <== disconnect_volume: return (347ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:05:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:05:12 user nova-compute[74669]: DEBUG nova.objects.instance [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lazy-loading 'flavor' on Instance uuid c20b4c52-94b1-4aed-98f0-ae228df81175 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:05:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-655ea43a-7012-4eb3-bba1-b01cb19d58ac tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.317s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:05:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-0afd785b-444e-4c1b-bfb8-562e783f0b2c req-251d7613-6ade-4687-a7d6-9d4e521dac45 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received event network-changed-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:05:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-0afd785b-444e-4c1b-bfb8-562e783f0b2c req-251d7613-6ade-4687-a7d6-9d4e521dac45 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Refreshing instance network info cache due to event network-changed-d0dc10aa-3fca-4242-8895-241190da8780. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:05:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0afd785b-444e-4c1b-bfb8-562e783f0b2c req-251d7613-6ade-4687-a7d6-9d4e521dac45 service nova] Acquiring lock "refresh_cache-af8b58ff-90d5-4a04-844a-ac0534a7e413" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:05:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0afd785b-444e-4c1b-bfb8-562e783f0b2c req-251d7613-6ade-4687-a7d6-9d4e521dac45 service nova] Acquired lock "refresh_cache-af8b58ff-90d5-4a04-844a-ac0534a7e413" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:05:28 user nova-compute[74669]: DEBUG nova.network.neutron [req-0afd785b-444e-4c1b-bfb8-562e783f0b2c req-251d7613-6ade-4687-a7d6-9d4e521dac45 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Refreshing network info cache for port d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:05:29 user nova-compute[74669]: DEBUG nova.network.neutron [req-0afd785b-444e-4c1b-bfb8-562e783f0b2c req-251d7613-6ade-4687-a7d6-9d4e521dac45 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Updated VIF entry in instance network info cache for port d0dc10aa-3fca-4242-8895-241190da8780. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:05:29 user nova-compute[74669]: DEBUG nova.network.neutron [req-0afd785b-444e-4c1b-bfb8-562e783f0b2c req-251d7613-6ade-4687-a7d6-9d4e521dac45 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Updating instance_info_cache with network_info: [{"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:05:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0afd785b-444e-4c1b-bfb8-562e783f0b2c req-251d7613-6ade-4687-a7d6-9d4e521dac45 service nova] Releasing lock "refresh_cache-af8b58ff-90d5-4a04-844a-ac0534a7e413" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:05:31 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:05:32 user nova-compute[74669]: INFO nova.compute.manager [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Terminating instance
Nov 08 17:05:32 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG nova.compute.manager [req-9b5e80ee-e54f-4f2c-9049-862dec6c1644 req-5439d71d-d673-45b3-9f34-6d926500f986 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Received event network-vif-unplugged-6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9b5e80ee-e54f-4f2c-9049-862dec6c1644 req-5439d71d-d673-45b3-9f34-6d926500f986 service nova] Acquiring lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9b5e80ee-e54f-4f2c-9049-862dec6c1644 req-5439d71d-d673-45b3-9f34-6d926500f986 service nova] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9b5e80ee-e54f-4f2c-9049-862dec6c1644 req-5439d71d-d673-45b3-9f34-6d926500f986 service nova] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG nova.compute.manager [req-9b5e80ee-e54f-4f2c-9049-862dec6c1644 req-5439d71d-d673-45b3-9f34-6d926500f986 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] No waiting events found dispatching network-vif-unplugged-6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG nova.compute.manager [req-9b5e80ee-e54f-4f2c-9049-862dec6c1644 req-5439d71d-d673-45b3-9f34-6d926500f986 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Received event network-vif-unplugged-6582b38d-2366-43fe-9a2b-6990e7bc165b for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:32 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Instance destroyed successfully.
Nov 08 17:05:32 user nova-compute[74669]: DEBUG nova.objects.instance [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lazy-loading 'resources' on Instance uuid b8bfb971-094b-46cf-b8bd-ba3df8994e7a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:00:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1396004842',display_name='tempest-TestMinimumBasicScenario-server-1396004842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1396004842',id=19,image_ref='527ca5aa-ca8a-47f5-8e2d-d2ec0a0d39e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCOD1NU5AKnSEY5ecgGJBWw2CuqlrxCDwkJtqxOzcMha6UEVuT3KdyNUtjj2i4UoYzgC+WcJUNwzoVbSVK+8J24XNPeP7yPtaPMCLWTXNnIgHAt+SU2oKE9MWioZA6wFA==',key_name='tempest-TestMinimumBasicScenario-1345680325',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:00:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39bcebfdde5c48dc8857824275b0082e',ramdisk_id='',reservation_id='r-1q48xzql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='527ca5aa-ca8a-47f5-8e2d-d2ec0a0d39e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1167063302',owner_user_name='tempest-TestMinimumBasicScenario-1167063302-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:02:44Z,user_data=None,user_id='d6fd033f262943cdabb12db63b11eca8',uuid=b8bfb971-094b-46cf-b8bd-ba3df8994e7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "address": "fa:16:3e:93:f5:4a", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6582b38d-23", "ovs_interfaceid": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Converting VIF {"id": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "address": "fa:16:3e:93:f5:4a", "network": {"id": "c618e3db-19f3-4b21-aa37-98985a7bf610", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-382571117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39bcebfdde5c48dc8857824275b0082e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6582b38d-23", "ovs_interfaceid": "6582b38d-2366-43fe-9a2b-6990e7bc165b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:f5:4a,bridge_name='br-int',has_traffic_filtering=True,id=6582b38d-2366-43fe-9a2b-6990e7bc165b,network=Network(c618e3db-19f3-4b21-aa37-98985a7bf610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6582b38d-23') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG os_vif [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:f5:4a,bridge_name='br-int',has_traffic_filtering=True,id=6582b38d-2366-43fe-9a2b-6990e7bc165b,network=Network(c618e3db-19f3-4b21-aa37-98985a7bf610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6582b38d-23') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6582b38d-23, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8dc77147-7a68-4b80-ace9-95d1ee4d68e3) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:32 user nova-compute[74669]: INFO os_vif [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:f5:4a,bridge_name='br-int',has_traffic_filtering=True,id=6582b38d-2366-43fe-9a2b-6990e7bc165b,network=Network(c618e3db-19f3-4b21-aa37-98985a7bf610),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6582b38d-23')
Nov 08 17:05:32 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Deleting instance files /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a_del
Nov 08 17:05:32 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Deletion of /opt/stack/data/nova/instances/b8bfb971-094b-46cf-b8bd-ba3df8994e7a_del complete
Nov 08 17:05:32 user nova-compute[74669]: INFO nova.compute.manager [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 08 17:05:32 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:05:32 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:05:33 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:05:33 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Took 0.57 seconds to deallocate network for instance.
Nov 08 17:05:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:33 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:05:34 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:05:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:05:34 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Deleted allocations for instance b8bfb971-094b-46cf-b8bd-ba3df8994e7a
Nov 08 17:05:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e6a531d0-8661-4fbc-9d79-0e5eb0651ce6 tempest-TestMinimumBasicScenario-1167063302 tempest-TestMinimumBasicScenario-1167063302-project-member] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.095s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:05:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-214986a9-325f-4589-81f3-58373db3e2da req-7a0ec3e3-ddf9-4afc-a77f-3c73b92934e7 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Received event network-vif-plugged-6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:05:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-214986a9-325f-4589-81f3-58373db3e2da req-7a0ec3e3-ddf9-4afc-a77f-3c73b92934e7 service nova] Acquiring lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-214986a9-325f-4589-81f3-58373db3e2da req-7a0ec3e3-ddf9-4afc-a77f-3c73b92934e7 service nova] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-214986a9-325f-4589-81f3-58373db3e2da req-7a0ec3e3-ddf9-4afc-a77f-3c73b92934e7 service nova] Lock "b8bfb971-094b-46cf-b8bd-ba3df8994e7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:05:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-214986a9-325f-4589-81f3-58373db3e2da req-7a0ec3e3-ddf9-4afc-a77f-3c73b92934e7 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] No waiting events found dispatching network-vif-plugged-6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:05:34 user nova-compute[74669]: WARNING nova.compute.manager [req-214986a9-325f-4589-81f3-58373db3e2da req-7a0ec3e3-ddf9-4afc-a77f-3c73b92934e7 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Received unexpected event network-vif-plugged-6582b38d-2366-43fe-9a2b-6990e7bc165b for instance with vm_state deleted and task_state None.
Nov 08 17:05:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-214986a9-325f-4589-81f3-58373db3e2da req-7a0ec3e3-ddf9-4afc-a77f-3c73b92934e7 service nova] [instance: b8bfb971-094b-46cf-b8bd-ba3df8994e7a] Received event network-vif-deleted-6582b38d-2366-43fe-9a2b-6990e7bc165b {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:05:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "b663cd16-12b5-48fc-886d-0a7d160faea5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:36 user nova-compute[74669]: INFO nova.compute.manager [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Detaching volume f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2
Nov 08 17:05:36 user nova-compute[74669]: INFO nova.virt.block_device [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Attempting to driver detach volume f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 from mountpoint /dev/vdb
Nov 08 17:05:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Attempting to detach device vdb from instance b663cd16-12b5-48fc-886d-0a7d160faea5 from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 17:05:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:05:36 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:05:36 user nova-compute[74669]:   <source dev="/dev/sdb"/>
Nov 08 17:05:36 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:05:36 user nova-compute[74669]:   <serial>f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2</serial>
Nov 08 17:05:36 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:05:36 user nova-compute[74669]: </disk>
Nov 08 17:05:36 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:05:36 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Successfully detached device vdb from instance b663cd16-12b5-48fc-886d-0a7d160faea5 from the persistent domain config.
Nov 08 17:05:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b663cd16-12b5-48fc-886d-0a7d160faea5 from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 17:05:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:05:36 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:05:36 user nova-compute[74669]:   <source dev="/dev/sdb"/>
Nov 08 17:05:36 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:05:36 user nova-compute[74669]:   <serial>f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2</serial>
Nov 08 17:05:36 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:05:36 user nova-compute[74669]: </disk>
Nov 08 17:05:36 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:05:36 user nova-compute[74669]: DEBUG nova.compute.manager [req-98f03316-dd17-45a3-b8e8-f204db8622ea req-fed4f38a-c173-43e5-812d-89126fd4740a service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received event network-changed-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:05:36 user nova-compute[74669]: DEBUG nova.compute.manager [req-98f03316-dd17-45a3-b8e8-f204db8622ea req-fed4f38a-c173-43e5-812d-89126fd4740a service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Refreshing instance network info cache due to event network-changed-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:05:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-98f03316-dd17-45a3-b8e8-f204db8622ea req-fed4f38a-c173-43e5-812d-89126fd4740a service nova] Acquiring lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:05:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-98f03316-dd17-45a3-b8e8-f204db8622ea req-fed4f38a-c173-43e5-812d-89126fd4740a service nova] Acquired lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:05:36 user nova-compute[74669]: DEBUG nova.network.neutron [req-98f03316-dd17-45a3-b8e8-f204db8622ea req-fed4f38a-c173-43e5-812d-89126fd4740a service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Refreshing network info cache for port f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:05:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b663cd16-12b5-48fc-886d-0a7d160faea5 {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 17:05:36 user nova-compute[74669]: DEBUG nova.network.neutron [req-98f03316-dd17-45a3-b8e8-f204db8622ea req-fed4f38a-c173-43e5-812d-89126fd4740a service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Updated VIF entry in instance network info cache for port f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:05:36 user nova-compute[74669]: DEBUG nova.network.neutron [req-98f03316-dd17-45a3-b8e8-f204db8622ea req-fed4f38a-c173-43e5-812d-89126fd4740a service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Updating instance_info_cache with network_info: [{"id": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "address": "fa:16:3e:70:48:8f", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c0ff3a-f7", "ovs_interfaceid": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:05:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-98f03316-dd17-45a3-b8e8-f204db8622ea req-fed4f38a-c173-43e5-812d-89126fd4740a service nova] Releasing lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:05:36 user nova-compute[74669]: DEBUG nova.compute.manager [req-98f03316-dd17-45a3-b8e8-f204db8622ea req-fed4f38a-c173-43e5-812d-89126fd4740a service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received event network-changed-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:05:36 user nova-compute[74669]: DEBUG nova.compute.manager [req-98f03316-dd17-45a3-b8e8-f204db8622ea req-fed4f38a-c173-43e5-812d-89126fd4740a service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Refreshing instance network info cache due to event network-changed-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:05:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-98f03316-dd17-45a3-b8e8-f204db8622ea req-fed4f38a-c173-43e5-812d-89126fd4740a service nova] Acquiring lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:05:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-98f03316-dd17-45a3-b8e8-f204db8622ea req-fed4f38a-c173-43e5-812d-89126fd4740a service nova] Acquired lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:05:36 user nova-compute[74669]: DEBUG nova.network.neutron [req-98f03316-dd17-45a3-b8e8-f204db8622ea req-fed4f38a-c173-43e5-812d-89126fd4740a service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Refreshing network info cache for port f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:05:37 user nova-compute[74669]: DEBUG nova.network.neutron [req-98f03316-dd17-45a3-b8e8-f204db8622ea req-fed4f38a-c173-43e5-812d-89126fd4740a service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Updated VIF entry in instance network info cache for port f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:05:37 user nova-compute[74669]: DEBUG nova.network.neutron [req-98f03316-dd17-45a3-b8e8-f204db8622ea req-fed4f38a-c173-43e5-812d-89126fd4740a service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Updating instance_info_cache with network_info: [{"id": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "address": "fa:16:3e:70:48:8f", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c0ff3a-f7", "ovs_interfaceid": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:05:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-98f03316-dd17-45a3-b8e8-f204db8622ea req-fed4f38a-c173-43e5-812d-89126fd4740a service nova] Releasing lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:05:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Acquiring lock "c20b4c52-94b1-4aed-98f0-ae228df81175" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Acquiring lock "c20b4c52-94b1-4aed-98f0-ae228df81175-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:05:41 user nova-compute[74669]: INFO nova.compute.manager [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Terminating instance
Nov 08 17:05:41 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:05:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:41 user nova-compute[74669]: DEBUG nova.compute.manager [req-1d8c96e5-7a8b-4cec-9246-ecedd07b1d43 req-7af21eea-cd93-4164-832b-27768dc0c507 service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Received event network-vif-unplugged-1f3f9a10-8444-4120-859e-c682589df53e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:05:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1d8c96e5-7a8b-4cec-9246-ecedd07b1d43 req-7af21eea-cd93-4164-832b-27768dc0c507 service nova] Acquiring lock "c20b4c52-94b1-4aed-98f0-ae228df81175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1d8c96e5-7a8b-4cec-9246-ecedd07b1d43 req-7af21eea-cd93-4164-832b-27768dc0c507 service nova] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1d8c96e5-7a8b-4cec-9246-ecedd07b1d43 req-7af21eea-cd93-4164-832b-27768dc0c507 service nova] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:05:41 user nova-compute[74669]: DEBUG nova.compute.manager [req-1d8c96e5-7a8b-4cec-9246-ecedd07b1d43 req-7af21eea-cd93-4164-832b-27768dc0c507 service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] No waiting events found dispatching network-vif-unplugged-1f3f9a10-8444-4120-859e-c682589df53e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:05:41 user nova-compute[74669]: DEBUG nova.compute.manager [req-1d8c96e5-7a8b-4cec-9246-ecedd07b1d43 req-7af21eea-cd93-4164-832b-27768dc0c507 service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Received event network-vif-unplugged-1f3f9a10-8444-4120-859e-c682589df53e for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:05:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:42 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Instance destroyed successfully.
Nov 08 17:05:42 user nova-compute[74669]: DEBUG nova.objects.instance [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lazy-loading 'resources' on Instance uuid c20b4c52-94b1-4aed-98f0-ae228df81175 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:05:42 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1284191940',display_name='tempest-TestServerVolumeAttachmentScenario-server-1284191940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1284191940',id=18,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbJYMlPQ4GKmKUtDbAjenDGMeXLqQpRW5oj85LY3v4pCJeaVU2m8wytGDB15EoXjGERIWPOYapJZ4KWzbHKYKk8yb4Y04AX0h8N6aREyby7hBt8m0c7qdj+9pozuajuEA==',key_name='tempest-keypair-737894091',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:00:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faf3cd12d36542129de95b6a2b473906',ramdisk_id='',reservation_id='r-d1i60x6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-61284172',owner_user_name='tempest-TestServerVolumeAttachmentScenario-61284172-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:00:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbcab9c7167b463aa19203215af5a91a',uuid=c20b4c52-94b1-4aed-98f0-ae228df81175,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f3f9a10-8444-4120-859e-c682589df53e", "address": "fa:16:3e:62:af:a3", "network": {"id": "41edded2-dc16-49e9-8b02-b176d6e4ff77", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-901731550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faf3cd12d36542129de95b6a2b473906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3f9a10-84", "ovs_interfaceid": "1f3f9a10-8444-4120-859e-c682589df53e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:05:42 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Converting VIF {"id": "1f3f9a10-8444-4120-859e-c682589df53e", "address": "fa:16:3e:62:af:a3", "network": {"id": "41edded2-dc16-49e9-8b02-b176d6e4ff77", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-901731550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faf3cd12d36542129de95b6a2b473906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3f9a10-84", "ovs_interfaceid": "1f3f9a10-8444-4120-859e-c682589df53e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:05:42 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:af:a3,bridge_name='br-int',has_traffic_filtering=True,id=1f3f9a10-8444-4120-859e-c682589df53e,network=Network(41edded2-dc16-49e9-8b02-b176d6e4ff77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f3f9a10-84') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:05:42 user nova-compute[74669]: DEBUG os_vif [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:af:a3,bridge_name='br-int',has_traffic_filtering=True,id=1f3f9a10-8444-4120-859e-c682589df53e,network=Network(41edded2-dc16-49e9-8b02-b176d6e4ff77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f3f9a10-84') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:05:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f3f9a10-84, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:05:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:05:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76db03df-556e-470f-8ce3-bb0aa4fd32b1) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:05:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:42 user nova-compute[74669]: INFO os_vif [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:af:a3,bridge_name='br-int',has_traffic_filtering=True,id=1f3f9a10-8444-4120-859e-c682589df53e,network=Network(41edded2-dc16-49e9-8b02-b176d6e4ff77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f3f9a10-84')
Nov 08 17:05:42 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Deleting instance files /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175_del
Nov 08 17:05:42 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Deletion of /opt/stack/data/nova/instances/c20b4c52-94b1-4aed-98f0-ae228df81175_del complete
Nov 08 17:05:42 user nova-compute[74669]: INFO nova.compute.manager [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 08 17:05:42 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:05:42 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:05:42 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:05:43 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:05:43 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Took 0.85 seconds to deallocate network for instance.
Nov 08 17:05:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:43 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:05:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:43 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:05:43 user nova-compute[74669]: DEBUG nova.compute.manager [req-92e3c02c-00b5-4064-8c06-8000e7c7cdb0 req-fe8b239c-fe4c-4e19-8970-77cce3a18ccc service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Received event network-vif-plugged-1f3f9a10-8444-4120-859e-c682589df53e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:05:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-92e3c02c-00b5-4064-8c06-8000e7c7cdb0 req-fe8b239c-fe4c-4e19-8970-77cce3a18ccc service nova] Acquiring lock "c20b4c52-94b1-4aed-98f0-ae228df81175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-92e3c02c-00b5-4064-8c06-8000e7c7cdb0 req-fe8b239c-fe4c-4e19-8970-77cce3a18ccc service nova] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-92e3c02c-00b5-4064-8c06-8000e7c7cdb0 req-fe8b239c-fe4c-4e19-8970-77cce3a18ccc service nova] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:05:43 user nova-compute[74669]: DEBUG nova.compute.manager [req-92e3c02c-00b5-4064-8c06-8000e7c7cdb0 req-fe8b239c-fe4c-4e19-8970-77cce3a18ccc service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] No waiting events found dispatching network-vif-plugged-1f3f9a10-8444-4120-859e-c682589df53e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:05:43 user nova-compute[74669]: WARNING nova.compute.manager [req-92e3c02c-00b5-4064-8c06-8000e7c7cdb0 req-fe8b239c-fe4c-4e19-8970-77cce3a18ccc service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Received unexpected event network-vif-plugged-1f3f9a10-8444-4120-859e-c682589df53e for instance with vm_state deleted and task_state None.
Nov 08 17:05:43 user nova-compute[74669]: DEBUG nova.compute.manager [req-92e3c02c-00b5-4064-8c06-8000e7c7cdb0 req-fe8b239c-fe4c-4e19-8970-77cce3a18ccc service nova] [instance: c20b4c52-94b1-4aed-98f0-ae228df81175] Received event network-vif-deleted-1f3f9a10-8444-4120-859e-c682589df53e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:05:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.481s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:05:43 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Deleted allocations for instance c20b4c52-94b1-4aed-98f0-ae228df81175
Nov 08 17:05:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e4abc874-504e-4c73-8f4f-3bdd52270777 tempest-TestServerVolumeAttachmentScenario-61284172 tempest-TestServerVolumeAttachmentScenario-61284172-project-member] Lock "c20b4c52-94b1-4aed-98f0-ae228df81175" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.674s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:05:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-fc69672e-4b8f-4d15-a8f4-395ba7ceb4f1 req-db17ec9c-7e2a-4929-a077-78cceb9f0dfb service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Received event network-changed-3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:05:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-fc69672e-4b8f-4d15-a8f4-395ba7ceb4f1 req-db17ec9c-7e2a-4929-a077-78cceb9f0dfb service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Refreshing instance network info cache due to event network-changed-3021424c-2541-449d-b3f8-ffca35fdb364. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:05:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-fc69672e-4b8f-4d15-a8f4-395ba7ceb4f1 req-db17ec9c-7e2a-4929-a077-78cceb9f0dfb service nova] Acquiring lock "refresh_cache-5575cb2b-b93d-4048-bb96-c4cd7f19ee1d" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:05:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-fc69672e-4b8f-4d15-a8f4-395ba7ceb4f1 req-db17ec9c-7e2a-4929-a077-78cceb9f0dfb service nova] Acquired lock "refresh_cache-5575cb2b-b93d-4048-bb96-c4cd7f19ee1d" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:05:44 user nova-compute[74669]: DEBUG nova.network.neutron [req-fc69672e-4b8f-4d15-a8f4-395ba7ceb4f1 req-db17ec9c-7e2a-4929-a077-78cceb9f0dfb service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Refreshing network info cache for port 3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:05:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:44 user nova-compute[74669]: DEBUG nova.objects.instance [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'flavor' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:05:44 user nova-compute[74669]: DEBUG nova.network.neutron [req-fc69672e-4b8f-4d15-a8f4-395ba7ceb4f1 req-db17ec9c-7e2a-4929-a077-78cceb9f0dfb service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Updated VIF entry in instance network info cache for port 3021424c-2541-449d-b3f8-ffca35fdb364. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:05:44 user nova-compute[74669]: DEBUG nova.network.neutron [req-fc69672e-4b8f-4d15-a8f4-395ba7ceb4f1 req-db17ec9c-7e2a-4929-a077-78cceb9f0dfb service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Updating instance_info_cache with network_info: [{"id": "3021424c-2541-449d-b3f8-ffca35fdb364", "address": "fa:16:3e:6f:e9:d8", "network": {"id": "2b28db73-56c6-4cc7-95de-75ec297a7809", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-839594529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5706466a59c34a878f3eafcebee088d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3021424c-25", "ovs_interfaceid": "3021424c-2541-449d-b3f8-ffca35fdb364", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:05:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:05:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-fc69672e-4b8f-4d15-a8f4-395ba7ceb4f1 req-db17ec9c-7e2a-4929-a077-78cceb9f0dfb service nova] Releasing lock "refresh_cache-5575cb2b-b93d-4048-bb96-c4cd7f19ee1d" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:45 user nova-compute[74669]: INFO nova.compute.manager [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Attaching volume a2d3bf54-9d77-4c85-a92a-6192eae32c7b to /dev/vdb
Nov 08 17:05:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG os_brick.utils [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d948802-ebba-4b27-b64d-fb1ecf00c49a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4246300a-30c0-4e4a-a5a1-3ec312391a19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[69812ded-05b7-4658-af88-458e473975ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4aad7c-25e2-4528-aaae-335c8a697d86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:05:45 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:05:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b8f6d0-7faa-4890-aa71-90a84cc6dfbb]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG os_brick.utils [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:05:45 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Updating existing volume attachment record: 2e23770b-ccc2-4f2b-a216-c882f90abc9f {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:05:45 user nova-compute[74669]: INFO nova.compute.manager [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Rebuilding instance
Nov 08 17:05:46 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG nova.compute.manager [req-e7ddb9bd-7bef-4468-bcb9-81619d4ffc35 req-159cc24f-4316-4df2-8795-7cccf3e2e45c service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Received event network-vif-unplugged-3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e7ddb9bd-7bef-4468-bcb9-81619d4ffc35 req-159cc24f-4316-4df2-8795-7cccf3e2e45c service nova] Acquiring lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e7ddb9bd-7bef-4468-bcb9-81619d4ffc35 req-159cc24f-4316-4df2-8795-7cccf3e2e45c service nova] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e7ddb9bd-7bef-4468-bcb9-81619d4ffc35 req-159cc24f-4316-4df2-8795-7cccf3e2e45c service nova] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG nova.compute.manager [req-e7ddb9bd-7bef-4468-bcb9-81619d4ffc35 req-159cc24f-4316-4df2-8795-7cccf3e2e45c service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] No waiting events found dispatching network-vif-unplugged-3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:05:46 user nova-compute[74669]: WARNING nova.compute.manager [req-e7ddb9bd-7bef-4468-bcb9-81619d4ffc35 req-159cc24f-4316-4df2-8795-7cccf3e2e45c service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Received unexpected event network-vif-unplugged-3021424c-2541-449d-b3f8-ffca35fdb364 for instance with vm_state active and task_state rebuilding.
Nov 08 17:05:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:46 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Instance destroyed successfully.
Nov 08 17:05:46 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Instance destroyed successfully.
Nov 08 17:05:46 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:03:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-858788957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-638839753',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgUCl1WLcb59V3Q5jCPwB0FEUGaJcnditDCK4NsYCVn5HJLFzTT3spZBJc6w7p9cbfNoX8cf7k8DGPcXuUOV2irdcP0AhcWgDxOJyANKtp67p0tg/YP8TSLWl4B1A/hJw==',key_name='tempest-keypair-1263187494',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:04:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5706466a59c34a878f3eafcebee088d0',ramdisk_id='',reservation_id='r-bl0nidls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-494820798',owner_user_name='tempest-ServerActionsV293TestJSON-494820798-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:05:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b443fd16646495790682d8ad338df57',uuid=5575cb2b-b93d-4048-bb96-c4cd7f19ee1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3021424c-2541-449d-b3f8-ffca35fdb364", "address": "fa:16:3e:6f:e9:d8", "network": {"id": "2b28db73-56c6-4cc7-95de-75ec297a7809", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-839594529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5706466a59c34a878f3eafcebee088d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3021424c-25", "ovs_interfaceid": "3021424c-2541-449d-b3f8-ffca35fdb364", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Converting VIF {"id": "3021424c-2541-449d-b3f8-ffca35fdb364", "address": "fa:16:3e:6f:e9:d8", "network": {"id": "2b28db73-56c6-4cc7-95de-75ec297a7809", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-839594529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5706466a59c34a878f3eafcebee088d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3021424c-25", "ovs_interfaceid": "3021424c-2541-449d-b3f8-ffca35fdb364", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:e9:d8,bridge_name='br-int',has_traffic_filtering=True,id=3021424c-2541-449d-b3f8-ffca35fdb364,network=Network(2b28db73-56c6-4cc7-95de-75ec297a7809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3021424c-25') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG os_vif [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:e9:d8,bridge_name='br-int',has_traffic_filtering=True,id=3021424c-2541-449d-b3f8-ffca35fdb364,network=Network(2b28db73-56c6-4cc7-95de-75ec297a7809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3021424c-25') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3021424c-25, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72a1d057-ee1f-45b0-bb59-d6c21e929aa7) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:05:46 user nova-compute[74669]: INFO os_vif [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:e9:d8,bridge_name='br-int',has_traffic_filtering=True,id=3021424c-2541-449d-b3f8-ffca35fdb364,network=Network(2b28db73-56c6-4cc7-95de-75ec297a7809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3021424c-25')
Nov 08 17:05:46 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOWSyBVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:05:46 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 17:05:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[85572ccd-ebfc-4e75-b369-e1114bbb5034]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:05:46 user nova-compute[74669]: No targets found.
Nov 08 17:05:46 user nova-compute[74669]: iSNS:
Nov 08 17:05:46 user nova-compute[74669]: No targets found.
Nov 08 17:05:46 user nova-compute[74669]: STATIC:
Nov 08 17:05:46 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3
Nov 08 17:05:46 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:05:46 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:05:46 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2
Nov 08 17:05:46 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:05:46 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:05:46 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79
Nov 08 17:05:46 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:05:46 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:05:46 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6
Nov 08 17:05:46 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:05:46 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:05:46 user nova-compute[74669]: FIRMWARE:
Nov 08 17:05:46 user nova-compute[74669]: No targets found.
Nov 08 17:05:46 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:05:46 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:05:46 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a282ad-0281-46f3-9466-21bd5ba76268]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4005403a-7f96-4f34-89c2-6e89bdb26170]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:05:47 user nova-compute[74669]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:05:47 user nova-compute[74669]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:05:47 user nova-compute[74669]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)
Nov 08 17:05:47 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:05:47 user nova-compute[74669]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:05:47 user nova-compute[74669]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:05:47 user nova-compute[74669]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)
Nov 08 17:05:47 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9ba2c36d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79'): ({'sdf'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Removing single pathed devices sdf {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f7fac1-9405-44e8-b621-b234a76df839]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bde358-0ed3-443f-aa10-bc608cbebdb5]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Flushing IO for device /dev/sdf {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[65afb920-f22b-443a-8384-4641ad1c6fd8]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[acebb76f-27bc-435c-b58e-db11751a65b3]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] SCSI volumes sdf have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9b40ac-ba00-4998-a8a4-fe3b352eded9]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c97097-4b11-48e4-a549-6718aecb840d]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79, portal: 172.16.0.220,3260]
Nov 08 17:05:47 user nova-compute[74669]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79, portal: 172.16.0.220,3260] successful.
Nov 08 17:05:47 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebc1e98-a99a-4675-9adb-f3b7111d77f9]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] <== disconnect_volume: return (343ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:05:47 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Deleting instance files /opt/stack/data/nova/instances/5575cb2b-b93d-4048-bb96-c4cd7f19ee1d_del
Nov 08 17:05:47 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Deletion of /opt/stack/data/nova/instances/5575cb2b-b93d-4048-bb96-c4cd7f19ee1d_del complete
Nov 08 17:05:47 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d could not be found.
Nov 08 17:05:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOWSyBVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:05:47 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4ecf29-0b39-4a30-bc53-39954c7b0d9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:05:47 user nova-compute[74669]: No targets found.
Nov 08 17:05:47 user nova-compute[74669]: iSNS:
Nov 08 17:05:47 user nova-compute[74669]: No targets found.
Nov 08 17:05:47 user nova-compute[74669]: STATIC:
Nov 08 17:05:47 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3
Nov 08 17:05:47 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:05:47 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:05:47 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2
Nov 08 17:05:47 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:05:47 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:05:47 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6
Nov 08 17:05:47 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:05:47 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:05:47 user nova-compute[74669]: FIRMWARE:
Nov 08 17:05:47 user nova-compute[74669]: No targets found.
Nov 08 17:05:47 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:05:47 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:05:47 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[66602e31-1f44-4cc1-9c1a-8476d5aa7f0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[414e8ec1-b6a4-469a-a052-0bc4c2f089fc]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:05:47 user nova-compute[74669]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:05:47 user nova-compute[74669]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)
Nov 08 17:05:47 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:05:47 user nova-compute[74669]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:05:47 user nova-compute[74669]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)
Nov 08 17:05:47 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9b9fd3f40>, {}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Disconnecting from: [] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] <== disconnect_volume: return (84ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:05:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:05:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-2b8b29b3-cfd9-4bce-87f3-3694a771c7b2 req-11bce285-6c00-4dbf-ad04-3ea4854aec8a service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Received event network-vif-plugged-3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:05:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2b8b29b3-cfd9-4bce-87f3-3694a771c7b2 req-11bce285-6c00-4dbf-ad04-3ea4854aec8a service nova] Acquiring lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2b8b29b3-cfd9-4bce-87f3-3694a771c7b2 req-11bce285-6c00-4dbf-ad04-3ea4854aec8a service nova] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2b8b29b3-cfd9-4bce-87f3-3694a771c7b2 req-11bce285-6c00-4dbf-ad04-3ea4854aec8a service nova] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:05:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-2b8b29b3-cfd9-4bce-87f3-3694a771c7b2 req-11bce285-6c00-4dbf-ad04-3ea4854aec8a service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] No waiting events found dispatching network-vif-plugged-3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:05:48 user nova-compute[74669]: WARNING nova.compute.manager [req-2b8b29b3-cfd9-4bce-87f3-3694a771c7b2 req-11bce285-6c00-4dbf-ad04-3ea4854aec8a service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Received unexpected event network-vif-plugged-3021424c-2541-449d-b3f8-ffca35fdb364 for instance with vm_state active and task_state rebuilding.
Nov 08 17:05:48 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Preparing to wait for external event volume-reimaged-27fd5c1d-4793-43c2-8ebf-f021e25b5a79 {{(pid=74669) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 08 17:05:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Acquiring lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:05:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:52 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:05:52 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:05:52 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:05:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:05:52 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:05:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:56 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b663cd16-12b5-48fc-886d-0a7d160faea5 is timed out.
Nov 08 17:05:56 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Successfully detached device vdb from instance b663cd16-12b5-48fc-886d-0a7d160faea5 from the live domain config.
Nov 08 17:05:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBhCzkmx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:05:56 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:05:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8a02fd-1deb-4c6a-b9c0-bc5b5b18523d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:05:56 user nova-compute[74669]: No targets found.
Nov 08 17:05:56 user nova-compute[74669]: iSNS:
Nov 08 17:05:56 user nova-compute[74669]: No targets found.
Nov 08 17:05:56 user nova-compute[74669]: STATIC:
Nov 08 17:05:56 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3
Nov 08 17:05:56 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:05:56 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:05:56 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2
Nov 08 17:05:56 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:05:56 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:05:56 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6
Nov 08 17:05:56 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:05:56 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:05:56 user nova-compute[74669]: FIRMWARE:
Nov 08 17:05:56 user nova-compute[74669]: No targets found.
Nov 08 17:05:56 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:05:56 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:05:56 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[080b5c4c-09f3-4d34-949a-f495f7060b39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffa3ef2-d186-46d7-9466-dca04983d692]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:05:56 user nova-compute[74669]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:05:56 user nova-compute[74669]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)
Nov 08 17:05:56 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 (non-flash)
Nov 08 17:05:56 user nova-compute[74669]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:05:56 user nova-compute[74669]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)
Nov 08 17:05:56 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9a848dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2'): ({'sdb'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Removing single pathed devices sdb {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd85a71-6d5a-455f-bff7-7779cc0e7d7c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a086807-ed76-4ed1-99f1-0bd806ff9128]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Flushing IO for device /dev/sdb {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[734e9369-99a3-4d51-8e3f-6606b1a9ce8b]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:05:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[744fd9ca-a6d7-438c-b48a-9b5875eb27c8]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0929a6bd-cd90-4d20-96e2-f6d9c450e775]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11eef9c-b847-4f68-90bf-c42a494cdb42]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2, portal: 172.16.0.220,3260]
Nov 08 17:05:57 user nova-compute[74669]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2, portal: 172.16.0.220,3260] successful.
Nov 08 17:05:57 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4619d6f-eca5-4aae-ae1f-ddff0ffa8dd2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.138s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78dce1e-7f29-43fb-aa3e-5386a15954f5]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.491s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] <== disconnect_volume: return (493ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Acquiring lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG nova.compute.manager [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:05:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:58 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:05:58 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:05:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=7474MB free_disk=25.18551254272461GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7b335462-0d93-4899-a223-5c2e36932578 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b663cd16-12b5-48fc-886d-0a7d160faea5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance d91eaa51-6bf4-40eb-9f36-f8e838501373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance ee7af599-1f24-4828-913f-5ba3687619df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b68038d5-a01a-49a2-bd73-80cec03e68f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance af8b58ff-90d5-4a04-844a-ac0534a7e413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 55c67717-eb46-4617-9165-28531360e5d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 84fac5e1-7ef0-417a-8888-955a7c9f8944 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance dff7cbf2-497a-4a27-a0b1-2e97f1391090 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.584s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.567s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:58 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:05:58 user nova-compute[74669]: INFO nova.compute.claims [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Claim successful on node user
Nov 08 17:05:59 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:05:59 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:05:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:05:59 user nova-compute[74669]: DEBUG nova.compute.manager [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:05:59 user nova-compute[74669]: DEBUG nova.compute.manager [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:05:59 user nova-compute[74669]: DEBUG nova.network.neutron [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:05:59 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:05:59 user nova-compute[74669]: DEBUG nova.compute.manager [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:05:59 user nova-compute[74669]: DEBUG nova.policy [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4579628656354f278a6cc2e79b062025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a409449798dc4b25acdd09d4930a8b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:05:59 user nova-compute[74669]: DEBUG nova.compute.manager [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:05:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:05:59 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Creating image(s)
Nov 08 17:05:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Acquiring lock "/opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lock "/opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lock "/opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:05:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.178s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:05:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:05:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.191s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:05:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk 1073741824" returned: 0 in 0.051s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:05:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:05:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.208s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:00 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:06:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:00 user nova-compute[74669]: DEBUG nova.network.neutron [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Successfully created port: adf75b32-76fa-4ce3-b1bd-2a6170848b58 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:06:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:00 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Cannot resize image /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:06:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:06:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Ensure instance console log exists: /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:06:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:06:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:06:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:06:00 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:06:00 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:06:00 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:06:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:06:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:06:00 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:06:00 user nova-compute[74669]: DEBUG nova.network.neutron [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Successfully updated port: adf75b32-76fa-4ce3-b1bd-2a6170848b58 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Acquiring lock "refresh_cache-dff7cbf2-497a-4a27-a0b1-2e97f1391090" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Acquired lock "refresh_cache-dff7cbf2-497a-4a27-a0b1-2e97f1391090" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-3472d115-5888-4172-ad18-fac263fdf061 req-5f6f9ffc-bd65-487a-b95f-fae591972e2e service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Received event network-changed-adf75b32-76fa-4ce3-b1bd-2a6170848b58 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-3472d115-5888-4172-ad18-fac263fdf061 req-5f6f9ffc-bd65-487a-b95f-fae591972e2e service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Refreshing instance network info cache due to event network-changed-adf75b32-76fa-4ce3-b1bd-2a6170848b58. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3472d115-5888-4172-ad18-fac263fdf061 req-5f6f9ffc-bd65-487a-b95f-fae591972e2e service nova] Acquiring lock "refresh_cache-dff7cbf2-497a-4a27-a0b1-2e97f1391090" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Updating instance_info_cache with network_info: [{"id": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "address": "fa:16:3e:70:48:8f", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c0ff3a-f7", "ovs_interfaceid": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-b663cd16-12b5-48fc-886d-0a7d160faea5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Updating instance_info_cache with network_info: [{"id": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "address": "fa:16:3e:6d:12:7d", "network": {"id": "03c29fa9-39a4-4633-8c7e-1c69b147193a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276510167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a409449798dc4b25acdd09d4930a8b28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf75b32-76", "ovs_interfaceid": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Releasing lock "refresh_cache-dff7cbf2-497a-4a27-a0b1-2e97f1391090" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Instance network_info: |[{"id": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "address": "fa:16:3e:6d:12:7d", "network": {"id": "03c29fa9-39a4-4633-8c7e-1c69b147193a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276510167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a409449798dc4b25acdd09d4930a8b28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf75b32-76", "ovs_interfaceid": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3472d115-5888-4172-ad18-fac263fdf061 req-5f6f9ffc-bd65-487a-b95f-fae591972e2e service nova] Acquired lock "refresh_cache-dff7cbf2-497a-4a27-a0b1-2e97f1391090" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.network.neutron [req-3472d115-5888-4172-ad18-fac263fdf061 req-5f6f9ffc-bd65-487a-b95f-fae591972e2e service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Refreshing network info cache for port adf75b32-76fa-4ce3-b1bd-2a6170848b58 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Start _get_guest_xml network_info=[{"id": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "address": "fa:16:3e:6d:12:7d", "network": {"id": "03c29fa9-39a4-4633-8c7e-1c69b147193a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276510167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a409449798dc4b25acdd09d4930a8b28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf75b32-76", "ovs_interfaceid": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:06:01 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:06:01 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1971736995',display_name='tempest-SnapshotDataIntegrityTests-server-1971736995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1971736995',id=27,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMn768SphUSH6G7QsOgDlSrxumlFf8fMJDoxiOJZTlQPHXhl1ec1Nn4fpL5e2hlp1naGSgzb3bbqX7IHdk0MwpqFRFnx4ycPiV6D829LLGvtfn2kDU1fRgnawcNtLaFQjQ==',key_name='tempest-keypair-604512327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a409449798dc4b25acdd09d4930a8b28',ramdisk_id='',reservation_id='r-lc2y4955',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-714924060',owner_user_name='tempest-SnapshotDataIntegrityTests-714924060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:05:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4579628656354f278a6cc2e79b062025',uuid=dff7cbf2-497a-4a27-a0b1-2e97f1391090,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "address": "fa:16:3e:6d:12:7d", "network": {"id": "03c29fa9-39a4-4633-8c7e-1c69b147193a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276510167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a409449798dc4b25acdd09d4930a8b28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf75b32-76", "ovs_interfaceid": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Converting VIF {"id": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "address": "fa:16:3e:6d:12:7d", "network": {"id": "03c29fa9-39a4-4633-8c7e-1c69b147193a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276510167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a409449798dc4b25acdd09d4930a8b28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf75b32-76", "ovs_interfaceid": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:12:7d,bridge_name='br-int',has_traffic_filtering=True,id=adf75b32-76fa-4ce3-b1bd-2a6170848b58,network=Network(03c29fa9-39a4-4633-8c7e-1c69b147193a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadf75b32-76') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.objects.instance [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lazy-loading 'pci_devices' on Instance uuid dff7cbf2-497a-4a27-a0b1-2e97f1391090 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:06:01 user nova-compute[74669]:   <uuid>dff7cbf2-497a-4a27-a0b1-2e97f1391090</uuid>
Nov 08 17:06:01 user nova-compute[74669]:   <name>instance-0000001b</name>
Nov 08 17:06:01 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:06:01 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:06:01 user nova-compute[74669]:   <metadata>
Nov 08 17:06:01 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:06:01 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:06:01 user nova-compute[74669]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1971736995</nova:name>
Nov 08 17:06:01 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:06:01</nova:creationTime>
Nov 08 17:06:01 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:06:01 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:06:01 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:06:01 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:06:01 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:06:01 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:06:01 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:06:01 user nova-compute[74669]:       <nova:owner>
Nov 08 17:06:01 user nova-compute[74669]:         <nova:user uuid="4579628656354f278a6cc2e79b062025">tempest-SnapshotDataIntegrityTests-714924060-project-member</nova:user>
Nov 08 17:06:01 user nova-compute[74669]:         <nova:project uuid="a409449798dc4b25acdd09d4930a8b28">tempest-SnapshotDataIntegrityTests-714924060</nova:project>
Nov 08 17:06:01 user nova-compute[74669]:       </nova:owner>
Nov 08 17:06:01 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:06:01 user nova-compute[74669]:       <nova:ports>
Nov 08 17:06:01 user nova-compute[74669]:         <nova:port uuid="adf75b32-76fa-4ce3-b1bd-2a6170848b58">
Nov 08 17:06:01 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 17:06:01 user nova-compute[74669]:         </nova:port>
Nov 08 17:06:01 user nova-compute[74669]:       </nova:ports>
Nov 08 17:06:01 user nova-compute[74669]:     </nova:instance>
Nov 08 17:06:01 user nova-compute[74669]:   </metadata>
Nov 08 17:06:01 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:06:01 user nova-compute[74669]:     <system>
Nov 08 17:06:01 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:06:01 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:06:01 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:06:01 user nova-compute[74669]:       <entry name="serial">dff7cbf2-497a-4a27-a0b1-2e97f1391090</entry>
Nov 08 17:06:01 user nova-compute[74669]:       <entry name="uuid">dff7cbf2-497a-4a27-a0b1-2e97f1391090</entry>
Nov 08 17:06:01 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:06:01 user nova-compute[74669]:     </system>
Nov 08 17:06:01 user nova-compute[74669]:   </sysinfo>
Nov 08 17:06:01 user nova-compute[74669]:   <os>
Nov 08 17:06:01 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:06:01 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:06:01 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:06:01 user nova-compute[74669]:   </os>
Nov 08 17:06:01 user nova-compute[74669]:   <features>
Nov 08 17:06:01 user nova-compute[74669]:     <acpi/>
Nov 08 17:06:01 user nova-compute[74669]:     <apic/>
Nov 08 17:06:01 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:06:01 user nova-compute[74669]:   </features>
Nov 08 17:06:01 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:06:01 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:06:01 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:06:01 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:06:01 user nova-compute[74669]:   </clock>
Nov 08 17:06:01 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:06:01 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:06:01 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:06:01 user nova-compute[74669]:   </cpu>
Nov 08 17:06:01 user nova-compute[74669]:   <devices>
Nov 08 17:06:01 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:06:01 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:06:01 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk"/>
Nov 08 17:06:01 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:06:01 user nova-compute[74669]:     </disk>
Nov 08 17:06:01 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:06:01 user nova-compute[74669]:       <mac address="fa:16:3e:6d:12:7d"/>
Nov 08 17:06:01 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:06:01 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:06:01 user nova-compute[74669]:       <target dev="tapadf75b32-76"/>
Nov 08 17:06:01 user nova-compute[74669]:     </interface>
Nov 08 17:06:01 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:06:01 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/console.log" append="off"/>
Nov 08 17:06:01 user nova-compute[74669]:     </serial>
Nov 08 17:06:01 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:06:01 user nova-compute[74669]:     <video>
Nov 08 17:06:01 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:06:01 user nova-compute[74669]:     </video>
Nov 08 17:06:01 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:06:01 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:06:01 user nova-compute[74669]:     </rng>
Nov 08 17:06:01 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:06:01 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:06:01 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:06:01 user nova-compute[74669]:     </memballoon>
Nov 08 17:06:01 user nova-compute[74669]:   </devices>
Nov 08 17:06:01 user nova-compute[74669]: </domain>
Nov 08 17:06:01 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1971736995',display_name='tempest-SnapshotDataIntegrityTests-server-1971736995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1971736995',id=27,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMn768SphUSH6G7QsOgDlSrxumlFf8fMJDoxiOJZTlQPHXhl1ec1Nn4fpL5e2hlp1naGSgzb3bbqX7IHdk0MwpqFRFnx4ycPiV6D829LLGvtfn2kDU1fRgnawcNtLaFQjQ==',key_name='tempest-keypair-604512327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a409449798dc4b25acdd09d4930a8b28',ramdisk_id='',reservation_id='r-lc2y4955',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-714924060',owner_user_name='tempest-SnapshotDataIntegrityTests-714924060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:05:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4579628656354f278a6cc2e79b062025',uuid=dff7cbf2-497a-4a27-a0b1-2e97f1391090,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "address": "fa:16:3e:6d:12:7d", "network": {"id": "03c29fa9-39a4-4633-8c7e-1c69b147193a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276510167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a409449798dc4b25acdd09d4930a8b28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf75b32-76", "ovs_interfaceid": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Converting VIF {"id": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "address": "fa:16:3e:6d:12:7d", "network": {"id": "03c29fa9-39a4-4633-8c7e-1c69b147193a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276510167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a409449798dc4b25acdd09d4930a8b28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf75b32-76", "ovs_interfaceid": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:12:7d,bridge_name='br-int',has_traffic_filtering=True,id=adf75b32-76fa-4ce3-b1bd-2a6170848b58,network=Network(03c29fa9-39a4-4633-8c7e-1c69b147193a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadf75b32-76') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG os_vif [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:12:7d,bridge_name='br-int',has_traffic_filtering=True,id=adf75b32-76fa-4ce3-b1bd-2a6170848b58,network=Network(03c29fa9-39a4-4633-8c7e-1c69b147193a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadf75b32-76') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41ed38bc-98cf-5a0a-bab6-b916e21a48ae', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadf75b32-76, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapadf75b32-76, col_values=(('qos', UUID('64addedf-4f8d-4ef7-b6c9-653ef2577f73')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapadf75b32-76, col_values=(('external_ids', {'iface-id': 'adf75b32-76fa-4ce3-b1bd-2a6170848b58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:12:7d', 'vm-uuid': 'dff7cbf2-497a-4a27-a0b1-2e97f1391090'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:01 user nova-compute[74669]: INFO os_vif [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:12:7d,bridge_name='br-int',has_traffic_filtering=True,id=adf75b32-76fa-4ce3-b1bd-2a6170848b58,network=Network(03c29fa9-39a4-4633-8c7e-1c69b147193a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadf75b32-76')
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:06:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] No VIF found with MAC fa:16:3e:6d:12:7d, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:06:02 user nova-compute[74669]: DEBUG nova.network.neutron [req-3472d115-5888-4172-ad18-fac263fdf061 req-5f6f9ffc-bd65-487a-b95f-fae591972e2e service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Updated VIF entry in instance network info cache for port adf75b32-76fa-4ce3-b1bd-2a6170848b58. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:06:02 user nova-compute[74669]: DEBUG nova.network.neutron [req-3472d115-5888-4172-ad18-fac263fdf061 req-5f6f9ffc-bd65-487a-b95f-fae591972e2e service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Updating instance_info_cache with network_info: [{"id": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "address": "fa:16:3e:6d:12:7d", "network": {"id": "03c29fa9-39a4-4633-8c7e-1c69b147193a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276510167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a409449798dc4b25acdd09d4930a8b28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf75b32-76", "ovs_interfaceid": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:06:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3472d115-5888-4172-ad18-fac263fdf061 req-5f6f9ffc-bd65-487a-b95f-fae591972e2e service nova] Releasing lock "refresh_cache-dff7cbf2-497a-4a27-a0b1-2e97f1391090" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:06:02 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:06:02 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:06:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:03 user nova-compute[74669]: DEBUG nova.compute.manager [req-c4521d49-4859-41ed-8625-cf4f974a6e62 req-e063e0d2-a1b7-40a8-8b73-acb614e50aee service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Received event network-vif-plugged-adf75b32-76fa-4ce3-b1bd-2a6170848b58 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:06:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c4521d49-4859-41ed-8625-cf4f974a6e62 req-e063e0d2-a1b7-40a8-8b73-acb614e50aee service nova] Acquiring lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:06:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c4521d49-4859-41ed-8625-cf4f974a6e62 req-e063e0d2-a1b7-40a8-8b73-acb614e50aee service nova] Lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:06:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c4521d49-4859-41ed-8625-cf4f974a6e62 req-e063e0d2-a1b7-40a8-8b73-acb614e50aee service nova] Lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:06:03 user nova-compute[74669]: DEBUG nova.compute.manager [req-c4521d49-4859-41ed-8625-cf4f974a6e62 req-e063e0d2-a1b7-40a8-8b73-acb614e50aee service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] No waiting events found dispatching network-vif-plugged-adf75b32-76fa-4ce3-b1bd-2a6170848b58 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:06:03 user nova-compute[74669]: WARNING nova.compute.manager [req-c4521d49-4859-41ed-8625-cf4f974a6e62 req-e063e0d2-a1b7-40a8-8b73-acb614e50aee service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Received unexpected event network-vif-plugged-adf75b32-76fa-4ce3-b1bd-2a6170848b58 for instance with vm_state building and task_state spawning.
Nov 08 17:06:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:05 user nova-compute[74669]: DEBUG nova.compute.manager [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:06:05 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:06:05 user nova-compute[74669]: DEBUG nova.compute.manager [req-e66adfb7-a58a-42fc-80f3-15cc3dde2e42 req-a5f6fcd3-8db8-4c7f-bd59-077f1063f339 service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Received event network-vif-plugged-adf75b32-76fa-4ce3-b1bd-2a6170848b58 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:06:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e66adfb7-a58a-42fc-80f3-15cc3dde2e42 req-a5f6fcd3-8db8-4c7f-bd59-077f1063f339 service nova] Acquiring lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:06:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e66adfb7-a58a-42fc-80f3-15cc3dde2e42 req-a5f6fcd3-8db8-4c7f-bd59-077f1063f339 service nova] Lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:06:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e66adfb7-a58a-42fc-80f3-15cc3dde2e42 req-a5f6fcd3-8db8-4c7f-bd59-077f1063f339 service nova] Lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:06:05 user nova-compute[74669]: DEBUG nova.compute.manager [req-e66adfb7-a58a-42fc-80f3-15cc3dde2e42 req-a5f6fcd3-8db8-4c7f-bd59-077f1063f339 service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] No waiting events found dispatching network-vif-plugged-adf75b32-76fa-4ce3-b1bd-2a6170848b58 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:06:05 user nova-compute[74669]: WARNING nova.compute.manager [req-e66adfb7-a58a-42fc-80f3-15cc3dde2e42 req-a5f6fcd3-8db8-4c7f-bd59-077f1063f339 service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Received unexpected event network-vif-plugged-adf75b32-76fa-4ce3-b1bd-2a6170848b58 for instance with vm_state building and task_state spawning.
Nov 08 17:06:05 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Instance spawned successfully.
Nov 08 17:06:05 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:06:05 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:06:05 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:06:05 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:06:05 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:06:05 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:06:05 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:06:05 user nova-compute[74669]: INFO nova.compute.manager [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Took 6.05 seconds to spawn the instance on the hypervisor.
Nov 08 17:06:05 user nova-compute[74669]: DEBUG nova.compute.manager [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:06:05 user nova-compute[74669]: INFO nova.compute.manager [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Took 7.51 seconds to build instance.
Nov 08 17:06:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-23fc90d2-9feb-4276-ad1e-61242764d125 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.058s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:06:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:22 user nova-compute[74669]: DEBUG nova.objects.instance [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'flavor' on Instance uuid b663cd16-12b5-48fc-886d-0a7d160faea5 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:06:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-637b8e4b-3587-4d9f-9235-3973f5c077fd tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 46.398s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG nova.compute.manager [req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf req-2cbfcb83-9dcd-4b23-a0df-d45d008c7e91 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Received event volume-reimaged-27fd5c1d-4793-43c2-8ebf-f021e25b5a79 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf req-2cbfcb83-9dcd-4b23-a0df-d45d008c7e91 service nova] Acquiring lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf req-2cbfcb83-9dcd-4b23-a0df-d45d008c7e91 service nova] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf req-2cbfcb83-9dcd-4b23-a0df-d45d008c7e91 service nova] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG nova.compute.manager [req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf req-2cbfcb83-9dcd-4b23-a0df-d45d008c7e91 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Processing event volume-reimaged-27fd5c1d-4793-43c2-8ebf-f021e25b5a79 {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Instance event wait completed in 34 seconds for volume-reimaged {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:06:23 user nova-compute[74669]: INFO nova.virt.block_device [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Booting with volume 27fd5c1d-4793-43c2-8ebf-f021e25b5a79 at /dev/vda
Nov 08 17:06:23 user nova-compute[74669]: DEBUG os_brick.utils [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6fbca9-3308-4e59-b469-e5643204d317]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f372a6-6b2a-430b-b4f1-de9cb56f779e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[49adc411-6a38-4c7f-ab32-d254370e643e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b603a22c-b9c2-445f-b886-ea986e719413]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:06:23 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:06:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e63fe38-785f-4627-8f43-ebcf83880de3]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG os_brick.utils [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Updating existing volume attachment record: 15ebb151-2986-41d1-884d-be5b26a608a8 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:06:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-a57df055-b18b-4357-837e-7ec7d805e16a req-7473c790-592e-4e4f-b6a8-0d576416688d service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Received event network-changed-a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-a57df055-b18b-4357-837e-7ec7d805e16a req-7473c790-592e-4e4f-b6a8-0d576416688d service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Refreshing instance network info cache due to event network-changed-a6d42001-e353-4460-9257-a9d4b0027672. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a57df055-b18b-4357-837e-7ec7d805e16a req-7473c790-592e-4e4f-b6a8-0d576416688d service nova] Acquiring lock "refresh_cache-84fac5e1-7ef0-417a-8888-955a7c9f8944" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a57df055-b18b-4357-837e-7ec7d805e16a req-7473c790-592e-4e4f-b6a8-0d576416688d service nova] Acquired lock "refresh_cache-84fac5e1-7ef0-417a-8888-955a7c9f8944" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG nova.network.neutron [req-a57df055-b18b-4357-837e-7ec7d805e16a req-7473c790-592e-4e4f-b6a8-0d576416688d service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Refreshing network info cache for port a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "55c67717-eb46-4617-9165-28531360e5d7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "55c67717-eb46-4617-9165-28531360e5d7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:06:26 user nova-compute[74669]: INFO nova.compute.manager [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Detaching volume e8124213-75fd-4ac0-bd18-e69f14601fc3
Nov 08 17:06:26 user nova-compute[74669]: INFO nova.virt.block_device [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Attempting to driver detach volume e8124213-75fd-4ac0-bd18-e69f14601fc3 from mountpoint /dev/vdc
Nov 08 17:06:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Attempting to detach device vdc from instance 55c67717-eb46-4617-9165-28531360e5d7 from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:06:26 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:06:26 user nova-compute[74669]:   <source dev="/dev/sdg"/>
Nov 08 17:06:26 user nova-compute[74669]:   <target dev="vdc" bus="virtio"/>
Nov 08 17:06:26 user nova-compute[74669]:   <serial>e8124213-75fd-4ac0-bd18-e69f14601fc3</serial>
Nov 08 17:06:26 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 17:06:26 user nova-compute[74669]: </disk>
Nov 08 17:06:26 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:06:26 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Successfully detached device vdc from instance 55c67717-eb46-4617-9165-28531360e5d7 from the persistent domain config.
Nov 08 17:06:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 55c67717-eb46-4617-9165-28531360e5d7 from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:06:26 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:06:26 user nova-compute[74669]:   <source dev="/dev/sdg"/>
Nov 08 17:06:26 user nova-compute[74669]:   <target dev="vdc" bus="virtio"/>
Nov 08 17:06:26 user nova-compute[74669]:   <serial>e8124213-75fd-4ac0-bd18-e69f14601fc3</serial>
Nov 08 17:06:26 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 17:06:26 user nova-compute[74669]: </disk>
Nov 08 17:06:26 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "b663cd16-12b5-48fc-886d-0a7d160faea5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:26 user nova-compute[74669]: INFO nova.compute.manager [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Terminating instance
Nov 08 17:06:26 user nova-compute[74669]: DEBUG nova.compute.manager [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG nova.network.neutron [req-a57df055-b18b-4357-837e-7ec7d805e16a req-7473c790-592e-4e4f-b6a8-0d576416688d service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Updated VIF entry in instance network info cache for port a6d42001-e353-4460-9257-a9d4b0027672. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG nova.network.neutron [req-a57df055-b18b-4357-837e-7ec7d805e16a req-7473c790-592e-4e4f-b6a8-0d576416688d service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Updating instance_info_cache with network_info: [{"id": "a6d42001-e353-4460-9257-a9d4b0027672", "address": "fa:16:3e:79:4f:aa", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d42001-e3", "ovs_interfaceid": "a6d42001-e353-4460-9257-a9d4b0027672", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a57df055-b18b-4357-837e-7ec7d805e16a req-7473c790-592e-4e4f-b6a8-0d576416688d service nova] Releasing lock "refresh_cache-84fac5e1-7ef0-417a-8888-955a7c9f8944" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "84fac5e1-7ef0-417a-8888-955a7c9f8944" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG nova.objects.instance [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lazy-loading 'flavor' on Instance uuid 84fac5e1-7ef0-417a-8888-955a7c9f8944 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 55c67717-eb46-4617-9165-28531360e5d7 {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "84fac5e1-7ef0-417a-8888-955a7c9f8944" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:06:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:06:26 user nova-compute[74669]: INFO nova.compute.manager [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Attaching volume e1b9998c-085b-4ead-a5f2-96aff332aed5 to /dev/vdb
Nov 08 17:06:27 user nova-compute[74669]: DEBUG os_brick.utils [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45ae1a5-a897-49ad-b3ae-94a14d87d500]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f04d6ea-4b74-4a7d-b33f-e82bd7d2b2a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e6ba6c-df71-4330-af0c-6bc1ad88e5d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8349ca1-7b3e-4c2f-876d-d15259c5b55c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:06:27 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:06:27 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c437da64-39af-465c-8de7-4a87a6b03d39]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG os_brick.utils [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Updating existing volume attachment record: 79bed3aa-2832-4c54-abd7-8b6cc2e18b0b {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:27 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Instance destroyed successfully.
Nov 08 17:06:27 user nova-compute[74669]: DEBUG nova.objects.instance [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'resources' on Instance uuid b663cd16-12b5-48fc-886d-0a7d160faea5 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1617099866',display_name='tempest-ServerRescueNegativeTestJSON-server-1617099866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1617099866',id=16,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4Cgsm6cX2qyzx8rq6D9dugDe4RZp7Igjsfdo3CJijmqQ1dHOQM5HOFxPzKN86OgMWJ2HHhOKlvxf15iLNojfkf1D4DQ0XYMSMxUPTQJoEkRD6CCzrhdyhlfH+CXTjE8g==',key_name='tempest-keypair-1917158791',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:01:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='632d3acc026b4a869be4899a0ed2e2e2',ramdisk_id='',reservation_id='r-kojzv90d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1743978403',owner_user_name='tempest-ServerRescueNegativeTestJSON-1743978403-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:03:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4836f11b0e8346a2a7e835a6012f53fb',uuid=b663cd16-12b5-48fc-886d-0a7d160faea5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "address": "fa:16:3e:70:48:8f", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c0ff3a-f7", "ovs_interfaceid": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converting VIF {"id": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "address": "fa:16:3e:70:48:8f", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c0ff3a-f7", "ovs_interfaceid": "f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:48:8f,bridge_name='br-int',has_traffic_filtering=True,id=f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6c0ff3a-f7') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG os_vif [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:48:8f,bridge_name='br-int',has_traffic_filtering=True,id=f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6c0ff3a-f7') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6c0ff3a-f7, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9736dd4b-7a43-46ba-be8d-ce41d5b9c678) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:27 user nova-compute[74669]: INFO os_vif [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:48:8f,bridge_name='br-int',has_traffic_filtering=True,id=f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6c0ff3a-f7')
Nov 08 17:06:27 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Deleting instance files /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5_del
Nov 08 17:06:27 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Deletion of /opt/stack/data/nova/instances/b663cd16-12b5-48fc-886d-0a7d160faea5_del complete
Nov 08 17:06:27 user nova-compute[74669]: INFO nova.compute.manager [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 08 17:06:27 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:06:27 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:06:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-e3f3acef-adcc-4abc-8666-a2d5bfe205ac req-de1c58f9-2f8d-4515-ab46-88ba336a1878 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received event network-vif-unplugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:06:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e3f3acef-adcc-4abc-8666-a2d5bfe205ac req-de1c58f9-2f8d-4515-ab46-88ba336a1878 service nova] Acquiring lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:06:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e3f3acef-adcc-4abc-8666-a2d5bfe205ac req-de1c58f9-2f8d-4515-ab46-88ba336a1878 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:06:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e3f3acef-adcc-4abc-8666-a2d5bfe205ac req-de1c58f9-2f8d-4515-ab46-88ba336a1878 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:06:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-e3f3acef-adcc-4abc-8666-a2d5bfe205ac req-de1c58f9-2f8d-4515-ab46-88ba336a1878 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] No waiting events found dispatching network-vif-unplugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:06:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-e3f3acef-adcc-4abc-8666-a2d5bfe205ac req-de1c58f9-2f8d-4515-ab46-88ba336a1878 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received event network-vif-unplugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:06:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-e3f3acef-adcc-4abc-8666-a2d5bfe205ac req-de1c58f9-2f8d-4515-ab46-88ba336a1878 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:06:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e3f3acef-adcc-4abc-8666-a2d5bfe205ac req-de1c58f9-2f8d-4515-ab46-88ba336a1878 service nova] Acquiring lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:06:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e3f3acef-adcc-4abc-8666-a2d5bfe205ac req-de1c58f9-2f8d-4515-ab46-88ba336a1878 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:06:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e3f3acef-adcc-4abc-8666-a2d5bfe205ac req-de1c58f9-2f8d-4515-ab46-88ba336a1878 service nova] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:06:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-e3f3acef-adcc-4abc-8666-a2d5bfe205ac req-de1c58f9-2f8d-4515-ab46-88ba336a1878 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] No waiting events found dispatching network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:06:28 user nova-compute[74669]: WARNING nova.compute.manager [req-e3f3acef-adcc-4abc-8666-a2d5bfe205ac req-de1c58f9-2f8d-4515-ab46-88ba336a1878 service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received unexpected event network-vif-plugged-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 for instance with vm_state active and task_state deleting.
Nov 08 17:06:28 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:06:28 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Took 0.82 seconds to deallocate network for instance.
Nov 08 17:06:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-82c5ab2e-7355-4aa0-8c72-89a77a1d2554 req-38957066-f219-4ed1-a539-d110c2a5cfbf service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Received event network-vif-deleted-f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:06:28 user nova-compute[74669]: INFO nova.compute.manager [req-82c5ab2e-7355-4aa0-8c72-89a77a1d2554 req-38957066-f219-4ed1-a539-d110c2a5cfbf service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Neutron deleted interface f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791; detaching it from the instance and deleting it from the info cache
Nov 08 17:06:28 user nova-compute[74669]: DEBUG nova.network.neutron [req-82c5ab2e-7355-4aa0-8c72-89a77a1d2554 req-38957066-f219-4ed1-a539-d110c2a5cfbf service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:06:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-82c5ab2e-7355-4aa0-8c72-89a77a1d2554 req-38957066-f219-4ed1-a539-d110c2a5cfbf service nova] [instance: b663cd16-12b5-48fc-886d-0a7d160faea5] Detach interface failed, port_id=f6c0ff3a-f71a-4ccd-bf4d-2ae93b581791, reason: Instance b663cd16-12b5-48fc-886d-0a7d160faea5 could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 17:06:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:06:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:06:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:29 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:06:29 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:06:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:06:29 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Deleted allocations for instance b663cd16-12b5-48fc-886d-0a7d160faea5
Nov 08 17:06:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-51ef21d1-0757-4985-b824-332f24db174e tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "b663cd16-12b5-48fc-886d-0a7d160faea5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.731s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:06:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:06:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGaVbyCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:06:36 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:06:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:06:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:06:36 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:06:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:06:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:06:36 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:06:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:36 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fb849a-2269-4be3-82fe-7dc6f94497d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:06:36 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:06:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2faf52b0-4b3a-428a-8363-cdb80840648a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b] added
Nov 08 17:06:37 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d27cac-b548-43a8-ac19-6e37d8f17897]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c163e6bf-2957-414d-8dd1-c1155ed23a1b]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MGaVbyCT {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MGaVbyCT" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b2db72-42b3-4037-b47c-e7f86dea4f2a]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MGaVbyCT'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[caab0006-ba2c-4f24-8060-30060cfd4185]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[69787956-c1ef-4488-a911-536d92e243e3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:06:37 user nova-compute[74669]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)
Nov 08 17:06:37 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:06:37 user nova-compute[74669]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)
Nov 08 17:06:37 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b11d80-32ba-4689-9997-8ed0ff2c246e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b, portal: 172.16.0.220,3260]
Nov 08 17:06:37 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b, portal: 172.16.0.220,3260] successful.
Nov 08 17:06:37 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2449b157-95ee-48f6-ac18-9f58d915b6c5]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7231898-2552-4ddb-822f-e377724c8566]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:06:37 user nova-compute[74669]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)
Nov 08 17:06:37 user nova-compute[74669]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:06:37 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:06:37 user nova-compute[74669]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)
Nov 08 17:06:37 user nova-compute[74669]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:06:37 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[308bd4d1-321e-4122-80f9-b0681e50bb14]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: None {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:06:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:38 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:06:38 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGaVbyCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:06:38 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:06:38 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23662343762393164', 'path': '/dev/sdb'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:06:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662343762393164', 'path': '/dev/sdb'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:06:38 user nova-compute[74669]: DEBUG nova.objects.instance [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'flavor' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:06:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 17:06:38 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:06:38 user nova-compute[74669]:   <source dev="/dev/sdb"/>
Nov 08 17:06:38 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:06:38 user nova-compute[74669]:   <serial>a2d3bf54-9d77-4c85-a92a-6192eae32c7b</serial>
Nov 08 17:06:38 user nova-compute[74669]: </disk>
Nov 08 17:06:38 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 17:06:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:06:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:06:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] No VIF found with MAC fa:16:3e:4d:2d:67, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:06:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5e6d8b2b-268b-4edb-8e4d-3eef6077463b tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 53.865s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:06:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54e8409f-c817-4dfc-9145-47d79bda72f5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:06:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54e8409f-c817-4dfc-9145-47d79bda72f5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:06:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-54e8409f-c817-4dfc-9145-47d79bda72f5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:06:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-54e8409f-c817-4dfc-9145-47d79bda72f5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74669) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 08 17:06:39 user nova-compute[74669]: DEBUG nova.objects.instance [None req-54e8409f-c817-4dfc-9145-47d79bda72f5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'flavor' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:06:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:40 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Instance destroyed successfully.
Nov 08 17:06:40 user nova-compute[74669]: DEBUG nova.compute.manager [None req-54e8409f-c817-4dfc-9145-47d79bda72f5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:06:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-54e8409f-c817-4dfc-9145-47d79bda72f5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.877s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:06:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-d5835eb9-1d45-468b-84be-55fa630d1a26 req-fbb19cb0-6f38-4ecd-9c84-dbf07152ddc3 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received event network-vif-unplugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:06:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d5835eb9-1d45-468b-84be-55fa630d1a26 req-fbb19cb0-6f38-4ecd-9c84-dbf07152ddc3 service nova] Acquiring lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:06:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d5835eb9-1d45-468b-84be-55fa630d1a26 req-fbb19cb0-6f38-4ecd-9c84-dbf07152ddc3 service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:06:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d5835eb9-1d45-468b-84be-55fa630d1a26 req-fbb19cb0-6f38-4ecd-9c84-dbf07152ddc3 service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:06:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-d5835eb9-1d45-468b-84be-55fa630d1a26 req-fbb19cb0-6f38-4ecd-9c84-dbf07152ddc3 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] No waiting events found dispatching network-vif-unplugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:06:40 user nova-compute[74669]: WARNING nova.compute.manager [req-d5835eb9-1d45-468b-84be-55fa630d1a26 req-fbb19cb0-6f38-4ecd-9c84-dbf07152ddc3 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received unexpected event network-vif-unplugged-d0dc10aa-3fca-4242-8895-241190da8780 for instance with vm_state stopped and task_state None.
Nov 08 17:06:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-b7ada512-fe93-4a21-8f02-380ed49f951b req-b3e1712b-9ce1-4157-ab2e-754dba4a10d8 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received event network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:06:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b7ada512-fe93-4a21-8f02-380ed49f951b req-b3e1712b-9ce1-4157-ab2e-754dba4a10d8 service nova] Acquiring lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:06:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b7ada512-fe93-4a21-8f02-380ed49f951b req-b3e1712b-9ce1-4157-ab2e-754dba4a10d8 service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:06:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b7ada512-fe93-4a21-8f02-380ed49f951b req-b3e1712b-9ce1-4157-ab2e-754dba4a10d8 service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:06:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-b7ada512-fe93-4a21-8f02-380ed49f951b req-b3e1712b-9ce1-4157-ab2e-754dba4a10d8 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] No waiting events found dispatching network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:06:42 user nova-compute[74669]: WARNING nova.compute.manager [req-b7ada512-fe93-4a21-8f02-380ed49f951b req-b3e1712b-9ce1-4157-ab2e-754dba4a10d8 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received unexpected event network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 for instance with vm_state stopped and task_state None.
Nov 08 17:06:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:44 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:06:44 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74669) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 17:06:46 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 55c67717-eb46-4617-9165-28531360e5d7 is timed out.
Nov 08 17:06:46 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Successfully detached device vdc from instance 55c67717-eb46-4617-9165-28531360e5d7 from the live domain config.
Nov 08 17:06:46 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YPlxJAoV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:06:46 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:06:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8543a2f2-3513-4efd-a01a-373ca555a7de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:06:46 user nova-compute[74669]: No targets found.
Nov 08 17:06:46 user nova-compute[74669]: iSNS:
Nov 08 17:06:46 user nova-compute[74669]: No targets found.
Nov 08 17:06:46 user nova-compute[74669]: STATIC:
Nov 08 17:06:46 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3
Nov 08 17:06:46 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:06:46 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:06:46 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b
Nov 08 17:06:46 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:06:46 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:06:46 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6
Nov 08 17:06:46 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:06:46 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:06:46 user nova-compute[74669]: FIRMWARE:
Nov 08 17:06:46 user nova-compute[74669]: No targets found.
Nov 08 17:06:46 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:06:46 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:06:46 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[77049c75-191e-4763-814f-7d2936eb6dc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9dabd3-e407-4cb3-894d-26f07d60bd6f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:06:46 user nova-compute[74669]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)
Nov 08 17:06:46 user nova-compute[74669]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:06:46 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:06:46 user nova-compute[74669]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 (non-flash)
Nov 08 17:06:46 user nova-compute[74669]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:06:46 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9a848df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3'): ({'sdg'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Removing single pathed devices sdg {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac73fdc-e4f2-4e0a-b3ac-dbef2e9d80fd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ad82dc-b149-4407-a3c9-1bbe752552d3]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Flushing IO for device /dev/sdg {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbb2d15-0c55-4b03-9519-02d6e4b5db87]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:06:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[61da175f-c24e-4a9f-b922-2af3a6b808da]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] SCSI volumes sdg have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b53e94f-55cc-4fb2-9adc-aac8072845dc]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c38ea3-58bd-48ff-be83-9700553b347d]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3, portal: 172.16.0.220,3260]
Nov 08 17:06:47 user nova-compute[74669]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3, portal: 172.16.0.220,3260] successful.
Nov 08 17:06:47 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8124213-75fd-4ac0-bd18-e69f14601fc3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[00182407-0f3b-47a1-94cd-721f836a3da9]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] <== disconnect_volume: return (318ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:06:47 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Creating image(s)
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Did not create local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Ensure instance console log exists: /opt/stack/data/nova/instances/5575cb2b-b93d-4048-bb96-c4cd7f19ee1d/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Start _get_guest_xml network_info=[{"id": "3021424c-2541-449d-b3f8-ffca35fdb364", "address": "fa:16:3e:6f:e9:d8", "network": {"id": "2b28db73-56c6-4cc7-95de-75ec297a7809", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-839594529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5706466a59c34a878f3eafcebee088d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3021424c-25", "ovs_interfaceid": "3021424c-2541-449d-b3f8-ffca35fdb364", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '15ebb151-2986-41d1-884d-be5b26a608a8', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOWSyBVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5575cb2b-b93d-4048-bb96-c4cd7f19ee1d', 'attached_at': '', 'detached_at': '', 'volume_id': '27fd5c1d-4793-43c2-8ebf-f021e25b5a79', 'serial': '27fd5c1d-4793-43c2-8ebf-f021e25b5a79'}, 'guest_format': None, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:06:47 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 17:06:47 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.objects.instance [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOWSyBVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:06:47 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:06:47 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:06:47 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e24c94-f231-469a-b9e3-8b1711f6b275]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:06:47 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b871afd6-0e54-4e51-a5e3-6412e68502c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79] added
Nov 08 17:06:47 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8605349d-fb78-4cb4-bf60-b88d20e049cb]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[328bc9fe-0bdf-4bad-b525-7eb345c0d95c]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LOWSyBVP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LOWSyBVP" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea2baf0-869f-4c19-95e9-ce328f3a4761]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LOWSyBVP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[84085795-be38-4a3d-829c-bcefcc4f595d]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb129865-146c-4f63-b67c-d53e4bac066b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:06:47 user nova-compute[74669]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:06:47 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:06:47 user nova-compute[74669]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:06:47 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe2c383-0f00-4870-95ec-bf2aa33e5a3c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79, portal: 172.16.0.220,3260]
Nov 08 17:06:47 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79, portal: 172.16.0.220,3260] successful.
Nov 08 17:06:47 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f6bae8-52b9-41b8-97da-c47139fdf1f7]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d41564d-6b88-4cee-9bfb-85389e8a34f5]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:06:47 user nova-compute[74669]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:06:47 user nova-compute[74669]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:06:47 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:06:47 user nova-compute[74669]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:06:47 user nova-compute[74669]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:06:47 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[df54d104-eccb-45ab-a6ab-6570e9d74930]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:06:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOWSyBVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG nova.objects.instance [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lazy-loading 'flavor' on Instance uuid 55c67717-eb46-4617-9165-28531360e5d7 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-42bbe4a8-7a5b-4760-8cbd-c2492250a481 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "55c67717-eb46-4617-9165-28531360e5d7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.906s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26534383330633965', 'path': '/dev/sdc'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534383330633965', 'path': '/dev/sdc'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T17:03:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-858788957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-638839753',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgUCl1WLcb59V3Q5jCPwB0FEUGaJcnditDCK4NsYCVn5HJLFzTT3spZBJc6w7p9cbfNoX8cf7k8DGPcXuUOV2irdcP0AhcWgDxOJyANKtp67p0tg/YP8TSLWl4B1A/hJw==',key_name='tempest-keypair-1263187494',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:04:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5706466a59c34a878f3eafcebee088d0',ramdisk_id='',reservation_id='r-bl0nidls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-494820798',owner_user_name='tempest-ServerActionsV293TestJSON-494820798-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:06:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b443fd16646495790682d8ad338df57',uuid=5575cb2b-b93d-4048-bb96-c4cd7f19ee1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3021424c-2541-449d-b3f8-ffca35fdb364", "address": "fa:16:3e:6f:e9:d8", "network": {"id": "2b28db73-56c6-4cc7-95de-75ec297a7809", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-839594529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5706466a59c34a878f3eafcebee088d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3021424c-25", "ovs_interfaceid": "3021424c-2541-449d-b3f8-ffca35fdb364", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Converting VIF {"id": "3021424c-2541-449d-b3f8-ffca35fdb364", "address": "fa:16:3e:6f:e9:d8", "network": {"id": "2b28db73-56c6-4cc7-95de-75ec297a7809", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-839594529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5706466a59c34a878f3eafcebee088d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3021424c-25", "ovs_interfaceid": "3021424c-2541-449d-b3f8-ffca35fdb364", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:e9:d8,bridge_name='br-int',has_traffic_filtering=True,id=3021424c-2541-449d-b3f8-ffca35fdb364,network=Network(2b28db73-56c6-4cc7-95de-75ec297a7809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3021424c-25') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:06:48 user nova-compute[74669]:   <uuid>5575cb2b-b93d-4048-bb96-c4cd7f19ee1d</uuid>
Nov 08 17:06:48 user nova-compute[74669]:   <name>instance-00000018</name>
Nov 08 17:06:48 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:06:48 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:06:48 user nova-compute[74669]:   <metadata>
Nov 08 17:06:48 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:06:48 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:06:48 user nova-compute[74669]:       <nova:name>tempest-ServerActionsV293TestJSON-server-858788957</nova:name>
Nov 08 17:06:48 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:06:47</nova:creationTime>
Nov 08 17:06:48 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:06:48 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:06:48 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:06:48 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:06:48 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:06:48 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:06:48 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:06:48 user nova-compute[74669]:       <nova:owner>
Nov 08 17:06:48 user nova-compute[74669]:         <nova:user uuid="3b443fd16646495790682d8ad338df57">tempest-ServerActionsV293TestJSON-494820798-project-member</nova:user>
Nov 08 17:06:48 user nova-compute[74669]:         <nova:project uuid="5706466a59c34a878f3eafcebee088d0">tempest-ServerActionsV293TestJSON-494820798</nova:project>
Nov 08 17:06:48 user nova-compute[74669]:       </nova:owner>
Nov 08 17:06:48 user nova-compute[74669]:       <nova:ports>
Nov 08 17:06:48 user nova-compute[74669]:         <nova:port uuid="3021424c-2541-449d-b3f8-ffca35fdb364">
Nov 08 17:06:48 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 17:06:48 user nova-compute[74669]:         </nova:port>
Nov 08 17:06:48 user nova-compute[74669]:       </nova:ports>
Nov 08 17:06:48 user nova-compute[74669]:     </nova:instance>
Nov 08 17:06:48 user nova-compute[74669]:   </metadata>
Nov 08 17:06:48 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:06:48 user nova-compute[74669]:     <system>
Nov 08 17:06:48 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:06:48 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:06:48 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:06:48 user nova-compute[74669]:       <entry name="serial">5575cb2b-b93d-4048-bb96-c4cd7f19ee1d</entry>
Nov 08 17:06:48 user nova-compute[74669]:       <entry name="uuid">5575cb2b-b93d-4048-bb96-c4cd7f19ee1d</entry>
Nov 08 17:06:48 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:06:48 user nova-compute[74669]:     </system>
Nov 08 17:06:48 user nova-compute[74669]:   </sysinfo>
Nov 08 17:06:48 user nova-compute[74669]:   <os>
Nov 08 17:06:48 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:06:48 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:06:48 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:06:48 user nova-compute[74669]:   </os>
Nov 08 17:06:48 user nova-compute[74669]:   <features>
Nov 08 17:06:48 user nova-compute[74669]:     <acpi/>
Nov 08 17:06:48 user nova-compute[74669]:     <apic/>
Nov 08 17:06:48 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:06:48 user nova-compute[74669]:   </features>
Nov 08 17:06:48 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:06:48 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:06:48 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:06:48 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:06:48 user nova-compute[74669]:   </clock>
Nov 08 17:06:48 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:06:48 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:06:48 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:06:48 user nova-compute[74669]:   </cpu>
Nov 08 17:06:48 user nova-compute[74669]:   <devices>
Nov 08 17:06:48 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 17:06:48 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:06:48 user nova-compute[74669]:       <source dev="/dev/sdc"/>
Nov 08 17:06:48 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:06:48 user nova-compute[74669]:       <serial>27fd5c1d-4793-43c2-8ebf-f021e25b5a79</serial>
Nov 08 17:06:48 user nova-compute[74669]:     </disk>
Nov 08 17:06:48 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:06:48 user nova-compute[74669]:       <mac address="fa:16:3e:6f:e9:d8"/>
Nov 08 17:06:48 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:06:48 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:06:48 user nova-compute[74669]:       <target dev="tap3021424c-25"/>
Nov 08 17:06:48 user nova-compute[74669]:     </interface>
Nov 08 17:06:48 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:06:48 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/5575cb2b-b93d-4048-bb96-c4cd7f19ee1d/console.log" append="off"/>
Nov 08 17:06:48 user nova-compute[74669]:     </serial>
Nov 08 17:06:48 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:06:48 user nova-compute[74669]:     <video>
Nov 08 17:06:48 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:06:48 user nova-compute[74669]:     </video>
Nov 08 17:06:48 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:06:48 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:06:48 user nova-compute[74669]:     </rng>
Nov 08 17:06:48 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:06:48 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:06:48 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:06:48 user nova-compute[74669]:     </memballoon>
Nov 08 17:06:48 user nova-compute[74669]:   </devices>
Nov 08 17:06:48 user nova-compute[74669]: </domain>
Nov 08 17:06:48 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T17:03:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-858788957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-638839753',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgUCl1WLcb59V3Q5jCPwB0FEUGaJcnditDCK4NsYCVn5HJLFzTT3spZBJc6w7p9cbfNoX8cf7k8DGPcXuUOV2irdcP0AhcWgDxOJyANKtp67p0tg/YP8TSLWl4B1A/hJw==',key_name='tempest-keypair-1263187494',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:04:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5706466a59c34a878f3eafcebee088d0',ramdisk_id='',reservation_id='r-bl0nidls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-494820798',owner_user_name='tempest-ServerActionsV293TestJSON-494820798-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:06:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b443fd16646495790682d8ad338df57',uuid=5575cb2b-b93d-4048-bb96-c4cd7f19ee1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3021424c-2541-449d-b3f8-ffca35fdb364", "address": "fa:16:3e:6f:e9:d8", "network": {"id": "2b28db73-56c6-4cc7-95de-75ec297a7809", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-839594529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5706466a59c34a878f3eafcebee088d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3021424c-25", "ovs_interfaceid": "3021424c-2541-449d-b3f8-ffca35fdb364", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Converting VIF {"id": "3021424c-2541-449d-b3f8-ffca35fdb364", "address": "fa:16:3e:6f:e9:d8", "network": {"id": "2b28db73-56c6-4cc7-95de-75ec297a7809", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-839594529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5706466a59c34a878f3eafcebee088d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3021424c-25", "ovs_interfaceid": "3021424c-2541-449d-b3f8-ffca35fdb364", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:e9:d8,bridge_name='br-int',has_traffic_filtering=True,id=3021424c-2541-449d-b3f8-ffca35fdb364,network=Network(2b28db73-56c6-4cc7-95de-75ec297a7809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3021424c-25') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG os_vif [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:e9:d8,bridge_name='br-int',has_traffic_filtering=True,id=3021424c-2541-449d-b3f8-ffca35fdb364,network=Network(2b28db73-56c6-4cc7-95de-75ec297a7809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3021424c-25') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d6f9952-162b-5e54-9a57-d57e0996e34f', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3021424c-25, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3021424c-25, col_values=(('qos', UUID('e16b6161-2b20-4a30-8c55-a1a0fb780ce1')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3021424c-25, col_values=(('external_ids', {'iface-id': '3021424c-2541-449d-b3f8-ffca35fdb364', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:e9:d8', 'vm-uuid': '5575cb2b-b93d-4048-bb96-c4cd7f19ee1d'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:06:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:49 user nova-compute[74669]: INFO os_vif [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:e9:d8,bridge_name='br-int',has_traffic_filtering=True,id=3021424c-2541-449d-b3f8-ffca35fdb364,network=Network(2b28db73-56c6-4cc7-95de-75ec297a7809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3021424c-25')
Nov 08 17:06:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:06:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] No VIF found with MAC fa:16:3e:6f:e9:d8, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:06:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:50 user nova-compute[74669]: DEBUG nova.compute.manager [req-afda556a-0779-4765-8080-b4651c5351ba req-b8e3a32b-af81-4bcd-bb25-d5e090130490 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Received event network-vif-plugged-3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:06:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-afda556a-0779-4765-8080-b4651c5351ba req-b8e3a32b-af81-4bcd-bb25-d5e090130490 service nova] Acquiring lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:06:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-afda556a-0779-4765-8080-b4651c5351ba req-b8e3a32b-af81-4bcd-bb25-d5e090130490 service nova] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:06:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-afda556a-0779-4765-8080-b4651c5351ba req-b8e3a32b-af81-4bcd-bb25-d5e090130490 service nova] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:06:50 user nova-compute[74669]: DEBUG nova.compute.manager [req-afda556a-0779-4765-8080-b4651c5351ba req-b8e3a32b-af81-4bcd-bb25-d5e090130490 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] No waiting events found dispatching network-vif-plugged-3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:06:50 user nova-compute[74669]: WARNING nova.compute.manager [req-afda556a-0779-4765-8080-b4651c5351ba req-b8e3a32b-af81-4bcd-bb25-d5e090130490 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Received unexpected event network-vif-plugged-3021424c-2541-449d-b3f8-ffca35fdb364 for instance with vm_state active and task_state rebuild_spawning.
Nov 08 17:06:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:52 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:06:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:06:52 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Instance spawned successfully.
Nov 08 17:06:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:06:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:06:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:06:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:06:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:06:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:06:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:06:52 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:06:52 user nova-compute[74669]: DEBUG nova.compute.manager [req-f2ee3cce-6bc3-405e-a2f2-66135ff87be0 req-c15a9280-ee12-490d-a656-4e12be9cf270 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Received event network-vif-plugged-3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:06:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f2ee3cce-6bc3-405e-a2f2-66135ff87be0 req-c15a9280-ee12-490d-a656-4e12be9cf270 service nova] Acquiring lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:06:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f2ee3cce-6bc3-405e-a2f2-66135ff87be0 req-c15a9280-ee12-490d-a656-4e12be9cf270 service nova] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:06:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f2ee3cce-6bc3-405e-a2f2-66135ff87be0 req-c15a9280-ee12-490d-a656-4e12be9cf270 service nova] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:06:52 user nova-compute[74669]: DEBUG nova.compute.manager [req-f2ee3cce-6bc3-405e-a2f2-66135ff87be0 req-c15a9280-ee12-490d-a656-4e12be9cf270 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] No waiting events found dispatching network-vif-plugged-3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:06:52 user nova-compute[74669]: WARNING nova.compute.manager [req-f2ee3cce-6bc3-405e-a2f2-66135ff87be0 req-c15a9280-ee12-490d-a656-4e12be9cf270 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Received unexpected event network-vif-plugged-3021424c-2541-449d-b3f8-ffca35fdb364 for instance with vm_state active and task_state rebuild_spawning.
Nov 08 17:06:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:06:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:06:52 user nova-compute[74669]: DEBUG nova.objects.instance [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74669) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 08 17:06:52 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:06:52 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:06:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ebb1075f-f5eb-4f1e-9035-82b72178fcdf tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.084s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:06:53 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:06:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:06:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:06:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:06:53 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:06:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:06:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:06:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:06:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:06:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:06:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:06:59 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:06:59 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:06:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=7609MB free_disk=25.212291717529297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:06:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:06:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:06:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:06:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:06:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7b335462-0d93-4899-a223-5c2e36932578 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:06:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance d91eaa51-6bf4-40eb-9f36-f8e838501373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:06:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance ee7af599-1f24-4828-913f-5ba3687619df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:06:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b68038d5-a01a-49a2-bd73-80cec03e68f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:06:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:06:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance af8b58ff-90d5-4a04-844a-ac0534a7e413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:06:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 55c67717-eb46-4617-9165-28531360e5d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:06:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 84fac5e1-7ef0-417a-8888-955a7c9f8944 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:06:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance dff7cbf2-497a-4a27-a0b1-2e97f1391090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:06:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:06:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:06:59 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing inventories for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 17:06:59 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Updating ProviderTree inventory for provider ce26964b-e55b-43d2-801a-7221ff1fe64b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 17:06:59 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Updating inventory in ProviderTree for provider ce26964b-e55b-43d2-801a-7221ff1fe64b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 17:06:59 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing aggregate associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, aggregates: None {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 17:06:59 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing trait associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, traits: HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 17:07:00 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:07:00 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:07:00 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:07:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.798s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:01 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:07:01 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:07:01 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:07:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:07:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-d91eaa51-6bf4-40eb-9f36-f8e838501373" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:07:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-d91eaa51-6bf4-40eb-9f36-f8e838501373" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:07:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:07:02 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Updating instance_info_cache with network_info: [{"id": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "address": "fa:16:3e:96:ba:06", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd57159a-b8", "ovs_interfaceid": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:07:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-d91eaa51-6bf4-40eb-9f36-f8e838501373" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:07:02 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:07:02 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:07:02 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:07:02 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:07:02 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:07:02 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:07:02 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:07:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:07:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:07:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:07:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:07:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:07:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:04 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:07:04 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 17:07:04 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] There are 0 instances to clean {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 17:07:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "55c67717-eb46-4617-9165-28531360e5d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "55c67717-eb46-4617-9165-28531360e5d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "55c67717-eb46-4617-9165-28531360e5d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "55c67717-eb46-4617-9165-28531360e5d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "55c67717-eb46-4617-9165-28531360e5d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:16 user nova-compute[74669]: INFO nova.compute.manager [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Terminating instance
Nov 08 17:07:16 user nova-compute[74669]: DEBUG nova.compute.manager [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:07:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-28df7497-e58d-40d0-9510-ef1306f075fd req-9abb43a5-6036-4c2c-94b0-d6c1c462197d service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Received event network-vif-unplugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:07:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-28df7497-e58d-40d0-9510-ef1306f075fd req-9abb43a5-6036-4c2c-94b0-d6c1c462197d service nova] Acquiring lock "55c67717-eb46-4617-9165-28531360e5d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-28df7497-e58d-40d0-9510-ef1306f075fd req-9abb43a5-6036-4c2c-94b0-d6c1c462197d service nova] Lock "55c67717-eb46-4617-9165-28531360e5d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-28df7497-e58d-40d0-9510-ef1306f075fd req-9abb43a5-6036-4c2c-94b0-d6c1c462197d service nova] Lock "55c67717-eb46-4617-9165-28531360e5d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-28df7497-e58d-40d0-9510-ef1306f075fd req-9abb43a5-6036-4c2c-94b0-d6c1c462197d service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] No waiting events found dispatching network-vif-unplugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:07:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-28df7497-e58d-40d0-9510-ef1306f075fd req-9abb43a5-6036-4c2c-94b0-d6c1c462197d service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Received event network-vif-unplugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:07:17 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Instance destroyed successfully.
Nov 08 17:07:17 user nova-compute[74669]: DEBUG nova.objects.instance [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lazy-loading 'resources' on Instance uuid 55c67717-eb46-4617-9165-28531360e5d7 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:07:17 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T16:59:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-287785015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-287785015',id=17,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqTEGMrhgsJerp3F07Qjp9lZ3WIFCasSJwyynJzvn5F9IQ6K479N2ZxX951BDCBv5rK5xSEBYvlpUodpv7Vp0m4MieCBpJEx9IDLx1wyhScDRdXhBk/8ggJAZZ7b45+jg==',key_name='tempest-keypair-185784068',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:04:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f1e9778e17a4e0fa1aa1f41d323a88c',ramdisk_id='',reservation_id='r-fr2itb4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-317302826',owner_user_name='tempest-AttachVolumeShelveTestJSON-317302826-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:04:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8bcb0586bce42a3a1a59b2cbc99f846',uuid=55c67717-eb46-4617-9165-28531360e5d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "address": "fa:16:3e:79:63:9e", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e437d3e-12", "ovs_interfaceid": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:07:17 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converting VIF {"id": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "address": "fa:16:3e:79:63:9e", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e437d3e-12", "ovs_interfaceid": "8e437d3e-12dd-4bec-aa76-2951dc03b5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:07:17 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:63:9e,bridge_name='br-int',has_traffic_filtering=True,id=8e437d3e-12dd-4bec-aa76-2951dc03b5eb,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e437d3e-12') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:07:17 user nova-compute[74669]: DEBUG os_vif [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:63:9e,bridge_name='br-int',has_traffic_filtering=True,id=8e437d3e-12dd-4bec-aa76-2951dc03b5eb,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e437d3e-12') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:07:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e437d3e-12, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:07:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:07:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1c665a4-3b4c-439b-b370-7865b61f0641) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:07:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:07:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:17 user nova-compute[74669]: INFO os_vif [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:63:9e,bridge_name='br-int',has_traffic_filtering=True,id=8e437d3e-12dd-4bec-aa76-2951dc03b5eb,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e437d3e-12')
Nov 08 17:07:17 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Deleting instance files /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7_del
Nov 08 17:07:17 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Deletion of /opt/stack/data/nova/instances/55c67717-eb46-4617-9165-28531360e5d7_del complete
Nov 08 17:07:17 user nova-compute[74669]: INFO nova.compute.manager [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 08 17:07:17 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:07:17 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:07:17 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 55c67717-eb46-4617-9165-28531360e5d7] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:07:18 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:07:18 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Took 0.91 seconds to deallocate network for instance.
Nov 08 17:07:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:18 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:07:18 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:07:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:18 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Deleted allocations for instance 55c67717-eb46-4617-9165-28531360e5d7
Nov 08 17:07:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c6842518-a70a-49db-b461-4a1d2a029460 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "55c67717-eb46-4617-9165-28531360e5d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.465s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:19 user nova-compute[74669]: DEBUG nova.compute.manager [req-dd991a56-a9be-4ee2-8e19-af3412ed3ac5 req-c18b1ea6-250f-4a13-a212-9a3c4294243d service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Received event network-vif-plugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:07:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-dd991a56-a9be-4ee2-8e19-af3412ed3ac5 req-c18b1ea6-250f-4a13-a212-9a3c4294243d service nova] Acquiring lock "55c67717-eb46-4617-9165-28531360e5d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-dd991a56-a9be-4ee2-8e19-af3412ed3ac5 req-c18b1ea6-250f-4a13-a212-9a3c4294243d service nova] Lock "55c67717-eb46-4617-9165-28531360e5d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-dd991a56-a9be-4ee2-8e19-af3412ed3ac5 req-c18b1ea6-250f-4a13-a212-9a3c4294243d service nova] Lock "55c67717-eb46-4617-9165-28531360e5d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:19 user nova-compute[74669]: DEBUG nova.compute.manager [req-dd991a56-a9be-4ee2-8e19-af3412ed3ac5 req-c18b1ea6-250f-4a13-a212-9a3c4294243d service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] No waiting events found dispatching network-vif-plugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:07:19 user nova-compute[74669]: WARNING nova.compute.manager [req-dd991a56-a9be-4ee2-8e19-af3412ed3ac5 req-c18b1ea6-250f-4a13-a212-9a3c4294243d service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Received unexpected event network-vif-plugged-8e437d3e-12dd-4bec-aa76-2951dc03b5eb for instance with vm_state deleted and task_state None.
Nov 08 17:07:19 user nova-compute[74669]: DEBUG nova.compute.manager [req-dd991a56-a9be-4ee2-8e19-af3412ed3ac5 req-c18b1ea6-250f-4a13-a212-9a3c4294243d service nova] [instance: 55c67717-eb46-4617-9165-28531360e5d7] Received event network-vif-deleted-8e437d3e-12dd-4bec-aa76-2951dc03b5eb {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:07:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZkLWvFPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:07:29 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:07:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:07:29 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:07:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:07:29 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd24a3c-7100-4eaf-95e8-f1901fd83cdc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:07:29 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ec7d48-16c3-4dfb-a80a-7bdc8d871593]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5] added
Nov 08 17:07:29 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe9f354-d80a-4870-b855-3f5559db09c4]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8154a118-0794-4f98-8226-06d73b19cd32]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZkLWvFPj {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZkLWvFPj" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[671d7ac9-bbce-4bba-a1a3-ae1ae9e2d2b0]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZkLWvFPj'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0332124f-1c37-4f27-9b00-0ba069d7b197]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f6f35c-b95a-4f25-8eff-5da79d14e195]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:07:29 user nova-compute[74669]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:07:29 user nova-compute[74669]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:07:29 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:07:29 user nova-compute[74669]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:07:29 user nova-compute[74669]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:07:29 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[659b96cd-662f-4f1d-9ce6-f52423875245]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5, portal: 172.16.0.220,3260]
Nov 08 17:07:29 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5, portal: 172.16.0.220,3260] successful.
Nov 08 17:07:29 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee831a3-d246-411c-a877-10e9fde3ac48]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:07:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2100b6-8e6c-4291-802e-a8410888abb2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:07:30 user nova-compute[74669]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:07:30 user nova-compute[74669]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:07:30 user nova-compute[74669]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 (non-flash)
Nov 08 17:07:30 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:07:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:07:30 user nova-compute[74669]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:07:30 user nova-compute[74669]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:07:30 user nova-compute[74669]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 (non-flash)
Nov 08 17:07:30 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:07:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:07:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:07:30 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:07:30 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:07:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d634a2-a30b-45ae-97a8-2aec9e9d0e8d]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:30 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:07:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZkLWvFPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:07:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:07:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23734633332343138', 'path': '/dev/sdd'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:07:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734633332343138', 'path': '/dev/sdd'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:07:31 user nova-compute[74669]: DEBUG nova.objects.instance [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lazy-loading 'flavor' on Instance uuid 84fac5e1-7ef0-417a-8888-955a7c9f8944 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:07:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 17:07:31 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:07:31 user nova-compute[74669]:   <source dev="/dev/sdd"/>
Nov 08 17:07:31 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:07:31 user nova-compute[74669]:   <serial>e1b9998c-085b-4ead-a5f2-96aff332aed5</serial>
Nov 08 17:07:31 user nova-compute[74669]: </disk>
Nov 08 17:07:31 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 17:07:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:07:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:07:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] No VIF found with MAC fa:16:3e:79:4f:aa, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:07:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-098e60b2-f89e-4161-927f-22dbb18b3295 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 64.662s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:07:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "84fac5e1-7ef0-417a-8888-955a7c9f8944" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:33 user nova-compute[74669]: INFO nova.compute.manager [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Detaching volume e1b9998c-085b-4ead-a5f2-96aff332aed5
Nov 08 17:07:33 user nova-compute[74669]: INFO nova.virt.block_device [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Attempting to driver detach volume e1b9998c-085b-4ead-a5f2-96aff332aed5 from mountpoint /dev/vdb
Nov 08 17:07:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Attempting to detach device vdb from instance 84fac5e1-7ef0-417a-8888-955a7c9f8944 from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 17:07:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:07:33 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:07:33 user nova-compute[74669]:   <source dev="/dev/sdd"/>
Nov 08 17:07:33 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:07:33 user nova-compute[74669]:   <serial>e1b9998c-085b-4ead-a5f2-96aff332aed5</serial>
Nov 08 17:07:33 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:07:33 user nova-compute[74669]: </disk>
Nov 08 17:07:33 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:07:33 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Successfully detached device vdb from instance 84fac5e1-7ef0-417a-8888-955a7c9f8944 from the persistent domain config.
Nov 08 17:07:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 84fac5e1-7ef0-417a-8888-955a7c9f8944 from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 17:07:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:07:33 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:07:33 user nova-compute[74669]:   <source dev="/dev/sdd"/>
Nov 08 17:07:33 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:07:33 user nova-compute[74669]:   <serial>e1b9998c-085b-4ead-a5f2-96aff332aed5</serial>
Nov 08 17:07:33 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:07:33 user nova-compute[74669]: </disk>
Nov 08 17:07:33 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:07:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 84fac5e1-7ef0-417a-8888-955a7c9f8944 {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 17:07:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "ee7af599-1f24-4828-913f-5ba3687619df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "ee7af599-1f24-4828-913f-5ba3687619df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "ee7af599-1f24-4828-913f-5ba3687619df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "ee7af599-1f24-4828-913f-5ba3687619df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "ee7af599-1f24-4828-913f-5ba3687619df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.005s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:45 user nova-compute[74669]: INFO nova.compute.manager [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Terminating instance
Nov 08 17:07:45 user nova-compute[74669]: DEBUG nova.compute.manager [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG nova.compute.manager [req-86a8e53b-ae4f-47cb-a95f-a2700fae4103 req-b8000a0a-0a16-4c0e-954e-8279c2aa1951 service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Received event network-vif-unplugged-ec94ef8c-0c4b-4578-99cd-a00aab4aa569 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-86a8e53b-ae4f-47cb-a95f-a2700fae4103 req-b8000a0a-0a16-4c0e-954e-8279c2aa1951 service nova] Acquiring lock "ee7af599-1f24-4828-913f-5ba3687619df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-86a8e53b-ae4f-47cb-a95f-a2700fae4103 req-b8000a0a-0a16-4c0e-954e-8279c2aa1951 service nova] Lock "ee7af599-1f24-4828-913f-5ba3687619df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-86a8e53b-ae4f-47cb-a95f-a2700fae4103 req-b8000a0a-0a16-4c0e-954e-8279c2aa1951 service nova] Lock "ee7af599-1f24-4828-913f-5ba3687619df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG nova.compute.manager [req-86a8e53b-ae4f-47cb-a95f-a2700fae4103 req-b8000a0a-0a16-4c0e-954e-8279c2aa1951 service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] No waiting events found dispatching network-vif-unplugged-ec94ef8c-0c4b-4578-99cd-a00aab4aa569 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG nova.compute.manager [req-86a8e53b-ae4f-47cb-a95f-a2700fae4103 req-b8000a0a-0a16-4c0e-954e-8279c2aa1951 service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Received event network-vif-unplugged-ec94ef8c-0c4b-4578-99cd-a00aab4aa569 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:46 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Instance destroyed successfully.
Nov 08 17:07:46 user nova-compute[74669]: DEBUG nova.objects.instance [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lazy-loading 'resources' on Instance uuid ee7af599-1f24-4828-913f-5ba3687619df {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:01:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1978130736',display_name='tempest-tempest.common.compute-instance-1978130736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1978130736',id=22,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3A71/NbWcwpTJz22ESjYCtiVwC2rdyy/Yutt8aAXWNb+I+QadzUiCPwuOVtgyI1vm3q9D1X3xnbz+4EixM+d9MN7xlEr6K2tBXLrgiIndpb1q+Dq8t7EKp9UoVLLBA1w==',key_name='tempest-keypair-726294899',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:01:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='766b82c0c2cd480f96d155adf4f6de4c',ramdisk_id='',reservation_id='r-tvnwhmql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-23582724',owner_user_name='tempest-ServerActionsTestOtherA-23582724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:01:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e118c178ece2492bb2d975643c405196',uuid=ee7af599-1f24-4828-913f-5ba3687619df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec94ef8c-0c4b-4578-99cd-a00aab4aa569", "address": "fa:16:3e:4e:de:98", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec94ef8c-0c", "ovs_interfaceid": "ec94ef8c-0c4b-4578-99cd-a00aab4aa569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converting VIF {"id": "ec94ef8c-0c4b-4578-99cd-a00aab4aa569", "address": "fa:16:3e:4e:de:98", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec94ef8c-0c", "ovs_interfaceid": "ec94ef8c-0c4b-4578-99cd-a00aab4aa569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:de:98,bridge_name='br-int',has_traffic_filtering=True,id=ec94ef8c-0c4b-4578-99cd-a00aab4aa569,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec94ef8c-0c') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG os_vif [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:de:98,bridge_name='br-int',has_traffic_filtering=True,id=ec94ef8c-0c4b-4578-99cd-a00aab4aa569,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec94ef8c-0c') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec94ef8c-0c, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ea3dc9e-ec96-4ab1-b900-2dbe795f48d1) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:46 user nova-compute[74669]: INFO os_vif [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:de:98,bridge_name='br-int',has_traffic_filtering=True,id=ec94ef8c-0c4b-4578-99cd-a00aab4aa569,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec94ef8c-0c')
Nov 08 17:07:46 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Deleting instance files /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df_del
Nov 08 17:07:46 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Deletion of /opt/stack/data/nova/instances/ee7af599-1f24-4828-913f-5ba3687619df_del complete
Nov 08 17:07:46 user nova-compute[74669]: INFO nova.compute.manager [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 08 17:07:46 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:07:46 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: ee7af599-1f24-4828-913f-5ba3687619df] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:07:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:47 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:07:47 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Took 0.99 seconds to deallocate network for instance.
Nov 08 17:07:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:07:48 user nova-compute[74669]: WARNING nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Nov 08 17:07:48 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid 7b335462-0d93-4899-a223-5c2e36932578 {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid d91eaa51-6bf4-40eb-9f36-f8e838501373 {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid b68038d5-a01a-49a2-bd73-80cec03e68f9 {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid 84fac5e1-7ef0-417a-8888-955a7c9f8944 {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid dff7cbf2-497a-4a27-a0b1-2e97f1391090 {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid ee7af599-1f24-4828-913f-5ba3687619df {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "7b335462-0d93-4899-a223-5c2e36932578" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "7b335462-0d93-4899-a223-5c2e36932578" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "d91eaa51-6bf4-40eb-9f36-f8e838501373" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "b68038d5-a01a-49a2-bd73-80cec03e68f9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "84fac5e1-7ef0-417a-8888-955a7c9f8944" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "ee7af599-1f24-4828-913f-5ba3687619df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "7b335462-0d93-4899-a223-5c2e36932578" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.126s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:48 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Deleted allocations for instance ee7af599-1f24-4828-913f-5ba3687619df
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bde4695f-95b6-4ca2-b3fd-565f68242669 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "ee7af599-1f24-4828-913f-5ba3687619df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.539s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "ee7af599-1f24-4828-913f-5ba3687619df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.340s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "ee7af599-1f24-4828-913f-5ba3687619df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-c98c6351-6fbe-4731-97f5-2473faf1d1e3 req-84647f9c-5554-42de-bb4d-c9b6ea06de0c service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Received event network-changed-adf75b32-76fa-4ce3-b1bd-2a6170848b58 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-c98c6351-6fbe-4731-97f5-2473faf1d1e3 req-84647f9c-5554-42de-bb4d-c9b6ea06de0c service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Refreshing instance network info cache due to event network-changed-adf75b32-76fa-4ce3-b1bd-2a6170848b58. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c98c6351-6fbe-4731-97f5-2473faf1d1e3 req-84647f9c-5554-42de-bb4d-c9b6ea06de0c service nova] Acquiring lock "refresh_cache-dff7cbf2-497a-4a27-a0b1-2e97f1391090" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c98c6351-6fbe-4731-97f5-2473faf1d1e3 req-84647f9c-5554-42de-bb4d-c9b6ea06de0c service nova] Acquired lock "refresh_cache-dff7cbf2-497a-4a27-a0b1-2e97f1391090" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG nova.network.neutron [req-c98c6351-6fbe-4731-97f5-2473faf1d1e3 req-84647f9c-5554-42de-bb4d-c9b6ea06de0c service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Refreshing network info cache for port adf75b32-76fa-4ce3-b1bd-2a6170848b58 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-8c63e364-9269-462d-bce4-c2618bcabd29 req-db96af1d-a5d1-4f9c-8682-5cea064dbe72 service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Received event network-vif-plugged-ec94ef8c-0c4b-4578-99cd-a00aab4aa569 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8c63e364-9269-462d-bce4-c2618bcabd29 req-db96af1d-a5d1-4f9c-8682-5cea064dbe72 service nova] Acquiring lock "ee7af599-1f24-4828-913f-5ba3687619df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8c63e364-9269-462d-bce4-c2618bcabd29 req-db96af1d-a5d1-4f9c-8682-5cea064dbe72 service nova] Lock "ee7af599-1f24-4828-913f-5ba3687619df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8c63e364-9269-462d-bce4-c2618bcabd29 req-db96af1d-a5d1-4f9c-8682-5cea064dbe72 service nova] Lock "ee7af599-1f24-4828-913f-5ba3687619df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-8c63e364-9269-462d-bce4-c2618bcabd29 req-db96af1d-a5d1-4f9c-8682-5cea064dbe72 service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] No waiting events found dispatching network-vif-plugged-ec94ef8c-0c4b-4578-99cd-a00aab4aa569 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:07:48 user nova-compute[74669]: WARNING nova.compute.manager [req-8c63e364-9269-462d-bce4-c2618bcabd29 req-db96af1d-a5d1-4f9c-8682-5cea064dbe72 service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Received unexpected event network-vif-plugged-ec94ef8c-0c4b-4578-99cd-a00aab4aa569 for instance with vm_state deleted and task_state None.
Nov 08 17:07:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-8c63e364-9269-462d-bce4-c2618bcabd29 req-db96af1d-a5d1-4f9c-8682-5cea064dbe72 service nova] [instance: ee7af599-1f24-4828-913f-5ba3687619df] Received event network-vif-deleted-ec94ef8c-0c4b-4578-99cd-a00aab4aa569 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG nova.network.neutron [req-c98c6351-6fbe-4731-97f5-2473faf1d1e3 req-84647f9c-5554-42de-bb4d-c9b6ea06de0c service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Updated VIF entry in instance network info cache for port adf75b32-76fa-4ce3-b1bd-2a6170848b58. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:07:48 user nova-compute[74669]: DEBUG nova.network.neutron [req-c98c6351-6fbe-4731-97f5-2473faf1d1e3 req-84647f9c-5554-42de-bb4d-c9b6ea06de0c service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Updating instance_info_cache with network_info: [{"id": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "address": "fa:16:3e:6d:12:7d", "network": {"id": "03c29fa9-39a4-4633-8c7e-1c69b147193a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276510167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a409449798dc4b25acdd09d4930a8b28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf75b32-76", "ovs_interfaceid": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:07:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c98c6351-6fbe-4731-97f5-2473faf1d1e3 req-84647f9c-5554-42de-bb4d-c9b6ea06de0c service nova] Releasing lock "refresh_cache-dff7cbf2-497a-4a27-a0b1-2e97f1391090" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:07:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Acquiring lock "b68038d5-a01a-49a2-bd73-80cec03e68f9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:49 user nova-compute[74669]: INFO nova.compute.manager [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Detaching volume 48158446-e642-4723-98ce-bc2d5ae13de6
Nov 08 17:07:49 user nova-compute[74669]: INFO nova.virt.block_device [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Attempting to driver detach volume 48158446-e642-4723-98ce-bc2d5ae13de6 from mountpoint /dev/vdb
Nov 08 17:07:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Attempting to detach device vdb from instance b68038d5-a01a-49a2-bd73-80cec03e68f9 from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 17:07:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:07:49 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:07:49 user nova-compute[74669]:   <source dev="/dev/sde"/>
Nov 08 17:07:49 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:07:49 user nova-compute[74669]:   <serial>48158446-e642-4723-98ce-bc2d5ae13de6</serial>
Nov 08 17:07:49 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:07:49 user nova-compute[74669]: </disk>
Nov 08 17:07:49 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:07:49 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Successfully detached device vdb from instance b68038d5-a01a-49a2-bd73-80cec03e68f9 from the persistent domain config.
Nov 08 17:07:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b68038d5-a01a-49a2-bd73-80cec03e68f9 from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 17:07:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:07:49 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:07:49 user nova-compute[74669]:   <source dev="/dev/sde"/>
Nov 08 17:07:49 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:07:49 user nova-compute[74669]:   <serial>48158446-e642-4723-98ce-bc2d5ae13de6</serial>
Nov 08 17:07:49 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:07:49 user nova-compute[74669]: </disk>
Nov 08 17:07:49 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:07:49 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b68038d5-a01a-49a2-bd73-80cec03e68f9 {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 17:07:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:52 user nova-compute[74669]: INFO nova.compute.manager [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Terminating instance
Nov 08 17:07:52 user nova-compute[74669]: DEBUG nova.compute.manager [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG nova.compute.manager [req-4730f8fc-c797-41c2-a23f-e74c36cf1fd0 req-dab6791a-bba0-4b53-a527-e6e83c3bad62 service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Received event network-vif-unplugged-525ba5da-155c-4f87-9fae-8db52836f73e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4730f8fc-c797-41c2-a23f-e74c36cf1fd0 req-dab6791a-bba0-4b53-a527-e6e83c3bad62 service nova] Acquiring lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4730f8fc-c797-41c2-a23f-e74c36cf1fd0 req-dab6791a-bba0-4b53-a527-e6e83c3bad62 service nova] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4730f8fc-c797-41c2-a23f-e74c36cf1fd0 req-dab6791a-bba0-4b53-a527-e6e83c3bad62 service nova] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG nova.compute.manager [req-4730f8fc-c797-41c2-a23f-e74c36cf1fd0 req-dab6791a-bba0-4b53-a527-e6e83c3bad62 service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] No waiting events found dispatching network-vif-unplugged-525ba5da-155c-4f87-9fae-8db52836f73e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG nova.compute.manager [req-4730f8fc-c797-41c2-a23f-e74c36cf1fd0 req-dab6791a-bba0-4b53-a527-e6e83c3bad62 service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Received event network-vif-unplugged-525ba5da-155c-4f87-9fae-8db52836f73e for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:07:52 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Instance destroyed successfully.
Nov 08 17:07:52 user nova-compute[74669]: DEBUG nova.objects.instance [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'resources' on Instance uuid 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-352889271',display_name='tempest-ServerRescueNegativeTestJSON-server-352889271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-352889271',id=4,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:52:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='632d3acc026b4a869be4899a0ed2e2e2',ramdisk_id='',reservation_id='r-ux3r1hfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1743978403',owner_user_name='tempest-ServerRescueNegativeTestJSON-1743978403-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:52:49Z,user_data=None,user_id='4836f11b0e8346a2a7e835a6012f53fb',uuid=7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "525ba5da-155c-4f87-9fae-8db52836f73e", "address": "fa:16:3e:7b:7c:e2", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525ba5da-15", "ovs_interfaceid": "525ba5da-155c-4f87-9fae-8db52836f73e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converting VIF {"id": "525ba5da-155c-4f87-9fae-8db52836f73e", "address": "fa:16:3e:7b:7c:e2", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap525ba5da-15", "ovs_interfaceid": "525ba5da-155c-4f87-9fae-8db52836f73e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:7c:e2,bridge_name='br-int',has_traffic_filtering=True,id=525ba5da-155c-4f87-9fae-8db52836f73e,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525ba5da-15') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG os_vif [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:7c:e2,bridge_name='br-int',has_traffic_filtering=True,id=525ba5da-155c-4f87-9fae-8db52836f73e,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525ba5da-15') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap525ba5da-15, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=edbc5498-ab36-4e49-b071-eb5910d781ae) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:07:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:53 user nova-compute[74669]: INFO os_vif [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:7c:e2,bridge_name='br-int',has_traffic_filtering=True,id=525ba5da-155c-4f87-9fae-8db52836f73e,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap525ba5da-15')
Nov 08 17:07:53 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Deleting instance files /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8_del
Nov 08 17:07:53 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Deletion of /opt/stack/data/nova/instances/7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8_del complete
Nov 08 17:07:53 user nova-compute[74669]: INFO nova.compute.manager [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:07:53 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Took 0.45 seconds to deallocate network for instance.
Nov 08 17:07:53 user nova-compute[74669]: DEBUG nova.compute.manager [req-83d6e086-5ecc-427b-816d-485f99ab3251 req-b6cb7cb4-5d53-41ab-b9e3-b900a8bb46d7 service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Received event network-vif-deleted-525ba5da-155c-4f87-9fae-8db52836f73e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:07:53 user nova-compute[74669]: INFO nova.compute.manager [req-83d6e086-5ecc-427b-816d-485f99ab3251 req-b6cb7cb4-5d53-41ab-b9e3-b900a8bb46d7 service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Neutron deleted interface 525ba5da-155c-4f87-9fae-8db52836f73e; detaching it from the instance and deleting it from the info cache
Nov 08 17:07:53 user nova-compute[74669]: DEBUG nova.network.neutron [req-83d6e086-5ecc-427b-816d-485f99ab3251 req-b6cb7cb4-5d53-41ab-b9e3-b900a8bb46d7 service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG nova.compute.manager [req-83d6e086-5ecc-427b-816d-485f99ab3251 req-b6cb7cb4-5d53-41ab-b9e3-b900a8bb46d7 service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Detach interface failed, port_id=525ba5da-155c-4f87-9fae-8db52836f73e, reason: Instance 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8 could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:53 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 84fac5e1-7ef0-417a-8888-955a7c9f8944 is timed out.
Nov 08 17:07:53 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Successfully detached device vdb from instance 84fac5e1-7ef0-417a-8888-955a7c9f8944 from the live domain config.
Nov 08 17:07:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZkLWvFPj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:07:53 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:07:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c9c441-7646-4225-891a-adfe9f28cb16]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:07:53 user nova-compute[74669]: No targets found.
Nov 08 17:07:53 user nova-compute[74669]: iSNS:
Nov 08 17:07:53 user nova-compute[74669]: No targets found.
Nov 08 17:07:53 user nova-compute[74669]: STATIC:
Nov 08 17:07:53 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5
Nov 08 17:07:53 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:07:53 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:07:53 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b
Nov 08 17:07:53 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:07:53 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:07:53 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79
Nov 08 17:07:53 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:07:53 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:07:53 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6
Nov 08 17:07:53 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:07:53 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:07:53 user nova-compute[74669]: FIRMWARE:
Nov 08 17:07:53 user nova-compute[74669]: No targets found.
Nov 08 17:07:53 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:07:53 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:07:53 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbae595-4c98-417e-a9e3-2b748719a238]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9e5c25-d73b-48c2-8053-91421258c4ae]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:07:53 user nova-compute[74669]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:07:53 user nova-compute[74669]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:07:53 user nova-compute[74669]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 (non-flash)
Nov 08 17:07:53 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:07:53 user nova-compute[74669]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:07:53 user nova-compute[74669]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:07:53 user nova-compute[74669]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 (non-flash)
Nov 08 17:07:53 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9a825beb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5'): ({'sdd'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Removing single pathed devices sdd {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dc48c8-19d5-4af3-ac91-7442cb58239a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e6c114-f68e-41a6-8734-6e219a6091c9]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Flushing IO for device /dev/sdd {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12de092-6230-423e-a035-b4ffa6cec11d]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b337fa2-27a1-4965-b266-32a29dbbb26d]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] SCSI volumes sdd have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b454a7-2365-454c-b9ba-8031769b6686]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.197s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:07:53 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Deleted allocations for instance 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf8f3dc-bea1-4e1d-9bbd-39745290582d]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5, portal: 172.16.0.220,3260]
Nov 08 17:07:53 user nova-compute[74669]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5, portal: 172.16.0.220,3260] successful.
Nov 08 17:07:53 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:07:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b9998c-085b-4ead-a5f2-96aff332aed5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:54 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f837033-0187-4fcd-8765-87e031bbcf92]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:07:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:07:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] <== disconnect_volume: return (340ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:07:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:07:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6665bffd-5517-4d57-a655-27c076303e68 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.957s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-1b4ff94d-6101-43c7-855a-f0070c97ebbd req-456de1f7-56cd-4231-8473-b105bde7933b service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Received event network-vif-plugged-525ba5da-155c-4f87-9fae-8db52836f73e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:07:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1b4ff94d-6101-43c7-855a-f0070c97ebbd req-456de1f7-56cd-4231-8473-b105bde7933b service nova] Acquiring lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1b4ff94d-6101-43c7-855a-f0070c97ebbd req-456de1f7-56cd-4231-8473-b105bde7933b service nova] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1b4ff94d-6101-43c7-855a-f0070c97ebbd req-456de1f7-56cd-4231-8473-b105bde7933b service nova] Lock "7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-1b4ff94d-6101-43c7-855a-f0070c97ebbd req-456de1f7-56cd-4231-8473-b105bde7933b service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] No waiting events found dispatching network-vif-plugged-525ba5da-155c-4f87-9fae-8db52836f73e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:07:54 user nova-compute[74669]: WARNING nova.compute.manager [req-1b4ff94d-6101-43c7-855a-f0070c97ebbd req-456de1f7-56cd-4231-8473-b105bde7933b service nova] [instance: 7e0ee1d9-8bd5-4bdc-9b45-06a7893085e8] Received unexpected event network-vif-plugged-525ba5da-155c-4f87-9fae-8db52836f73e for instance with vm_state deleted and task_state None.
Nov 08 17:07:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:07:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8a98daf3-ac02-4506-84ff-3b808892b7b7 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Acquiring lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8a98daf3-ac02-4506-84ff-3b808892b7b7 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:56 user nova-compute[74669]: DEBUG nova.objects.instance [None req-8a98daf3-ac02-4506-84ff-3b808892b7b7 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lazy-loading 'flavor' on Instance uuid dff7cbf2-497a-4a27-a0b1-2e97f1391090 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:07:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8a98daf3-ac02-4506-84ff-3b808892b7b7 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8a98daf3-ac02-4506-84ff-3b808892b7b7 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Acquiring lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8a98daf3-ac02-4506-84ff-3b808892b7b7 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:56 user nova-compute[74669]: INFO nova.compute.manager [None req-8a98daf3-ac02-4506-84ff-3b808892b7b7 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Attaching volume ca8d7d16-3da9-41ef-a4cb-77a937148606 to /dev/vdb
Nov 08 17:07:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG os_brick.utils [None req-8a98daf3-ac02-4506-84ff-3b808892b7b7 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26b9896-946a-4e97-8d13-d861638f3a69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bac13e6-c364-4e5e-815e-50116cbf3484]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d54b98-7707-4238-820f-9818b121ad69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4962ae9-ec90-43f9-aafa-86709efed44d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-8a98daf3-ac02-4506-84ff-3b808892b7b7 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-8a98daf3-ac02-4506-84ff-3b808892b7b7 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a98daf3-ac02-4506-84ff-3b808892b7b7 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:07:57 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:07:57 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead3d531-c88c-4be2-98a6-5c74ce5430db]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-8a98daf3-ac02-4506-84ff-3b808892b7b7 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-8a98daf3-ac02-4506-84ff-3b808892b7b7 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-8a98daf3-ac02-4506-84ff-3b808892b7b7 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG os_brick.utils [None req-8a98daf3-ac02-4506-84ff-3b808892b7b7 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-8a98daf3-ac02-4506-84ff-3b808892b7b7 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Updating existing volume attachment record: c307e07d-13f0-4ac9-91f9-4afbcc4c8f55 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:07:57 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:07:57 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:07:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=7905MB free_disk=25.285045623779297GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7b335462-0d93-4899-a223-5c2e36932578 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance d91eaa51-6bf4-40eb-9f36-f8e838501373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance b68038d5-a01a-49a2-bd73-80cec03e68f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance af8b58ff-90d5-4a04-844a-ac0534a7e413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 84fac5e1-7ef0-417a-8888-955a7c9f8944 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance dff7cbf2-497a-4a27-a0b1-2e97f1391090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:07:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:07:58 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:07:58 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:07:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:07:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:07:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:01 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:08:01 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:08:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:08:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-b68038d5-a01a-49a2-bd73-80cec03e68f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:08:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-b68038d5-a01a-49a2-bd73-80cec03e68f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:08:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:08:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Updating instance_info_cache with network_info: [{"id": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "address": "fa:16:3e:ef:37:d8", "network": {"id": "5e97ae50-3f68-4098-a5c8-f17afb8a7366", "bridge": "br-int", "label": "tempest-TestVolumeSwap-200033215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da115791fd6d49ae84005c6f47dc1e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa24248f-00", "ovs_interfaceid": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:08:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-b68038d5-a01a-49a2-bd73-80cec03e68f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:08:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:08:01 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:08:01 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:08:01 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:08:02 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:08:02 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:08:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:04 user nova-compute[74669]: DEBUG nova.objects.instance [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lazy-loading 'flavor' on Instance uuid 84fac5e1-7ef0-417a-8888-955a7c9f8944 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:08:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b011bcf6-c74b-412d-9e5c-eda94684d5de tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 31.290s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 16.228s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:09 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b68038d5-a01a-49a2-bd73-80cec03e68f9 is timed out.
Nov 08 17:08:09 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Successfully detached device vdb from instance b68038d5-a01a-49a2-bd73-80cec03e68f9 from the live domain config.
Nov 08 17:08:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:08:09 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rRecaDLq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:08:09 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:08:09 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:08:09 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:08:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:09 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02ffefc-d54a-4d06-bcf7-1cca221f9469]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:09 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:08:09 user nova-compute[74669]: No targets found.
Nov 08 17:08:09 user nova-compute[74669]: iSNS:
Nov 08 17:08:09 user nova-compute[74669]: No targets found.
Nov 08 17:08:09 user nova-compute[74669]: STATIC:
Nov 08 17:08:09 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b
Nov 08 17:08:09 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:08:09 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:08:09 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79
Nov 08 17:08:09 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:08:09 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:08:09 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6
Nov 08 17:08:09 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:08:09 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:08:09 user nova-compute[74669]: FIRMWARE:
Nov 08 17:08:09 user nova-compute[74669]: No targets found.
Nov 08 17:08:09 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:08:09 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:08:09 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:08:09 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:08:09 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:08:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:09 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5162b2a-8c91-4759-aae9-8de23951128a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:09 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4eae89f-e341-4b5c-a726-8cde66a138ec]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:08:10 user nova-compute[74669]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:08:10 user nova-compute[74669]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:08:10 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 (non-flash)
Nov 08 17:08:10 user nova-compute[74669]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:08:10 user nova-compute[74669]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:08:10 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9846bff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6'): ({'sde'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Removing single pathed devices sde {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5cb2f2-48fa-4b63-8a7e-af59410fecad]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8719c5-a01c-4e82-b330-92c65e08b0cd]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Flushing IO for device /dev/sde {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5559bdd-3eab-481b-a73b-d9001514c472]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.127s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[391706b8-3fdd-4f97-a4b5-bc8ea0369ae8]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] SCSI volumes sde have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[13730c32-97d4-4cca-89a7-e0d6346d9a82]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "bf46a10b-747a-490c-8e22-a76ec65fafdf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba53ff5-511c-4cca-b5e4-355d526df7d3]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6, portal: 172.16.0.220,3260]
Nov 08 17:08:10 user nova-compute[74669]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6, portal: 172.16.0.220,3260] successful.
Nov 08 17:08:10 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG nova.compute.manager [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48158446-e642-4723-98ce-bc2d5ae13de6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fad45e6-6a9a-4897-b1b4-e86f1d978b7c]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] <== disconnect_volume: return (376ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:08:10 user nova-compute[74669]: INFO nova.compute.claims [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Claim successful on node user
Nov 08 17:08:10 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG nova.compute.manager [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG nova.compute.manager [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG nova.network.neutron [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:08:10 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:08:10 user nova-compute[74669]: DEBUG nova.compute.manager [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG nova.policy [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8bcb0586bce42a3a1a59b2cbc99f846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1e9778e17a4e0fa1aa1f41d323a88c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG nova.compute.manager [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:08:10 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Creating image(s)
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "/opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "/opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.220s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:11 user nova-compute[74669]: DEBUG nova.objects.instance [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lazy-loading 'flavor' on Instance uuid b68038d5-a01a-49a2-bd73-80cec03e68f9 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:08:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-170de7fe-0933-4e3f-becc-17e3e007322f tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.126s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.174s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk 1073741824" returned: 0 in 0.056s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:11 user nova-compute[74669]: DEBUG nova.network.neutron [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Successfully created port: 48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.volume.cinder [None req-8a98daf3-ac02-4506-84ff-3b808892b7b7 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Update attachment failed for attachment c307e07d-13f0-4ac9-91f9-4afbcc4c8f55. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cb4c2ad4-8e6b-4102-af49-f3a73e1c3ff1) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cb4c2ad4-8e6b-4102-af49-f3a73e1c3ff1)
Nov 08 17:08:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.216s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:11 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:08:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [None req-8a98daf3-ac02-4506-84ff-3b808892b7b7 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Failed to attach ca8d7d16-3da9-41ef-a4cb-77a937148606 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cb4c2ad4-8e6b-4102-af49-f3a73e1c3ff1)
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Traceback (most recent call last):
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]     self._do_attach(context, instance, volume, volume_api,
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]     self._volume_attach(context, volume, connector, instance,
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]     connection_info = volume_api.attachment_update(
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]     res = method(self, ctx, *args, **kwargs)
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]     with excutils.save_and_reraise_exception():
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]     self.force_reraise()
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]     raise self.value
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]     return method.func(obj, *args, **kwargs)
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]     resp = self._update('/attachments/%s' % id, body)
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]     return self.request(url, method, **kwargs)
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090]     raise exceptions.from_response(resp, body)
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cb4c2ad4-8e6b-4102-af49-f3a73e1c3ff1)
Nov 08 17:08:11 user nova-compute[74669]: ERROR nova.compute.manager [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] 
Nov 08 17:08:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8a98daf3-ac02-4506-84ff-3b808892b7b7 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.906s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:11 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Cannot resize image /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:08:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:08:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Ensure instance console log exists: /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:08:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server [None req-8a98daf3-ac02-4506-84ff-3b808892b7b7 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cb4c2ad4-8e6b-4102-af49-f3a73e1c3ff1)
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cb4c2ad4-8e6b-4102-af49-f3a73e1c3ff1)
Nov 08 17:08:11 user nova-compute[74669]: ERROR oslo_messaging.rpc.server 
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.network.neutron [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Successfully updated port: 48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquired lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.network.neutron [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.compute.manager [req-da39b509-c375-4f8a-ba0a-e2708dcc11f9 req-dc040f81-ee54-4226-a271-1e9fcd7e226f service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Received event network-changed-48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.compute.manager [req-da39b509-c375-4f8a-ba0a-e2708dcc11f9 req-dc040f81-ee54-4226-a271-1e9fcd7e226f service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Refreshing instance network info cache due to event network-changed-48c33fc5-13e1-4b32-b706-55d5f033b4d7. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-da39b509-c375-4f8a-ba0a-e2708dcc11f9 req-dc040f81-ee54-4226-a271-1e9fcd7e226f service nova] Acquiring lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.network.neutron [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.network.neutron [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Updating instance_info_cache with network_info: [{"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c33fc5-13", "ovs_interfaceid": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Releasing lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.compute.manager [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Instance network_info: |[{"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c33fc5-13", "ovs_interfaceid": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-da39b509-c375-4f8a-ba0a-e2708dcc11f9 req-dc040f81-ee54-4226-a271-1e9fcd7e226f service nova] Acquired lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.network.neutron [req-da39b509-c375-4f8a-ba0a-e2708dcc11f9 req-dc040f81-ee54-4226-a271-1e9fcd7e226f service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Refreshing network info cache for port 48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Start _get_guest_xml network_info=[{"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c33fc5-13", "ovs_interfaceid": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:08:12 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:08:12 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:08:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-906635481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-906635481',id=28,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCctGPvKViiOdXyrKx2lAWsKGEcF4bmf760ubgVvLN8IGOdz+Pa7cVVnJvWEDYvDETcr24w3bBjYR4gpcxGKh61GsWSFIwhCTGo213jwflFd1nP4PIE1jH6lMuTDSsl37Q==',key_name='tempest-keypair-1645684870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f1e9778e17a4e0fa1aa1f41d323a88c',ramdisk_id='',reservation_id='r-3gqwmia3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-317302826',owner_user_name='tempest-AttachVolumeShelveTestJSON-317302826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:08:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8bcb0586bce42a3a1a59b2cbc99f846',uuid=bf46a10b-747a-490c-8e22-a76ec65fafdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c33fc5-13", "ovs_interfaceid": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converting VIF {"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c33fc5-13", "ovs_interfaceid": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:64:e8,bridge_name='br-int',has_traffic_filtering=True,id=48c33fc5-13e1-4b32-b706-55d5f033b4d7,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c33fc5-13') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.objects.instance [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lazy-loading 'pci_devices' on Instance uuid bf46a10b-747a-490c-8e22-a76ec65fafdf {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:08:12 user nova-compute[74669]:   <uuid>bf46a10b-747a-490c-8e22-a76ec65fafdf</uuid>
Nov 08 17:08:12 user nova-compute[74669]:   <name>instance-0000001c</name>
Nov 08 17:08:12 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:08:12 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:08:12 user nova-compute[74669]:   <metadata>
Nov 08 17:08:12 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:08:12 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:08:12 user nova-compute[74669]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-906635481</nova:name>
Nov 08 17:08:12 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:08:12</nova:creationTime>
Nov 08 17:08:12 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:08:12 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:08:12 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:08:12 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:08:12 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:08:12 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:08:12 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:08:12 user nova-compute[74669]:       <nova:owner>
Nov 08 17:08:12 user nova-compute[74669]:         <nova:user uuid="d8bcb0586bce42a3a1a59b2cbc99f846">tempest-AttachVolumeShelveTestJSON-317302826-project-member</nova:user>
Nov 08 17:08:12 user nova-compute[74669]:         <nova:project uuid="9f1e9778e17a4e0fa1aa1f41d323a88c">tempest-AttachVolumeShelveTestJSON-317302826</nova:project>
Nov 08 17:08:12 user nova-compute[74669]:       </nova:owner>
Nov 08 17:08:12 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:08:12 user nova-compute[74669]:       <nova:ports>
Nov 08 17:08:12 user nova-compute[74669]:         <nova:port uuid="48c33fc5-13e1-4b32-b706-55d5f033b4d7">
Nov 08 17:08:12 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 17:08:12 user nova-compute[74669]:         </nova:port>
Nov 08 17:08:12 user nova-compute[74669]:       </nova:ports>
Nov 08 17:08:12 user nova-compute[74669]:     </nova:instance>
Nov 08 17:08:12 user nova-compute[74669]:   </metadata>
Nov 08 17:08:12 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:08:12 user nova-compute[74669]:     <system>
Nov 08 17:08:12 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:08:12 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:08:12 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:08:12 user nova-compute[74669]:       <entry name="serial">bf46a10b-747a-490c-8e22-a76ec65fafdf</entry>
Nov 08 17:08:12 user nova-compute[74669]:       <entry name="uuid">bf46a10b-747a-490c-8e22-a76ec65fafdf</entry>
Nov 08 17:08:12 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:08:12 user nova-compute[74669]:     </system>
Nov 08 17:08:12 user nova-compute[74669]:   </sysinfo>
Nov 08 17:08:12 user nova-compute[74669]:   <os>
Nov 08 17:08:12 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:08:12 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:08:12 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:08:12 user nova-compute[74669]:   </os>
Nov 08 17:08:12 user nova-compute[74669]:   <features>
Nov 08 17:08:12 user nova-compute[74669]:     <acpi/>
Nov 08 17:08:12 user nova-compute[74669]:     <apic/>
Nov 08 17:08:12 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:08:12 user nova-compute[74669]:   </features>
Nov 08 17:08:12 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:08:12 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:08:12 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:08:12 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:08:12 user nova-compute[74669]:   </clock>
Nov 08 17:08:12 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:08:12 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:08:12 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:08:12 user nova-compute[74669]:   </cpu>
Nov 08 17:08:12 user nova-compute[74669]:   <devices>
Nov 08 17:08:12 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:08:12 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:08:12 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk"/>
Nov 08 17:08:12 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:08:12 user nova-compute[74669]:     </disk>
Nov 08 17:08:12 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:08:12 user nova-compute[74669]:       <mac address="fa:16:3e:c8:64:e8"/>
Nov 08 17:08:12 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:08:12 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:08:12 user nova-compute[74669]:       <target dev="tap48c33fc5-13"/>
Nov 08 17:08:12 user nova-compute[74669]:     </interface>
Nov 08 17:08:12 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:08:12 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/console.log" append="off"/>
Nov 08 17:08:12 user nova-compute[74669]:     </serial>
Nov 08 17:08:12 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:08:12 user nova-compute[74669]:     <video>
Nov 08 17:08:12 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:08:12 user nova-compute[74669]:     </video>
Nov 08 17:08:12 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:08:12 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:08:12 user nova-compute[74669]:     </rng>
Nov 08 17:08:12 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:08:12 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:08:12 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:08:12 user nova-compute[74669]:     </memballoon>
Nov 08 17:08:12 user nova-compute[74669]:   </devices>
Nov 08 17:08:12 user nova-compute[74669]: </domain>
Nov 08 17:08:12 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:08:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-906635481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-906635481',id=28,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCctGPvKViiOdXyrKx2lAWsKGEcF4bmf760ubgVvLN8IGOdz+Pa7cVVnJvWEDYvDETcr24w3bBjYR4gpcxGKh61GsWSFIwhCTGo213jwflFd1nP4PIE1jH6lMuTDSsl37Q==',key_name='tempest-keypair-1645684870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f1e9778e17a4e0fa1aa1f41d323a88c',ramdisk_id='',reservation_id='r-3gqwmia3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-317302826',owner_user_name='tempest-AttachVolumeShelveTestJSON-317302826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:08:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8bcb0586bce42a3a1a59b2cbc99f846',uuid=bf46a10b-747a-490c-8e22-a76ec65fafdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c33fc5-13", "ovs_interfaceid": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converting VIF {"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c33fc5-13", "ovs_interfaceid": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:64:e8,bridge_name='br-int',has_traffic_filtering=True,id=48c33fc5-13e1-4b32-b706-55d5f033b4d7,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c33fc5-13') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG os_vif [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:64:e8,bridge_name='br-int',has_traffic_filtering=True,id=48c33fc5-13e1-4b32-b706-55d5f033b4d7,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c33fc5-13') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aad751fa-6481-52f2-ac15-d77cd61f3fa0', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48c33fc5-13, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48c33fc5-13, col_values=(('qos', UUID('7837644e-270d-41dc-bb39-dd43b1c566d6')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48c33fc5-13, col_values=(('external_ids', {'iface-id': '48c33fc5-13e1-4b32-b706-55d5f033b4d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:64:e8', 'vm-uuid': 'bf46a10b-747a-490c-8e22-a76ec65fafdf'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:12 user nova-compute[74669]: INFO os_vif [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:64:e8,bridge_name='br-int',has_traffic_filtering=True,id=48c33fc5-13e1-4b32-b706-55d5f033b4d7,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c33fc5-13')
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] No VIF found with MAC fa:16:3e:c8:64:e8, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.network.neutron [req-da39b509-c375-4f8a-ba0a-e2708dcc11f9 req-dc040f81-ee54-4226-a271-1e9fcd7e226f service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Updated VIF entry in instance network info cache for port 48c33fc5-13e1-4b32-b706-55d5f033b4d7. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG nova.network.neutron [req-da39b509-c375-4f8a-ba0a-e2708dcc11f9 req-dc040f81-ee54-4226-a271-1e9fcd7e226f service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Updating instance_info_cache with network_info: [{"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c33fc5-13", "ovs_interfaceid": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:08:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-da39b509-c375-4f8a-ba0a-e2708dcc11f9 req-dc040f81-ee54-4226-a271-1e9fcd7e226f service nova] Releasing lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:08:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:14 user nova-compute[74669]: DEBUG nova.compute.manager [req-89f0223f-6de7-4d5a-9ed2-2cc59f7d3a34 req-39aea7ed-5c9b-4fd9-af06-a21dc85e0e73 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Received event network-vif-plugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:08:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-89f0223f-6de7-4d5a-9ed2-2cc59f7d3a34 req-39aea7ed-5c9b-4fd9-af06-a21dc85e0e73 service nova] Acquiring lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-89f0223f-6de7-4d5a-9ed2-2cc59f7d3a34 req-39aea7ed-5c9b-4fd9-af06-a21dc85e0e73 service nova] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-89f0223f-6de7-4d5a-9ed2-2cc59f7d3a34 req-39aea7ed-5c9b-4fd9-af06-a21dc85e0e73 service nova] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:14 user nova-compute[74669]: DEBUG nova.compute.manager [req-89f0223f-6de7-4d5a-9ed2-2cc59f7d3a34 req-39aea7ed-5c9b-4fd9-af06-a21dc85e0e73 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] No waiting events found dispatching network-vif-plugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:08:14 user nova-compute[74669]: WARNING nova.compute.manager [req-89f0223f-6de7-4d5a-9ed2-2cc59f7d3a34 req-39aea7ed-5c9b-4fd9-af06-a21dc85e0e73 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Received unexpected event network-vif-plugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 for instance with vm_state building and task_state spawning.
Nov 08 17:08:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:16 user nova-compute[74669]: DEBUG nova.compute.manager [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:08:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:08:16 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Instance spawned successfully.
Nov 08 17:08:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:08:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:08:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:08:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:08:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:08:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:08:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:08:16 user nova-compute[74669]: DEBUG nova.compute.manager [req-50c6c25b-4c57-4ec8-b127-478d67eff9e6 req-05ed0738-35b0-4d65-b0b7-866fa0e068d2 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Received event network-vif-plugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:08:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-50c6c25b-4c57-4ec8-b127-478d67eff9e6 req-05ed0738-35b0-4d65-b0b7-866fa0e068d2 service nova] Acquiring lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-50c6c25b-4c57-4ec8-b127-478d67eff9e6 req-05ed0738-35b0-4d65-b0b7-866fa0e068d2 service nova] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-50c6c25b-4c57-4ec8-b127-478d67eff9e6 req-05ed0738-35b0-4d65-b0b7-866fa0e068d2 service nova] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:16 user nova-compute[74669]: DEBUG nova.compute.manager [req-50c6c25b-4c57-4ec8-b127-478d67eff9e6 req-05ed0738-35b0-4d65-b0b7-866fa0e068d2 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] No waiting events found dispatching network-vif-plugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:08:16 user nova-compute[74669]: WARNING nova.compute.manager [req-50c6c25b-4c57-4ec8-b127-478d67eff9e6 req-05ed0738-35b0-4d65-b0b7-866fa0e068d2 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Received unexpected event network-vif-plugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 for instance with vm_state building and task_state spawning.
Nov 08 17:08:16 user nova-compute[74669]: INFO nova.compute.manager [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 08 17:08:16 user nova-compute[74669]: DEBUG nova.compute.manager [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:08:16 user nova-compute[74669]: INFO nova.compute.manager [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Took 5.96 seconds to build instance.
Nov 08 17:08:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-992926fe-a2b2-43a7-b4e6-0af6d0ab9e2f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.060s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:23 user nova-compute[74669]: DEBUG nova.compute.manager [req-bad624a6-d9ad-49e1-a91f-92f5c91725f1 req-4b05bdb2-43c3-457f-a41e-570f85a2be63 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Received event network-changed-a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:08:23 user nova-compute[74669]: DEBUG nova.compute.manager [req-bad624a6-d9ad-49e1-a91f-92f5c91725f1 req-4b05bdb2-43c3-457f-a41e-570f85a2be63 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Refreshing instance network info cache due to event network-changed-a6d42001-e353-4460-9257-a9d4b0027672. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:08:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-bad624a6-d9ad-49e1-a91f-92f5c91725f1 req-4b05bdb2-43c3-457f-a41e-570f85a2be63 service nova] Acquiring lock "refresh_cache-84fac5e1-7ef0-417a-8888-955a7c9f8944" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:08:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-bad624a6-d9ad-49e1-a91f-92f5c91725f1 req-4b05bdb2-43c3-457f-a41e-570f85a2be63 service nova] Acquired lock "refresh_cache-84fac5e1-7ef0-417a-8888-955a7c9f8944" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:08:23 user nova-compute[74669]: DEBUG nova.network.neutron [req-bad624a6-d9ad-49e1-a91f-92f5c91725f1 req-4b05bdb2-43c3-457f-a41e-570f85a2be63 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Refreshing network info cache for port a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "84fac5e1-7ef0-417a-8888-955a7c9f8944" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:24 user nova-compute[74669]: INFO nova.compute.manager [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Terminating instance
Nov 08 17:08:24 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG nova.compute.manager [req-15895d8e-2a16-40e4-a99c-9b91224919c8 req-5edebbe5-d15e-4a52-8ba9-f4d0ce44c21b service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Received event network-vif-unplugged-a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-15895d8e-2a16-40e4-a99c-9b91224919c8 req-5edebbe5-d15e-4a52-8ba9-f4d0ce44c21b service nova] Acquiring lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-15895d8e-2a16-40e4-a99c-9b91224919c8 req-5edebbe5-d15e-4a52-8ba9-f4d0ce44c21b service nova] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-15895d8e-2a16-40e4-a99c-9b91224919c8 req-5edebbe5-d15e-4a52-8ba9-f4d0ce44c21b service nova] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG nova.compute.manager [req-15895d8e-2a16-40e4-a99c-9b91224919c8 req-5edebbe5-d15e-4a52-8ba9-f4d0ce44c21b service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] No waiting events found dispatching network-vif-unplugged-a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG nova.compute.manager [req-15895d8e-2a16-40e4-a99c-9b91224919c8 req-5edebbe5-d15e-4a52-8ba9-f4d0ce44c21b service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Received event network-vif-unplugged-a6d42001-e353-4460-9257-a9d4b0027672 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG nova.network.neutron [req-bad624a6-d9ad-49e1-a91f-92f5c91725f1 req-4b05bdb2-43c3-457f-a41e-570f85a2be63 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Updated VIF entry in instance network info cache for port a6d42001-e353-4460-9257-a9d4b0027672. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG nova.network.neutron [req-bad624a6-d9ad-49e1-a91f-92f5c91725f1 req-4b05bdb2-43c3-457f-a41e-570f85a2be63 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Updating instance_info_cache with network_info: [{"id": "a6d42001-e353-4460-9257-a9d4b0027672", "address": "fa:16:3e:79:4f:aa", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d42001-e3", "ovs_interfaceid": "a6d42001-e353-4460-9257-a9d4b0027672", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-bad624a6-d9ad-49e1-a91f-92f5c91725f1 req-4b05bdb2-43c3-457f-a41e-570f85a2be63 service nova] Releasing lock "refresh_cache-84fac5e1-7ef0-417a-8888-955a7c9f8944" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:24 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Instance destroyed successfully.
Nov 08 17:08:24 user nova-compute[74669]: DEBUG nova.objects.instance [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lazy-loading 'resources' on Instance uuid 84fac5e1-7ef0-417a-8888-955a7c9f8944 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:04:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-661364798',display_name='tempest-TestStampPattern-server-661364798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-661364798',id=26,image_ref='d88ae2e1-abfc-4460-bd86-88fc8ddbc8a2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPDGzyFrH3MdZrG/tSqCKZcN7lhFYTpjgjac9mXXE01cRHOS7+HZPHOYTre5OIE1b16d2AzYSrfjX/N3IGTtTcXx8PnKlOincfS8vgaHln6XlhTSOcFKiwt6piilyaUFg==',key_name='tempest-TestStampPattern-1970291243',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:04:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f704465bf5a44db5aa573ec6546b16c8',ramdisk_id='',reservation_id='r-kvryu3pr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d91eaa51-6bf4-40eb-9f36-f8e838501373',image_min_disk='1',image_min_ram='0',image_owner_id='f704465bf5a44db5aa573ec6546b16c8',image_owner_project_name='tempest-TestStampPattern-440069879',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-440069879-project-member',image_user_id='645f4df51c4240609e10a787918ddf41',owner_project_name='tempest-TestStampPattern-440069879',owner_user_name='tempest-TestStampPattern-440069879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:04:42Z,user_data=None,user_id='645f4df51c4240609e10a787918ddf41',uuid=84fac5e1-7ef0-417a-8888-955a7c9f8944,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6d42001-e353-4460-9257-a9d4b0027672", "address": "fa:16:3e:79:4f:aa", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d42001-e3", "ovs_interfaceid": "a6d42001-e353-4460-9257-a9d4b0027672", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Converting VIF {"id": "a6d42001-e353-4460-9257-a9d4b0027672", "address": "fa:16:3e:79:4f:aa", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d42001-e3", "ovs_interfaceid": "a6d42001-e353-4460-9257-a9d4b0027672", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:4f:aa,bridge_name='br-int',has_traffic_filtering=True,id=a6d42001-e353-4460-9257-a9d4b0027672,network=Network(1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d42001-e3') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG os_vif [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:4f:aa,bridge_name='br-int',has_traffic_filtering=True,id=a6d42001-e353-4460-9257-a9d4b0027672,network=Network(1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d42001-e3') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6d42001-e3, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92147501-8b39-476c-9d6c-5a20e870db47) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:24 user nova-compute[74669]: INFO os_vif [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:4f:aa,bridge_name='br-int',has_traffic_filtering=True,id=a6d42001-e353-4460-9257-a9d4b0027672,network=Network(1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d42001-e3')
Nov 08 17:08:24 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Deleting instance files /opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944_del
Nov 08 17:08:24 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Deletion of /opt/stack/data/nova/instances/84fac5e1-7ef0-417a-8888-955a7c9f8944_del complete
Nov 08 17:08:24 user nova-compute[74669]: INFO nova.compute.manager [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 08 17:08:24 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:08:24 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:08:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:25 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:08:25 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Took 0.83 seconds to deallocate network for instance.
Nov 08 17:08:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:26 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:08:26 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:08:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.278s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:26 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Deleted allocations for instance 84fac5e1-7ef0-417a-8888-955a7c9f8944
Nov 08 17:08:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e9b83558-a1a9-4ef7-b366-1dd278fa7a78 tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.231s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Received event network-vif-plugged-a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:08:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] Acquiring lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] No waiting events found dispatching network-vif-plugged-a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:08:26 user nova-compute[74669]: WARNING nova.compute.manager [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Received unexpected event network-vif-plugged-a6d42001-e353-4460-9257-a9d4b0027672 for instance with vm_state deleted and task_state None.
Nov 08 17:08:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Received event network-vif-plugged-a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:08:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] Acquiring lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] No waiting events found dispatching network-vif-plugged-a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:08:26 user nova-compute[74669]: WARNING nova.compute.manager [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Received unexpected event network-vif-plugged-a6d42001-e353-4460-9257-a9d4b0027672 for instance with vm_state deleted and task_state None.
Nov 08 17:08:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Received event network-vif-plugged-a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:08:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] Acquiring lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] No waiting events found dispatching network-vif-plugged-a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:08:26 user nova-compute[74669]: WARNING nova.compute.manager [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Received unexpected event network-vif-plugged-a6d42001-e353-4460-9257-a9d4b0027672 for instance with vm_state deleted and task_state None.
Nov 08 17:08:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Received event network-vif-plugged-a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:08:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] Acquiring lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] Lock "84fac5e1-7ef0-417a-8888-955a7c9f8944-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] No waiting events found dispatching network-vif-plugged-a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:08:26 user nova-compute[74669]: WARNING nova.compute.manager [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Received unexpected event network-vif-plugged-a6d42001-e353-4460-9257-a9d4b0027672 for instance with vm_state deleted and task_state None.
Nov 08 17:08:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-074a3006-fcd3-4dd8-9f81-631f7145cf67 req-32ab945e-7991-431a-9358-03e6fb21bba4 service nova] [instance: 84fac5e1-7ef0-417a-8888-955a7c9f8944] Received event network-vif-deleted-a6d42001-e353-4460-9257-a9d4b0027672 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:08:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Acquiring lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Acquiring lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:28 user nova-compute[74669]: INFO nova.compute.manager [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Terminating instance
Nov 08 17:08:28 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:08:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-94166def-ca8e-467c-b183-46c82beb9c40 req-3493d75d-bffb-451e-82b6-7523c1d634e2 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Received event network-vif-unplugged-3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:08:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-94166def-ca8e-467c-b183-46c82beb9c40 req-3493d75d-bffb-451e-82b6-7523c1d634e2 service nova] Acquiring lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-94166def-ca8e-467c-b183-46c82beb9c40 req-3493d75d-bffb-451e-82b6-7523c1d634e2 service nova] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-94166def-ca8e-467c-b183-46c82beb9c40 req-3493d75d-bffb-451e-82b6-7523c1d634e2 service nova] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-94166def-ca8e-467c-b183-46c82beb9c40 req-3493d75d-bffb-451e-82b6-7523c1d634e2 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] No waiting events found dispatching network-vif-unplugged-3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:08:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-94166def-ca8e-467c-b183-46c82beb9c40 req-3493d75d-bffb-451e-82b6-7523c1d634e2 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Received event network-vif-unplugged-3021424c-2541-449d-b3f8-ffca35fdb364 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:08:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:29 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Instance destroyed successfully.
Nov 08 17:08:29 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lazy-loading 'resources' on Instance uuid 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T17:03:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-858788957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-638839753',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgUCl1WLcb59V3Q5jCPwB0FEUGaJcnditDCK4NsYCVn5HJLFzTT3spZBJc6w7p9cbfNoX8cf7k8DGPcXuUOV2irdcP0AhcWgDxOJyANKtp67p0tg/YP8TSLWl4B1A/hJw==',key_name='tempest-keypair-1263187494',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:06:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5706466a59c34a878f3eafcebee088d0',ramdisk_id='',reservation_id='r-bl0nidls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-494820798',owner_user_name='tempest-ServerActionsV293TestJSON-494820798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:06:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b443fd16646495790682d8ad338df57',uuid=5575cb2b-b93d-4048-bb96-c4cd7f19ee1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3021424c-2541-449d-b3f8-ffca35fdb364", "address": "fa:16:3e:6f:e9:d8", "network": {"id": "2b28db73-56c6-4cc7-95de-75ec297a7809", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-839594529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5706466a59c34a878f3eafcebee088d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3021424c-25", "ovs_interfaceid": "3021424c-2541-449d-b3f8-ffca35fdb364", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Converting VIF {"id": "3021424c-2541-449d-b3f8-ffca35fdb364", "address": "fa:16:3e:6f:e9:d8", "network": {"id": "2b28db73-56c6-4cc7-95de-75ec297a7809", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-839594529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5706466a59c34a878f3eafcebee088d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3021424c-25", "ovs_interfaceid": "3021424c-2541-449d-b3f8-ffca35fdb364", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:e9:d8,bridge_name='br-int',has_traffic_filtering=True,id=3021424c-2541-449d-b3f8-ffca35fdb364,network=Network(2b28db73-56c6-4cc7-95de-75ec297a7809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3021424c-25') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG os_vif [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:e9:d8,bridge_name='br-int',has_traffic_filtering=True,id=3021424c-2541-449d-b3f8-ffca35fdb364,network=Network(2b28db73-56c6-4cc7-95de-75ec297a7809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3021424c-25') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3021424c-25, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e16b6161-2b20-4a30-8c55-a1a0fb780ce1) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:29 user nova-compute[74669]: INFO os_vif [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:e9:d8,bridge_name='br-int',has_traffic_filtering=True,id=3021424c-2541-449d-b3f8-ffca35fdb364,network=Network(2b28db73-56c6-4cc7-95de-75ec297a7809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3021424c-25')
Nov 08 17:08:29 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOWSyBVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:08:29 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:08:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0806f70e-5681-4f35-afa4-1ede8aa43d62]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:08:29 user nova-compute[74669]: No targets found.
Nov 08 17:08:29 user nova-compute[74669]: iSNS:
Nov 08 17:08:29 user nova-compute[74669]: No targets found.
Nov 08 17:08:29 user nova-compute[74669]: STATIC:
Nov 08 17:08:29 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b
Nov 08 17:08:29 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:08:29 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:08:29 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79
Nov 08 17:08:29 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:08:29 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:08:29 user nova-compute[74669]: FIRMWARE:
Nov 08 17:08:29 user nova-compute[74669]: No targets found.
Nov 08 17:08:29 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:08:29 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:08:29 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d741b4-102f-4988-a2b4-3b5bbddaa14a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee777d5a-2d7c-47af-a828-1ad50876de38]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:08:29 user nova-compute[74669]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:08:29 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:08:29 user nova-compute[74669]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 (non-flash)
Nov 08 17:08:29 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9a86505e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79'): ({'sdc'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Removing single pathed devices sdc {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac73ba49-5411-4fdb-a7ac-04fcf11c6362]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e219cd41-676c-457d-95ba-adeaf217025c]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Flushing IO for device /dev/sdc {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a82462e-f7fe-47c8-a086-951fca72b91a]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ffa1e1-c441-4767-ad1f-397834027bb0]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4f1a39b2', '/dev/disk/by-id/scsi-26534383330633965', '/dev/disk/by-id/scsi-1SCST_BIO4f1a39b2-e4830c9ea1caea55') {{(pid=86107) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c020eaf-0802-4586-8340-020079239274]: (4, None) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8887c3e-0394-44b5-83e0-db059ab6a07a]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc758f14-f4f4-410b-b29b-70ce94a1a4fd]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79, portal: 172.16.0.220,3260]
Nov 08 17:08:29 user nova-compute[74669]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79, portal: 172.16.0.220,3260] successful.
Nov 08 17:08:29 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fd5c1d-4793-43c2-8ebf-f021e25b5a79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edb535f-e937-48c7-8ad9-bb7aa3072ce6]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] <== disconnect_volume: return (320ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:08:29 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Deleting instance files /opt/stack/data/nova/instances/5575cb2b-b93d-4048-bb96-c4cd7f19ee1d_del
Nov 08 17:08:29 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Deletion of /opt/stack/data/nova/instances/5575cb2b-b93d-4048-bb96-c4cd7f19ee1d_del complete
Nov 08 17:08:29 user nova-compute[74669]: INFO nova.compute.manager [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 08 17:08:29 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:08:29 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:08:30 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:08:30 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Took 0.62 seconds to deallocate network for instance.
Nov 08 17:08:30 user nova-compute[74669]: DEBUG nova.compute.manager [req-a3f2aadc-5805-4aba-a682-66c0130d2546 req-88a3548a-2471-4078-9661-424a07ad0863 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Received event network-vif-deleted-3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:08:30 user nova-compute[74669]: INFO nova.compute.manager [req-a3f2aadc-5805-4aba-a682-66c0130d2546 req-88a3548a-2471-4078-9661-424a07ad0863 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Neutron deleted interface 3021424c-2541-449d-b3f8-ffca35fdb364; detaching it from the instance and deleting it from the info cache
Nov 08 17:08:30 user nova-compute[74669]: DEBUG nova.network.neutron [req-a3f2aadc-5805-4aba-a682-66c0130d2546 req-88a3548a-2471-4078-9661-424a07ad0863 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:08:30 user nova-compute[74669]: DEBUG nova.compute.manager [req-a3f2aadc-5805-4aba-a682-66c0130d2546 req-88a3548a-2471-4078-9661-424a07ad0863 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Detach interface failed, port_id=3021424c-2541-449d-b3f8-ffca35fdb364, reason: Instance 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 17:08:30 user nova-compute[74669]: DEBUG nova.objects.instance [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'flavor' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:08:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "refresh_cache-af8b58ff-90d5-4a04-844a-ac0534a7e413" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:08:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquired lock "refresh_cache-af8b58ff-90d5-4a04-844a-ac0534a7e413" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:08:30 user nova-compute[74669]: DEBUG nova.network.neutron [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:08:30 user nova-compute[74669]: DEBUG nova.objects.instance [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'info_cache' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:08:30 user nova-compute[74669]: DEBUG nova.objects.base [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Object Instance<af8b58ff-90d5-4a04-844a-ac0534a7e413> lazy-loaded attributes: flavor,info_cache {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:08:30 user nova-compute[74669]: DEBUG nova.compute.manager [req-95759b33-fbe7-45aa-8ab4-76ede2f06705 req-e7cb56b1-e30f-414c-8185-cacbb81a7c80 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Received event network-vif-plugged-3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:08:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-95759b33-fbe7-45aa-8ab4-76ede2f06705 req-e7cb56b1-e30f-414c-8185-cacbb81a7c80 service nova] Acquiring lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-95759b33-fbe7-45aa-8ab4-76ede2f06705 req-e7cb56b1-e30f-414c-8185-cacbb81a7c80 service nova] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-95759b33-fbe7-45aa-8ab4-76ede2f06705 req-e7cb56b1-e30f-414c-8185-cacbb81a7c80 service nova] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:30 user nova-compute[74669]: DEBUG nova.compute.manager [req-95759b33-fbe7-45aa-8ab4-76ede2f06705 req-e7cb56b1-e30f-414c-8185-cacbb81a7c80 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] No waiting events found dispatching network-vif-plugged-3021424c-2541-449d-b3f8-ffca35fdb364 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:08:30 user nova-compute[74669]: WARNING nova.compute.manager [req-95759b33-fbe7-45aa-8ab4-76ede2f06705 req-e7cb56b1-e30f-414c-8185-cacbb81a7c80 service nova] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Received unexpected event network-vif-plugged-3021424c-2541-449d-b3f8-ffca35fdb364 for instance with vm_state active and task_state deleting.
Nov 08 17:08:30 user nova-compute[74669]: DEBUG nova.network.neutron [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Updating instance_info_cache with network_info: [{"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Releasing lock "refresh_cache-af8b58ff-90d5-4a04-844a-ac0534a7e413" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:08:31 user nova-compute[74669]: INFO nova.compute.manager [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Took 0.91 seconds to detach 1 volumes for instance.
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] [instance: 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d] Deleting volume: 27fd5c1d-4793-43c2-8ebf-f021e25b5a79 {{(pid=74669) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 17:08:31 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Instance destroyed successfully.
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.objects.instance [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'resources' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.objects.base [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Object Instance<af8b58ff-90d5-4a04-844a-ac0534a7e413> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:03:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-546386835',display_name='tempest-AttachVolumeTestJSON-server-546386835',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-546386835',id=25,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXViWU/BdYxMm5+lemyfZcP7+TCdB2OaD+dWs6IPD7DtEkJGE2tx2z335cOHjRlBjCNb0QrrgNRKB9Cr8JI7YWfGi7dauKEckz8JkFarm7hJu+kJ/zQZH4rAL4xDCaMWg==',key_name='tempest-keypair-1427520299',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:03:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5a7febf2b00147cfb989380452aba869',ramdisk_id='',reservation_id='r-l53uvaaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-275457186',owner_user_name='tempest-AttachVolumeTestJSON-275457186-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fd41a7ea7943e6a913c211f6ea2d52',uuid=af8b58ff-90d5-4a04-844a-ac0534a7e413,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converting VIF {"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2d:67,bridge_name='br-int',has_traffic_filtering=True,id=d0dc10aa-3fca-4242-8895-241190da8780,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dc10aa-3f') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_vif [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2d:67,bridge_name='br-int',has_traffic_filtering=True,id=d0dc10aa-3fca-4242-8895-241190da8780,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dc10aa-3f') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0dc10aa-3f, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44b64867-629f-487f-a8bc-99f52c01e306) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:31 user nova-compute[74669]: INFO os_vif [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2d:67,bridge_name='br-int',has_traffic_filtering=True,id=d0dc10aa-3fca-4242-8895-241190da8780,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dc10aa-3f')
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGaVbyCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:08:31 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c0e1f2-b28a-4869-a0e9-281206815bdd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:08:31 user nova-compute[74669]: No targets found.
Nov 08 17:08:31 user nova-compute[74669]: iSNS:
Nov 08 17:08:31 user nova-compute[74669]: No targets found.
Nov 08 17:08:31 user nova-compute[74669]: STATIC:
Nov 08 17:08:31 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b
Nov 08 17:08:31 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:08:31 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:08:31 user nova-compute[74669]: FIRMWARE:
Nov 08 17:08:31 user nova-compute[74669]: No targets found.
Nov 08 17:08:31 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:08:31 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:08:31 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f96b399-57c8-4087-9320-e4afbdb473ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32037aa-4784-45d3-87bd-d87cd91c69bb]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:08:31 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:08:31 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9846bf400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b'): ({'sdb'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Removing single pathed devices sdb {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89f1681-6b89-4807-9fe3-f03367e9a9de]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.032s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aefcebc-8cd4-4ebf-a35e-44b0a153f536]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Flushing IO for device /dev/sdb {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[37686c73-4602-4215-a9d4-687156deca05]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7976dd-60e9-4b3a-8d00-39c362b90522]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[636966e5-57e9-4c10-8d7f-cdc54046e7f5]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[660fb144-dce4-4e39-9cb1-a115430e27bf]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b, portal: 172.16.0.220,3260]
Nov 08 17:08:31 user nova-compute[74669]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b, portal: 172.16.0.220,3260] successful.
Nov 08 17:08:31 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c9aad8-2351-42d2-9d56-2f98ff3c71e9]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] <== disconnect_volume: return (331ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Start _get_guest_xml network_info=[{"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '2e23770b-ccc2-4f2b-a216-c882f90abc9f', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGaVbyCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'af8b58ff-90d5-4a04-844a-ac0534a7e413', 'attached_at': '', 'detached_at': '', 'volume_id': 'a2d3bf54-9d77-4c85-a92a-6192eae32c7b', 'serial': 'a2d3bf54-9d77-4c85-a92a-6192eae32c7b'}, 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.objects.instance [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'numa_topology' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.objects.base [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Object Instance<af8b58ff-90d5-4a04-844a-ac0534a7e413> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:08:31 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:08:31 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.objects.instance [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'vcpu_model' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.objects.base [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Object Instance<af8b58ff-90d5-4a04-844a-ac0534a7e413> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGaVbyCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:08:31 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:08:31 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:08:31 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daa9e72-11fe-4c7f-8858-73285f5f9fff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:08:31 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7eee74-fac8-4ecc-915c-686944ea1a09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b] added
Nov 08 17:08:31 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3924a278-c2f0-48b7-b62d-c7c5577238a1]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ed5484-753f-4fcd-9476-3f27a9b75e98]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MGaVbyCT {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:31 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Deleted allocations for instance 5575cb2b-b93d-4048-bb96-c4cd7f19ee1d
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MGaVbyCT" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e830f0a0-0a73-460d-b056-13149b5aafe9]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MGaVbyCT'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c789165-2ad0-4033-8c38-b2d99ac19145]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee2a8d1-4f29-499b-8cf5-ca39f3f2fca5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 17:08:31 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 17:08:31 user nova-compute[74669]:  {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:08:31 user nova-compute[74669]: WARNING os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 17:08:31 user nova-compute[74669]: 
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d83e767f-7e4c-486e-85b5-4e0af4c2496b tempest-ServerActionsV293TestJSON-494820798 tempest-ServerActionsV293TestJSON-494820798-project-member] Lock "5575cb2b-b93d-4048-bb96-c4cd7f19ee1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.411s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[52846afd-639a-42bd-898b-bf39bcd381b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b, portal: 172.16.0.220,3260]
Nov 08 17:08:31 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b, portal: 172.16.0.220,3260] successful.
Nov 08 17:08:31 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6f9a46-cc60-4a57-b935-fd2da0a1a015]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa2dcc5-843b-4de5-b678-0eb0c390bea4]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:08:31 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:08:31 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01784fe-7872-4ff9-981c-49c4452977e5]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:08:31 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: None {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:08:32 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:08:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGaVbyCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:08:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:08:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23662343762393164', 'path': '/dev/sdb'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:08:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662343762393164', 'path': '/dev/sdb'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:08:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:03:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-546386835',display_name='tempest-AttachVolumeTestJSON-server-546386835',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-546386835',id=25,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXViWU/BdYxMm5+lemyfZcP7+TCdB2OaD+dWs6IPD7DtEkJGE2tx2z335cOHjRlBjCNb0QrrgNRKB9Cr8JI7YWfGi7dauKEckz8JkFarm7hJu+kJ/zQZH4rAL4xDCaMWg==',key_name='tempest-keypair-1427520299',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:03:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5a7febf2b00147cfb989380452aba869',ramdisk_id='',reservation_id='r-l53uvaaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-275457186',owner_user_name='tempest-AttachVolumeTestJSON-275457186-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fd41a7ea7943e6a913c211f6ea2d52',uuid=af8b58ff-90d5-4a04-844a-ac0534a7e413,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:08:32 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converting VIF {"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:08:32 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2d:67,bridge_name='br-int',has_traffic_filtering=True,id=d0dc10aa-3fca-4242-8895-241190da8780,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dc10aa-3f') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:08:32 user nova-compute[74669]: DEBUG nova.objects.instance [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'pci_devices' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:08:32 user nova-compute[74669]: DEBUG nova.objects.base [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Object Instance<af8b58ff-90d5-4a04-844a-ac0534a7e413> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:08:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:08:32 user nova-compute[74669]:   <uuid>af8b58ff-90d5-4a04-844a-ac0534a7e413</uuid>
Nov 08 17:08:32 user nova-compute[74669]:   <name>instance-00000019</name>
Nov 08 17:08:32 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:08:32 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:08:32 user nova-compute[74669]:   <metadata>
Nov 08 17:08:32 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:08:32 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:08:32 user nova-compute[74669]:       <nova:name>tempest-AttachVolumeTestJSON-server-546386835</nova:name>
Nov 08 17:08:32 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:08:31</nova:creationTime>
Nov 08 17:08:32 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:08:32 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:08:32 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:08:32 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:08:32 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:08:32 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:08:32 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:08:32 user nova-compute[74669]:       <nova:owner>
Nov 08 17:08:32 user nova-compute[74669]:         <nova:user uuid="80fd41a7ea7943e6a913c211f6ea2d52">tempest-AttachVolumeTestJSON-275457186-project-member</nova:user>
Nov 08 17:08:32 user nova-compute[74669]:         <nova:project uuid="5a7febf2b00147cfb989380452aba869">tempest-AttachVolumeTestJSON-275457186</nova:project>
Nov 08 17:08:32 user nova-compute[74669]:       </nova:owner>
Nov 08 17:08:32 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:08:32 user nova-compute[74669]:       <nova:ports>
Nov 08 17:08:32 user nova-compute[74669]:         <nova:port uuid="d0dc10aa-3fca-4242-8895-241190da8780">
Nov 08 17:08:32 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 17:08:32 user nova-compute[74669]:         </nova:port>
Nov 08 17:08:32 user nova-compute[74669]:       </nova:ports>
Nov 08 17:08:32 user nova-compute[74669]:     </nova:instance>
Nov 08 17:08:32 user nova-compute[74669]:   </metadata>
Nov 08 17:08:32 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:08:32 user nova-compute[74669]:     <system>
Nov 08 17:08:32 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:08:32 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:08:32 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:08:32 user nova-compute[74669]:       <entry name="serial">af8b58ff-90d5-4a04-844a-ac0534a7e413</entry>
Nov 08 17:08:32 user nova-compute[74669]:       <entry name="uuid">af8b58ff-90d5-4a04-844a-ac0534a7e413</entry>
Nov 08 17:08:32 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:08:32 user nova-compute[74669]:     </system>
Nov 08 17:08:32 user nova-compute[74669]:   </sysinfo>
Nov 08 17:08:32 user nova-compute[74669]:   <os>
Nov 08 17:08:32 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:08:32 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:08:32 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:08:32 user nova-compute[74669]:   </os>
Nov 08 17:08:32 user nova-compute[74669]:   <features>
Nov 08 17:08:32 user nova-compute[74669]:     <acpi/>
Nov 08 17:08:32 user nova-compute[74669]:     <apic/>
Nov 08 17:08:32 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:08:32 user nova-compute[74669]:   </features>
Nov 08 17:08:32 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:08:32 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:08:32 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:08:32 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:08:32 user nova-compute[74669]:   </clock>
Nov 08 17:08:32 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:08:32 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:08:32 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:08:32 user nova-compute[74669]:   </cpu>
Nov 08 17:08:32 user nova-compute[74669]:   <devices>
Nov 08 17:08:32 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:08:32 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:08:32 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk"/>
Nov 08 17:08:32 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:08:32 user nova-compute[74669]:     </disk>
Nov 08 17:08:32 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 17:08:32 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:08:32 user nova-compute[74669]:       <source dev="/dev/sdb"/>
Nov 08 17:08:32 user nova-compute[74669]:       <target dev="vdb" bus="virtio"/>
Nov 08 17:08:32 user nova-compute[74669]:       <serial>a2d3bf54-9d77-4c85-a92a-6192eae32c7b</serial>
Nov 08 17:08:32 user nova-compute[74669]:     </disk>
Nov 08 17:08:32 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:08:32 user nova-compute[74669]:       <mac address="fa:16:3e:4d:2d:67"/>
Nov 08 17:08:32 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:08:32 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:08:32 user nova-compute[74669]:       <target dev="tapd0dc10aa-3f"/>
Nov 08 17:08:32 user nova-compute[74669]:     </interface>
Nov 08 17:08:32 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:08:32 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/console.log" append="off"/>
Nov 08 17:08:32 user nova-compute[74669]:     </serial>
Nov 08 17:08:32 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:08:32 user nova-compute[74669]:     <video>
Nov 08 17:08:32 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:08:32 user nova-compute[74669]:     </video>
Nov 08 17:08:32 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:08:32 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:08:32 user nova-compute[74669]:     </rng>
Nov 08 17:08:32 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:08:32 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:08:32 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:08:32 user nova-compute[74669]:     </memballoon>
Nov 08 17:08:32 user nova-compute[74669]:   </devices>
Nov 08 17:08:32 user nova-compute[74669]: </domain>
Nov 08 17:08:32 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:08:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG nova.objects.instance [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'trusted_certs' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG nova.objects.base [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Object Instance<af8b58ff-90d5-4a04-844a-ac0534a7e413> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.174s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Cannot resize image /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG nova.objects.instance [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'migration_context' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG nova.objects.base [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Object Instance<af8b58ff-90d5-4a04-844a-ac0534a7e413> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:03:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-546386835',display_name='tempest-AttachVolumeTestJSON-server-546386835',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-546386835',id=25,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXViWU/BdYxMm5+lemyfZcP7+TCdB2OaD+dWs6IPD7DtEkJGE2tx2z335cOHjRlBjCNb0QrrgNRKB9Cr8JI7YWfGi7dauKEckz8JkFarm7hJu+kJ/zQZH4rAL4xDCaMWg==',key_name='tempest-keypair-1427520299',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:03:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5a7febf2b00147cfb989380452aba869',ramdisk_id='',reservation_id='r-l53uvaaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-275457186',owner_user_name='tempest-AttachVolumeTestJSON-275457186-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fd41a7ea7943e6a913c211f6ea2d52',uuid=af8b58ff-90d5-4a04-844a-ac0534a7e413,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converting VIF {"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2d:67,bridge_name='br-int',has_traffic_filtering=True,id=d0dc10aa-3fca-4242-8895-241190da8780,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dc10aa-3f') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG os_vif [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2d:67,bridge_name='br-int',has_traffic_filtering=True,id=d0dc10aa-3fca-4242-8895-241190da8780,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dc10aa-3f') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7bec5e43-b5a9-5f52-9259-a92ac9f34e2a', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0dc10aa-3f, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0dc10aa-3f, col_values=(('qos', UUID('39cace03-682a-4abf-a30f-1453a7a6fa02')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0dc10aa-3f, col_values=(('external_ids', {'iface-id': 'd0dc10aa-3fca-4242-8895-241190da8780', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:2d:67', 'vm-uuid': 'af8b58ff-90d5-4a04-844a-ac0534a7e413'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:08:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:33 user nova-compute[74669]: INFO os_vif [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2d:67,bridge_name='br-int',has_traffic_filtering=True,id=d0dc10aa-3fca-4242-8895-241190da8780,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dc10aa-3f')
Nov 08 17:08:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:35 user nova-compute[74669]: DEBUG nova.compute.manager [req-dbe4d952-a0a6-4f0f-a47b-93ddc15b84c3 req-b25880a9-ba43-4b29-b614-1413a9a80715 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received event network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:08:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-dbe4d952-a0a6-4f0f-a47b-93ddc15b84c3 req-b25880a9-ba43-4b29-b614-1413a9a80715 service nova] Acquiring lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-dbe4d952-a0a6-4f0f-a47b-93ddc15b84c3 req-b25880a9-ba43-4b29-b614-1413a9a80715 service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-dbe4d952-a0a6-4f0f-a47b-93ddc15b84c3 req-b25880a9-ba43-4b29-b614-1413a9a80715 service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:35 user nova-compute[74669]: DEBUG nova.compute.manager [req-dbe4d952-a0a6-4f0f-a47b-93ddc15b84c3 req-b25880a9-ba43-4b29-b614-1413a9a80715 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] No waiting events found dispatching network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:08:35 user nova-compute[74669]: WARNING nova.compute.manager [req-dbe4d952-a0a6-4f0f-a47b-93ddc15b84c3 req-b25880a9-ba43-4b29-b614-1413a9a80715 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received unexpected event network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 for instance with vm_state stopped and task_state powering-on.
Nov 08 17:08:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:37 user nova-compute[74669]: DEBUG nova.compute.manager [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:08:37 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Instance rebooted successfully.
Nov 08 17:08:37 user nova-compute[74669]: DEBUG nova.compute.manager [None req-4fae1ae6-cc99-425d-8721-5f08a1ab9cb5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:08:37 user nova-compute[74669]: DEBUG nova.compute.manager [req-7b8bf6c2-3631-4ad5-8dc2-026872545221 req-0b78b20f-d6b8-4708-9ab7-b8535597b8cd service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received event network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:08:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-7b8bf6c2-3631-4ad5-8dc2-026872545221 req-0b78b20f-d6b8-4708-9ab7-b8535597b8cd service nova] Acquiring lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-7b8bf6c2-3631-4ad5-8dc2-026872545221 req-0b78b20f-d6b8-4708-9ab7-b8535597b8cd service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-7b8bf6c2-3631-4ad5-8dc2-026872545221 req-0b78b20f-d6b8-4708-9ab7-b8535597b8cd service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:37 user nova-compute[74669]: DEBUG nova.compute.manager [req-7b8bf6c2-3631-4ad5-8dc2-026872545221 req-0b78b20f-d6b8-4708-9ab7-b8535597b8cd service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] No waiting events found dispatching network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:08:37 user nova-compute[74669]: WARNING nova.compute.manager [req-7b8bf6c2-3631-4ad5-8dc2-026872545221 req-0b78b20f-d6b8-4708-9ab7-b8535597b8cd service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received unexpected event network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 for instance with vm_state active and task_state None.
Nov 08 17:08:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Acquiring lock "b68038d5-a01a-49a2-bd73-80cec03e68f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Acquiring lock "b68038d5-a01a-49a2-bd73-80cec03e68f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:39 user nova-compute[74669]: INFO nova.compute.manager [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Terminating instance
Nov 08 17:08:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:08:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-3a331baf-ff4d-4446-8498-5c3514dcf5a0 req-61a62188-6416-443c-b995-25c49ce87185 service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Received event network-vif-unplugged-aa24248f-00c5-4dd2-b439-b1d63068d37f {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:08:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3a331baf-ff4d-4446-8498-5c3514dcf5a0 req-61a62188-6416-443c-b995-25c49ce87185 service nova] Acquiring lock "b68038d5-a01a-49a2-bd73-80cec03e68f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3a331baf-ff4d-4446-8498-5c3514dcf5a0 req-61a62188-6416-443c-b995-25c49ce87185 service nova] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3a331baf-ff4d-4446-8498-5c3514dcf5a0 req-61a62188-6416-443c-b995-25c49ce87185 service nova] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-3a331baf-ff4d-4446-8498-5c3514dcf5a0 req-61a62188-6416-443c-b995-25c49ce87185 service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] No waiting events found dispatching network-vif-unplugged-aa24248f-00c5-4dd2-b439-b1d63068d37f {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:08:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-3a331baf-ff4d-4446-8498-5c3514dcf5a0 req-61a62188-6416-443c-b995-25c49ce87185 service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Received event network-vif-unplugged-aa24248f-00c5-4dd2-b439-b1d63068d37f for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:08:40 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Instance destroyed successfully.
Nov 08 17:08:40 user nova-compute[74669]: DEBUG nova.objects.instance [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lazy-loading 'resources' on Instance uuid b68038d5-a01a-49a2-bd73-80cec03e68f9 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:08:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-819829494',display_name='tempest-TestVolumeSwap-server-819829494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-819829494',id=23,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOp+1Xxtd2umxV0btTGf/ErEe0g7D9x/a0isLC3fe0FGF5/TfATkP8vuqZOhsmylgLt8hudXcIDjk9reZZMKNfH71JzktHC/oQkDcqxQD980+M3FToSlLBzh5quuKllT9A==',key_name='tempest-keypair-2144222695',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:02:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da115791fd6d49ae84005c6f47dc1e6f',ramdisk_id='',reservation_id='r-wrtbgyyo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-96286036',owner_user_name='tempest-TestVolumeSwap-96286036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:02:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb1e2a8affb74c439d6e9b077d0e9fe4',uuid=b68038d5-a01a-49a2-bd73-80cec03e68f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "address": "fa:16:3e:ef:37:d8", "network": {"id": "5e97ae50-3f68-4098-a5c8-f17afb8a7366", "bridge": "br-int", "label": "tempest-TestVolumeSwap-200033215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da115791fd6d49ae84005c6f47dc1e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa24248f-00", "ovs_interfaceid": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:08:40 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Converting VIF {"id": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "address": "fa:16:3e:ef:37:d8", "network": {"id": "5e97ae50-3f68-4098-a5c8-f17afb8a7366", "bridge": "br-int", "label": "tempest-TestVolumeSwap-200033215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da115791fd6d49ae84005c6f47dc1e6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa24248f-00", "ovs_interfaceid": "aa24248f-00c5-4dd2-b439-b1d63068d37f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:08:40 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:37:d8,bridge_name='br-int',has_traffic_filtering=True,id=aa24248f-00c5-4dd2-b439-b1d63068d37f,network=Network(5e97ae50-3f68-4098-a5c8-f17afb8a7366),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa24248f-00') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:08:40 user nova-compute[74669]: DEBUG os_vif [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:37:d8,bridge_name='br-int',has_traffic_filtering=True,id=aa24248f-00c5-4dd2-b439-b1d63068d37f,network=Network(5e97ae50-3f68-4098-a5c8-f17afb8a7366),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa24248f-00') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:08:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa24248f-00, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:08:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:08:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9716f606-8053-4624-9247-06f2ecaceff8) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:08:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:08:40 user nova-compute[74669]: INFO os_vif [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:37:d8,bridge_name='br-int',has_traffic_filtering=True,id=aa24248f-00c5-4dd2-b439-b1d63068d37f,network=Network(5e97ae50-3f68-4098-a5c8-f17afb8a7366),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa24248f-00')
Nov 08 17:08:40 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Deleting instance files /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9_del
Nov 08 17:08:40 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Deletion of /opt/stack/data/nova/instances/b68038d5-a01a-49a2-bd73-80cec03e68f9_del complete
Nov 08 17:08:40 user nova-compute[74669]: INFO nova.compute.manager [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 08 17:08:40 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:08:40 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:08:40 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:08:41 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:08:41 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Took 0.90 seconds to deallocate network for instance.
Nov 08 17:08:41 user nova-compute[74669]: DEBUG nova.compute.manager [req-bac27dbd-19f2-4a43-b2d3-4e2010586080 req-8771e48f-6028-4a7e-a663-98b6c8f76327 service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Received event network-vif-deleted-aa24248f-00c5-4dd2-b439-b1d63068d37f {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:08:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:41 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:08:41 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:08:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:41 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Deleted allocations for instance b68038d5-a01a-49a2-bd73-80cec03e68f9
Nov 08 17:08:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0fd46675-f47c-4675-826a-e5231587b305 tempest-TestVolumeSwap-96286036 tempest-TestVolumeSwap-96286036-project-member] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.363s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-6806957d-2e2f-4229-baa2-5d6cc53e783b req-d998f77c-e815-40d8-a0eb-54af0a72c94f service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Received event network-vif-plugged-aa24248f-00c5-4dd2-b439-b1d63068d37f {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:08:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6806957d-2e2f-4229-baa2-5d6cc53e783b req-d998f77c-e815-40d8-a0eb-54af0a72c94f service nova] Acquiring lock "b68038d5-a01a-49a2-bd73-80cec03e68f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6806957d-2e2f-4229-baa2-5d6cc53e783b req-d998f77c-e815-40d8-a0eb-54af0a72c94f service nova] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6806957d-2e2f-4229-baa2-5d6cc53e783b req-d998f77c-e815-40d8-a0eb-54af0a72c94f service nova] Lock "b68038d5-a01a-49a2-bd73-80cec03e68f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-6806957d-2e2f-4229-baa2-5d6cc53e783b req-d998f77c-e815-40d8-a0eb-54af0a72c94f service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] No waiting events found dispatching network-vif-plugged-aa24248f-00c5-4dd2-b439-b1d63068d37f {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:08:42 user nova-compute[74669]: WARNING nova.compute.manager [req-6806957d-2e2f-4229-baa2-5d6cc53e783b req-d998f77c-e815-40d8-a0eb-54af0a72c94f service nova] [instance: b68038d5-a01a-49a2-bd73-80cec03e68f9] Received unexpected event network-vif-plugged-aa24248f-00c5-4dd2-b439-b1d63068d37f for instance with vm_state deleted and task_state None.
Nov 08 17:08:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:42 user nova-compute[74669]: INFO nova.compute.manager [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Terminating instance
Nov 08 17:08:42 user nova-compute[74669]: DEBUG nova.compute.manager [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:08:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:43 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Instance destroyed successfully.
Nov 08 17:08:43 user nova-compute[74669]: DEBUG nova.objects.instance [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lazy-loading 'resources' on Instance uuid e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:50:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-806433756',display_name='tempest-ServerRescueNegativeTestJSON-server-806433756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-806433756',id=3,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:55:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='632d3acc026b4a869be4899a0ed2e2e2',ramdisk_id='',reservation_id='r-zvbxh990',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1743978403',owner_user_name='tempest-ServerRescueNegativeTestJSON-1743978403-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:57:36Z,user_data=None,user_id='4836f11b0e8346a2a7e835a6012f53fb',uuid=e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "address": "fa:16:3e:8f:9e:16", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b48f6d-e0", "ovs_interfaceid": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converting VIF {"id": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "address": "fa:16:3e:8f:9e:16", "network": {"id": "793a6df1-207d-4042-8f9b-175670d1c860", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-467718214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "632d3acc026b4a869be4899a0ed2e2e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44b48f6d-e0", "ovs_interfaceid": "44b48f6d-e0fe-4178-badd-f5f57cd1cd6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=44b48f6d-e0fe-4178-badd-f5f57cd1cd6e,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44b48f6d-e0') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG os_vif [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=44b48f6d-e0fe-4178-badd-f5f57cd1cd6e,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44b48f6d-e0') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44b48f6d-e0, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=914dc754-e171-4b21-90a1-d99fd0f5c421) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:43 user nova-compute[74669]: INFO os_vif [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:9e:16,bridge_name='br-int',has_traffic_filtering=True,id=44b48f6d-e0fe-4178-badd-f5f57cd1cd6e,network=Network(793a6df1-207d-4042-8f9b-175670d1c860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44b48f6d-e0')
Nov 08 17:08:43 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Deleting instance files /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a_del
Nov 08 17:08:43 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Deletion of /opt/stack/data/nova/instances/e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a_del complete
Nov 08 17:08:43 user nova-compute[74669]: INFO nova.compute.manager [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 08 17:08:43 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG nova.compute.manager [req-bfdbb466-88d2-4b03-9f28-c3ba12b64f64 req-9b5394db-0239-4617-bc63-58cbab17ee3d service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received event network-vif-unplugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-bfdbb466-88d2-4b03-9f28-c3ba12b64f64 req-9b5394db-0239-4617-bc63-58cbab17ee3d service nova] Acquiring lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-bfdbb466-88d2-4b03-9f28-c3ba12b64f64 req-9b5394db-0239-4617-bc63-58cbab17ee3d service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-bfdbb466-88d2-4b03-9f28-c3ba12b64f64 req-9b5394db-0239-4617-bc63-58cbab17ee3d service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG nova.compute.manager [req-bfdbb466-88d2-4b03-9f28-c3ba12b64f64 req-9b5394db-0239-4617-bc63-58cbab17ee3d service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] No waiting events found dispatching network-vif-unplugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG nova.compute.manager [req-bfdbb466-88d2-4b03-9f28-c3ba12b64f64 req-9b5394db-0239-4617-bc63-58cbab17ee3d service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received event network-vif-unplugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG nova.compute.manager [req-bfdbb466-88d2-4b03-9f28-c3ba12b64f64 req-9b5394db-0239-4617-bc63-58cbab17ee3d service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received event network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-bfdbb466-88d2-4b03-9f28-c3ba12b64f64 req-9b5394db-0239-4617-bc63-58cbab17ee3d service nova] Acquiring lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-bfdbb466-88d2-4b03-9f28-c3ba12b64f64 req-9b5394db-0239-4617-bc63-58cbab17ee3d service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-bfdbb466-88d2-4b03-9f28-c3ba12b64f64 req-9b5394db-0239-4617-bc63-58cbab17ee3d service nova] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG nova.compute.manager [req-bfdbb466-88d2-4b03-9f28-c3ba12b64f64 req-9b5394db-0239-4617-bc63-58cbab17ee3d service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] No waiting events found dispatching network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:08:43 user nova-compute[74669]: WARNING nova.compute.manager [req-bfdbb466-88d2-4b03-9f28-c3ba12b64f64 req-9b5394db-0239-4617-bc63-58cbab17ee3d service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received unexpected event network-vif-plugged-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e for instance with vm_state active and task_state deleting.
Nov 08 17:08:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:08:43 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Took 0.46 seconds to deallocate network for instance.
Nov 08 17:08:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:44 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:08:44 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:08:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:44 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Deleted allocations for instance e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a
Nov 08 17:08:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8b7781bf-b96e-4d0b-9a14-45f3025bbec2 tempest-ServerRescueNegativeTestJSON-1743978403 tempest-ServerRescueNegativeTestJSON-1743978403-project-member] Lock "e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.632s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:45 user nova-compute[74669]: DEBUG nova.compute.manager [req-9f712362-080f-4c86-a911-3abf187a0962 req-b4011f28-1846-4538-a30a-89040eed7f87 service nova] [instance: e9f61b63-6f6f-4d3d-8a13-1196cefe1d8a] Received event network-vif-deleted-44b48f6d-e0fe-4178-badd-f5f57cd1cd6e {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:08:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:08:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:54 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:08:54 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:08:55 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:08:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:55 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:08:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:08:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:56 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:08:57 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:08:58 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:08:58 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:08:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8156MB free_disk=25.307952880859375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:08:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:08:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:08:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7b335462-0d93-4899-a223-5c2e36932578 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:08:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance d91eaa51-6bf4-40eb-9f36-f8e838501373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:08:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance af8b58ff-90d5-4a04-844a-ac0534a7e413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:08:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance dff7cbf2-497a-4a27-a0b1-2e97f1391090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:08:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance bf46a10b-747a-490c-8e22-a76ec65fafdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:08:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:08:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:08:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:08:58 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:08:58 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:08:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:08:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:08:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:00 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:09:00 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:09:00 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:09:00 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 17:09:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:09:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:09:00 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:09:00 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lazy-loading 'info_cache' on Instance uuid 7b335462-0d93-4899-a223-5c2e36932578 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:09:00 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Updating instance_info_cache with network_info: [{"id": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "address": "fa:16:3e:e6:99:99", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bfc353f-1f", "ovs_interfaceid": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:09:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:09:00 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:09:00 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:09:00 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:09:00 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:09:02 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:09:02 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:09:02 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:09:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:37 user nova-compute[74669]: DEBUG nova.compute.manager [req-e032dad9-5bea-47af-9201-73af1b64e05d req-287bed3f-0fbb-4049-b936-ef0ddee80928 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Received event network-changed-cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:09:37 user nova-compute[74669]: DEBUG nova.compute.manager [req-e032dad9-5bea-47af-9201-73af1b64e05d req-287bed3f-0fbb-4049-b936-ef0ddee80928 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Refreshing instance network info cache due to event network-changed-cd57159a-b86e-4130-ad82-ddaa0fb63501. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:09:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e032dad9-5bea-47af-9201-73af1b64e05d req-287bed3f-0fbb-4049-b936-ef0ddee80928 service nova] Acquiring lock "refresh_cache-d91eaa51-6bf4-40eb-9f36-f8e838501373" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:09:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e032dad9-5bea-47af-9201-73af1b64e05d req-287bed3f-0fbb-4049-b936-ef0ddee80928 service nova] Acquired lock "refresh_cache-d91eaa51-6bf4-40eb-9f36-f8e838501373" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:09:37 user nova-compute[74669]: DEBUG nova.network.neutron [req-e032dad9-5bea-47af-9201-73af1b64e05d req-287bed3f-0fbb-4049-b936-ef0ddee80928 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Refreshing network info cache for port cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:09:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "d91eaa51-6bf4-40eb-9f36-f8e838501373" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:09:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:09:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:09:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:09:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:09:37 user nova-compute[74669]: INFO nova.compute.manager [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Terminating instance
Nov 08 17:09:37 user nova-compute[74669]: DEBUG nova.compute.manager [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG nova.compute.manager [req-72823ea0-0913-4c81-9eb6-c5f17ff75cd8 req-56e2b0f0-46df-497a-b0b0-fb7618bc21a3 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Received event network-vif-unplugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-72823ea0-0913-4c81-9eb6-c5f17ff75cd8 req-56e2b0f0-46df-497a-b0b0-fb7618bc21a3 service nova] Acquiring lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-72823ea0-0913-4c81-9eb6-c5f17ff75cd8 req-56e2b0f0-46df-497a-b0b0-fb7618bc21a3 service nova] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-72823ea0-0913-4c81-9eb6-c5f17ff75cd8 req-56e2b0f0-46df-497a-b0b0-fb7618bc21a3 service nova] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG nova.compute.manager [req-72823ea0-0913-4c81-9eb6-c5f17ff75cd8 req-56e2b0f0-46df-497a-b0b0-fb7618bc21a3 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] No waiting events found dispatching network-vif-unplugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG nova.compute.manager [req-72823ea0-0913-4c81-9eb6-c5f17ff75cd8 req-56e2b0f0-46df-497a-b0b0-fb7618bc21a3 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Received event network-vif-unplugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG nova.network.neutron [req-e032dad9-5bea-47af-9201-73af1b64e05d req-287bed3f-0fbb-4049-b936-ef0ddee80928 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Updated VIF entry in instance network info cache for port cd57159a-b86e-4130-ad82-ddaa0fb63501. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG nova.network.neutron [req-e032dad9-5bea-47af-9201-73af1b64e05d req-287bed3f-0fbb-4049-b936-ef0ddee80928 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Updating instance_info_cache with network_info: [{"id": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "address": "fa:16:3e:96:ba:06", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd57159a-b8", "ovs_interfaceid": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e032dad9-5bea-47af-9201-73af1b64e05d req-287bed3f-0fbb-4049-b936-ef0ddee80928 service nova] Releasing lock "refresh_cache-d91eaa51-6bf4-40eb-9f36-f8e838501373" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:38 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Instance destroyed successfully.
Nov 08 17:09:38 user nova-compute[74669]: DEBUG nova.objects.instance [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lazy-loading 'resources' on Instance uuid d91eaa51-6bf4-40eb-9f36-f8e838501373 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:00:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-793229153',display_name='tempest-TestStampPattern-server-793229153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-793229153',id=21,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPDGzyFrH3MdZrG/tSqCKZcN7lhFYTpjgjac9mXXE01cRHOS7+HZPHOYTre5OIE1b16d2AzYSrfjX/N3IGTtTcXx8PnKlOincfS8vgaHln6XlhTSOcFKiwt6piilyaUFg==',key_name='tempest-TestStampPattern-1970291243',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:00:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f704465bf5a44db5aa573ec6546b16c8',ramdisk_id='',reservation_id='r-1hqbz4tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-440069879',owner_user_name='tempest-TestStampPattern-440069879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:04:32Z,user_data=None,user_id='645f4df51c4240609e10a787918ddf41',uuid=d91eaa51-6bf4-40eb-9f36-f8e838501373,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "address": "fa:16:3e:96:ba:06", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd57159a-b8", "ovs_interfaceid": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Converting VIF {"id": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "address": "fa:16:3e:96:ba:06", "network": {"id": "1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e", "bridge": "br-int", "label": "tempest-TestStampPattern-434677184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f704465bf5a44db5aa573ec6546b16c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd57159a-b8", "ovs_interfaceid": "cd57159a-b86e-4130-ad82-ddaa0fb63501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:ba:06,bridge_name='br-int',has_traffic_filtering=True,id=cd57159a-b86e-4130-ad82-ddaa0fb63501,network=Network(1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd57159a-b8') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG os_vif [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:ba:06,bridge_name='br-int',has_traffic_filtering=True,id=cd57159a-b86e-4130-ad82-ddaa0fb63501,network=Network(1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd57159a-b8') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd57159a-b8, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41a191a5-abe5-4313-afbe-215f59cbfa96) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:09:38 user nova-compute[74669]: INFO os_vif [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:ba:06,bridge_name='br-int',has_traffic_filtering=True,id=cd57159a-b86e-4130-ad82-ddaa0fb63501,network=Network(1e3ec3a2-85fa-49a6-9a70-ec0fcc88175e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd57159a-b8')
Nov 08 17:09:38 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Deleting instance files /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373_del
Nov 08 17:09:38 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Deletion of /opt/stack/data/nova/instances/d91eaa51-6bf4-40eb-9f36-f8e838501373_del complete
Nov 08 17:09:38 user nova-compute[74669]: INFO nova.compute.manager [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 08 17:09:38 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:09:38 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:09:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:39 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:09:39 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Took 0.74 seconds to deallocate network for instance.
Nov 08 17:09:39 user nova-compute[74669]: DEBUG nova.compute.manager [req-f17b0c86-be15-4242-b0b0-2edff0f6eb42 req-9830570e-7d24-4a11-a130-1ebf821791fb service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Received event network-vif-deleted-cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:09:39 user nova-compute[74669]: INFO nova.compute.manager [req-f17b0c86-be15-4242-b0b0-2edff0f6eb42 req-9830570e-7d24-4a11-a130-1ebf821791fb service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Neutron deleted interface cd57159a-b86e-4130-ad82-ddaa0fb63501; detaching it from the instance and deleting it from the info cache
Nov 08 17:09:39 user nova-compute[74669]: DEBUG nova.network.neutron [req-f17b0c86-be15-4242-b0b0-2edff0f6eb42 req-9830570e-7d24-4a11-a130-1ebf821791fb service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:09:39 user nova-compute[74669]: DEBUG nova.compute.manager [req-f17b0c86-be15-4242-b0b0-2edff0f6eb42 req-9830570e-7d24-4a11-a130-1ebf821791fb service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Detach interface failed, port_id=cd57159a-b86e-4130-ad82-ddaa0fb63501, reason: Instance d91eaa51-6bf4-40eb-9f36-f8e838501373 could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 17:09:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:09:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:09:39 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:09:39 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:09:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:09:40 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Deleted allocations for instance d91eaa51-6bf4-40eb-9f36-f8e838501373
Nov 08 17:09:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-28b31ff5-526a-40d2-9b7d-4287615154ad tempest-TestStampPattern-440069879 tempest-TestStampPattern-440069879-project-member] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.176s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:09:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Received event network-vif-plugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:09:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] Acquiring lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:09:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:09:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:09:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] No waiting events found dispatching network-vif-plugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:09:40 user nova-compute[74669]: WARNING nova.compute.manager [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Received unexpected event network-vif-plugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 for instance with vm_state deleted and task_state None.
Nov 08 17:09:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Received event network-vif-plugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:09:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] Acquiring lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:09:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:09:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:09:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] No waiting events found dispatching network-vif-plugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:09:40 user nova-compute[74669]: WARNING nova.compute.manager [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Received unexpected event network-vif-plugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 for instance with vm_state deleted and task_state None.
Nov 08 17:09:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Received event network-vif-plugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:09:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] Acquiring lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:09:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:09:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:09:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] No waiting events found dispatching network-vif-plugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:09:40 user nova-compute[74669]: WARNING nova.compute.manager [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Received unexpected event network-vif-plugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 for instance with vm_state deleted and task_state None.
Nov 08 17:09:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Received event network-vif-unplugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:09:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] Acquiring lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:09:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:09:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:09:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] No waiting events found dispatching network-vif-unplugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:09:40 user nova-compute[74669]: WARNING nova.compute.manager [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Received unexpected event network-vif-unplugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 for instance with vm_state deleted and task_state None.
Nov 08 17:09:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Received event network-vif-plugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:09:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] Acquiring lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:09:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:09:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] Lock "d91eaa51-6bf4-40eb-9f36-f8e838501373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:09:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] No waiting events found dispatching network-vif-plugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:09:40 user nova-compute[74669]: WARNING nova.compute.manager [req-40ccf436-ff20-4534-9349-214911e7ba9d req-78274d35-b7f9-49bd-b4c9-dc0cb6ab4801 service nova] [instance: d91eaa51-6bf4-40eb-9f36-f8e838501373] Received unexpected event network-vif-plugged-cd57159a-b86e-4130-ad82-ddaa0fb63501 for instance with vm_state deleted and task_state None.
Nov 08 17:09:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Acquiring lock "2158a7c2-2f46-4bce-8558-4347a48623d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:09:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "2158a7c2-2f46-4bce-8558-4347a48623d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:09:45 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:09:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:09:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:09:46 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:09:46 user nova-compute[74669]: INFO nova.compute.claims [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Claim successful on node user
Nov 08 17:09:46 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:09:46 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:09:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:09:46 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:09:46 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:09:46 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:09:46 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:09:46 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:09:46 user nova-compute[74669]: DEBUG nova.policy [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3b60e9d47ab49f8bd3614621e2bd890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1a781163a345dc8be717e3e7c73788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:09:46 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:09:46 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:09:46 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Creating image(s)
Nov 08 17:09:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Acquiring lock "/opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:09:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "/opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:09:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "/opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:09:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:09:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.170s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:09:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:09:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:09:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:09:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.173s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:09:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:09:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk 1073741824" returned: 0 in 0.058s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:09:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:09:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:09:47 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Successfully created port: ea40d3d9-25df-410d-b2ff-46a980702022 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:09:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.190s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:09:47 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:09:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:09:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:09:47 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Cannot resize image /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:09:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:09:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Ensure instance console log exists: /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:09:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:09:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:09:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:09:47 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Successfully updated port: ea40d3d9-25df-410d-b2ff-46a980702022 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:09:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Acquiring lock "refresh_cache-2158a7c2-2f46-4bce-8558-4347a48623d5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:09:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Acquired lock "refresh_cache-2158a7c2-2f46-4bce-8558-4347a48623d5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:09:47 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:09:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-945c2e1d-35a1-41c0-b600-1def9ace1a2e req-3d2a4e3b-6d09-486b-8cdc-816af9613909 service nova] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Received event network-changed-ea40d3d9-25df-410d-b2ff-46a980702022 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:09:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-945c2e1d-35a1-41c0-b600-1def9ace1a2e req-3d2a4e3b-6d09-486b-8cdc-816af9613909 service nova] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Refreshing instance network info cache due to event network-changed-ea40d3d9-25df-410d-b2ff-46a980702022. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:09:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-945c2e1d-35a1-41c0-b600-1def9ace1a2e req-3d2a4e3b-6d09-486b-8cdc-816af9613909 service nova] Acquiring lock "refresh_cache-2158a7c2-2f46-4bce-8558-4347a48623d5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Updating instance_info_cache with network_info: [{"id": "ea40d3d9-25df-410d-b2ff-46a980702022", "address": "fa:16:3e:76:cd:a9", "network": {"id": "52bf51f6-cf7e-403b-b601-0660b9c8544f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-17276515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1a781163a345dc8be717e3e7c73788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea40d3d9-25", "ovs_interfaceid": "ea40d3d9-25df-410d-b2ff-46a980702022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Releasing lock "refresh_cache-2158a7c2-2f46-4bce-8558-4347a48623d5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Instance network_info: |[{"id": "ea40d3d9-25df-410d-b2ff-46a980702022", "address": "fa:16:3e:76:cd:a9", "network": {"id": "52bf51f6-cf7e-403b-b601-0660b9c8544f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-17276515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1a781163a345dc8be717e3e7c73788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea40d3d9-25", "ovs_interfaceid": "ea40d3d9-25df-410d-b2ff-46a980702022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-945c2e1d-35a1-41c0-b600-1def9ace1a2e req-3d2a4e3b-6d09-486b-8cdc-816af9613909 service nova] Acquired lock "refresh_cache-2158a7c2-2f46-4bce-8558-4347a48623d5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.network.neutron [req-945c2e1d-35a1-41c0-b600-1def9ace1a2e req-3d2a4e3b-6d09-486b-8cdc-816af9613909 service nova] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Refreshing network info cache for port ea40d3d9-25df-410d-b2ff-46a980702022 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Start _get_guest_xml network_info=[{"id": "ea40d3d9-25df-410d-b2ff-46a980702022", "address": "fa:16:3e:76:cd:a9", "network": {"id": "52bf51f6-cf7e-403b-b601-0660b9c8544f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-17276515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1a781163a345dc8be717e3e7c73788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea40d3d9-25", "ovs_interfaceid": "ea40d3d9-25df-410d-b2ff-46a980702022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:09:48 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:09:48 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:09:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-614850635',display_name='tempest-ServersNegativeTestJSON-server-614850635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-614850635',id=29,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae1a781163a345dc8be717e3e7c73788',ramdisk_id='',reservation_id='r-i1y84hf5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1017043905',owner_user_name='tempest-ServersNegativeTestJSON-1017043905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:09:47Z,user_data=None,user_id='a3b60e9d47ab49f8bd3614621e2bd890',uuid=2158a7c2-2f46-4bce-8558-4347a48623d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea40d3d9-25df-410d-b2ff-46a980702022", "address": "fa:16:3e:76:cd:a9", "network": {"id": "52bf51f6-cf7e-403b-b601-0660b9c8544f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-17276515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1a781163a345dc8be717e3e7c73788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea40d3d9-25", "ovs_interfaceid": "ea40d3d9-25df-410d-b2ff-46a980702022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Converting VIF {"id": "ea40d3d9-25df-410d-b2ff-46a980702022", "address": "fa:16:3e:76:cd:a9", "network": {"id": "52bf51f6-cf7e-403b-b601-0660b9c8544f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-17276515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1a781163a345dc8be717e3e7c73788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea40d3d9-25", "ovs_interfaceid": "ea40d3d9-25df-410d-b2ff-46a980702022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:cd:a9,bridge_name='br-int',has_traffic_filtering=True,id=ea40d3d9-25df-410d-b2ff-46a980702022,network=Network(52bf51f6-cf7e-403b-b601-0660b9c8544f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea40d3d9-25') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.objects.instance [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lazy-loading 'pci_devices' on Instance uuid 2158a7c2-2f46-4bce-8558-4347a48623d5 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:09:48 user nova-compute[74669]:   <uuid>2158a7c2-2f46-4bce-8558-4347a48623d5</uuid>
Nov 08 17:09:48 user nova-compute[74669]:   <name>instance-0000001d</name>
Nov 08 17:09:48 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:09:48 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:09:48 user nova-compute[74669]:   <metadata>
Nov 08 17:09:48 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:09:48 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:09:48 user nova-compute[74669]:       <nova:name>tempest-ServersNegativeTestJSON-server-614850635</nova:name>
Nov 08 17:09:48 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:09:48</nova:creationTime>
Nov 08 17:09:48 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:09:48 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:09:48 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:09:48 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:09:48 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:09:48 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:09:48 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:09:48 user nova-compute[74669]:       <nova:owner>
Nov 08 17:09:48 user nova-compute[74669]:         <nova:user uuid="a3b60e9d47ab49f8bd3614621e2bd890">tempest-ServersNegativeTestJSON-1017043905-project-member</nova:user>
Nov 08 17:09:48 user nova-compute[74669]:         <nova:project uuid="ae1a781163a345dc8be717e3e7c73788">tempest-ServersNegativeTestJSON-1017043905</nova:project>
Nov 08 17:09:48 user nova-compute[74669]:       </nova:owner>
Nov 08 17:09:48 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:09:48 user nova-compute[74669]:       <nova:ports>
Nov 08 17:09:48 user nova-compute[74669]:         <nova:port uuid="ea40d3d9-25df-410d-b2ff-46a980702022">
Nov 08 17:09:48 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 17:09:48 user nova-compute[74669]:         </nova:port>
Nov 08 17:09:48 user nova-compute[74669]:       </nova:ports>
Nov 08 17:09:48 user nova-compute[74669]:     </nova:instance>
Nov 08 17:09:48 user nova-compute[74669]:   </metadata>
Nov 08 17:09:48 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:09:48 user nova-compute[74669]:     <system>
Nov 08 17:09:48 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:09:48 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:09:48 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:09:48 user nova-compute[74669]:       <entry name="serial">2158a7c2-2f46-4bce-8558-4347a48623d5</entry>
Nov 08 17:09:48 user nova-compute[74669]:       <entry name="uuid">2158a7c2-2f46-4bce-8558-4347a48623d5</entry>
Nov 08 17:09:48 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:09:48 user nova-compute[74669]:     </system>
Nov 08 17:09:48 user nova-compute[74669]:   </sysinfo>
Nov 08 17:09:48 user nova-compute[74669]:   <os>
Nov 08 17:09:48 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:09:48 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:09:48 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:09:48 user nova-compute[74669]:   </os>
Nov 08 17:09:48 user nova-compute[74669]:   <features>
Nov 08 17:09:48 user nova-compute[74669]:     <acpi/>
Nov 08 17:09:48 user nova-compute[74669]:     <apic/>
Nov 08 17:09:48 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:09:48 user nova-compute[74669]:   </features>
Nov 08 17:09:48 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:09:48 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:09:48 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:09:48 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:09:48 user nova-compute[74669]:   </clock>
Nov 08 17:09:48 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:09:48 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:09:48 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:09:48 user nova-compute[74669]:   </cpu>
Nov 08 17:09:48 user nova-compute[74669]:   <devices>
Nov 08 17:09:48 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:09:48 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:09:48 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk"/>
Nov 08 17:09:48 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:09:48 user nova-compute[74669]:     </disk>
Nov 08 17:09:48 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:09:48 user nova-compute[74669]:       <mac address="fa:16:3e:76:cd:a9"/>
Nov 08 17:09:48 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:09:48 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:09:48 user nova-compute[74669]:       <target dev="tapea40d3d9-25"/>
Nov 08 17:09:48 user nova-compute[74669]:     </interface>
Nov 08 17:09:48 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:09:48 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/console.log" append="off"/>
Nov 08 17:09:48 user nova-compute[74669]:     </serial>
Nov 08 17:09:48 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:09:48 user nova-compute[74669]:     <video>
Nov 08 17:09:48 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:09:48 user nova-compute[74669]:     </video>
Nov 08 17:09:48 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:09:48 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:09:48 user nova-compute[74669]:     </rng>
Nov 08 17:09:48 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:09:48 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:09:48 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:09:48 user nova-compute[74669]:     </memballoon>
Nov 08 17:09:48 user nova-compute[74669]:   </devices>
Nov 08 17:09:48 user nova-compute[74669]: </domain>
Nov 08 17:09:48 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:09:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-614850635',display_name='tempest-ServersNegativeTestJSON-server-614850635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-614850635',id=29,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae1a781163a345dc8be717e3e7c73788',ramdisk_id='',reservation_id='r-i1y84hf5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1017043905',owner_user_name='tempest-ServersNegativeTestJSON-1017043905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:09:47Z,user_data=None,user_id='a3b60e9d47ab49f8bd3614621e2bd890',uuid=2158a7c2-2f46-4bce-8558-4347a48623d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea40d3d9-25df-410d-b2ff-46a980702022", "address": "fa:16:3e:76:cd:a9", "network": {"id": "52bf51f6-cf7e-403b-b601-0660b9c8544f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-17276515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1a781163a345dc8be717e3e7c73788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea40d3d9-25", "ovs_interfaceid": "ea40d3d9-25df-410d-b2ff-46a980702022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Converting VIF {"id": "ea40d3d9-25df-410d-b2ff-46a980702022", "address": "fa:16:3e:76:cd:a9", "network": {"id": "52bf51f6-cf7e-403b-b601-0660b9c8544f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-17276515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1a781163a345dc8be717e3e7c73788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea40d3d9-25", "ovs_interfaceid": "ea40d3d9-25df-410d-b2ff-46a980702022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:cd:a9,bridge_name='br-int',has_traffic_filtering=True,id=ea40d3d9-25df-410d-b2ff-46a980702022,network=Network(52bf51f6-cf7e-403b-b601-0660b9c8544f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea40d3d9-25') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG os_vif [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:cd:a9,bridge_name='br-int',has_traffic_filtering=True,id=ea40d3d9-25df-410d-b2ff-46a980702022,network=Network(52bf51f6-cf7e-403b-b601-0660b9c8544f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea40d3d9-25') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05aded17-a26f-519e-8923-3bb42ec5810f', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea40d3d9-25, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea40d3d9-25, col_values=(('qos', UUID('e5d79f9a-13c6-4f4d-aa01-23978ddfa685')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea40d3d9-25, col_values=(('external_ids', {'iface-id': 'ea40d3d9-25df-410d-b2ff-46a980702022', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:cd:a9', 'vm-uuid': '2158a7c2-2f46-4bce-8558-4347a48623d5'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:48 user nova-compute[74669]: INFO os_vif [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:cd:a9,bridge_name='br-int',has_traffic_filtering=True,id=ea40d3d9-25df-410d-b2ff-46a980702022,network=Network(52bf51f6-cf7e-403b-b601-0660b9c8544f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea40d3d9-25')
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] No VIF found with MAC fa:16:3e:76:cd:a9, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.network.neutron [req-945c2e1d-35a1-41c0-b600-1def9ace1a2e req-3d2a4e3b-6d09-486b-8cdc-816af9613909 service nova] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Updated VIF entry in instance network info cache for port ea40d3d9-25df-410d-b2ff-46a980702022. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG nova.network.neutron [req-945c2e1d-35a1-41c0-b600-1def9ace1a2e req-3d2a4e3b-6d09-486b-8cdc-816af9613909 service nova] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Updating instance_info_cache with network_info: [{"id": "ea40d3d9-25df-410d-b2ff-46a980702022", "address": "fa:16:3e:76:cd:a9", "network": {"id": "52bf51f6-cf7e-403b-b601-0660b9c8544f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-17276515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1a781163a345dc8be717e3e7c73788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea40d3d9-25", "ovs_interfaceid": "ea40d3d9-25df-410d-b2ff-46a980702022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:09:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-945c2e1d-35a1-41c0-b600-1def9ace1a2e req-3d2a4e3b-6d09-486b-8cdc-816af9613909 service nova] Releasing lock "refresh_cache-2158a7c2-2f46-4bce-8558-4347a48623d5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:09:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:50 user nova-compute[74669]: DEBUG nova.compute.manager [req-f6767b11-2d44-4957-973f-362fd2255003 req-ce94c4a9-fc10-4852-a852-31d4a79bb1f8 service nova] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Received event network-vif-plugged-ea40d3d9-25df-410d-b2ff-46a980702022 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:09:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f6767b11-2d44-4957-973f-362fd2255003 req-ce94c4a9-fc10-4852-a852-31d4a79bb1f8 service nova] Acquiring lock "2158a7c2-2f46-4bce-8558-4347a48623d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:09:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f6767b11-2d44-4957-973f-362fd2255003 req-ce94c4a9-fc10-4852-a852-31d4a79bb1f8 service nova] Lock "2158a7c2-2f46-4bce-8558-4347a48623d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:09:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f6767b11-2d44-4957-973f-362fd2255003 req-ce94c4a9-fc10-4852-a852-31d4a79bb1f8 service nova] Lock "2158a7c2-2f46-4bce-8558-4347a48623d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:09:50 user nova-compute[74669]: DEBUG nova.compute.manager [req-f6767b11-2d44-4957-973f-362fd2255003 req-ce94c4a9-fc10-4852-a852-31d4a79bb1f8 service nova] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] No waiting events found dispatching network-vif-plugged-ea40d3d9-25df-410d-b2ff-46a980702022 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:09:50 user nova-compute[74669]: WARNING nova.compute.manager [req-f6767b11-2d44-4957-973f-362fd2255003 req-ce94c4a9-fc10-4852-a852-31d4a79bb1f8 service nova] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Received unexpected event network-vif-plugged-ea40d3d9-25df-410d-b2ff-46a980702022 for instance with vm_state building and task_state spawning.
Nov 08 17:09:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:52 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:09:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:09:52 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Instance spawned successfully.
Nov 08 17:09:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:09:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:09:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:09:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:09:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:09:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:09:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:09:52 user nova-compute[74669]: DEBUG nova.compute.manager [req-9d90cff3-b595-42b6-9f4e-08f7cdf1e07f req-81595756-565a-4927-8d79-81035381fd76 service nova] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Received event network-vif-plugged-ea40d3d9-25df-410d-b2ff-46a980702022 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:09:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9d90cff3-b595-42b6-9f4e-08f7cdf1e07f req-81595756-565a-4927-8d79-81035381fd76 service nova] Acquiring lock "2158a7c2-2f46-4bce-8558-4347a48623d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:09:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9d90cff3-b595-42b6-9f4e-08f7cdf1e07f req-81595756-565a-4927-8d79-81035381fd76 service nova] Lock "2158a7c2-2f46-4bce-8558-4347a48623d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:09:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9d90cff3-b595-42b6-9f4e-08f7cdf1e07f req-81595756-565a-4927-8d79-81035381fd76 service nova] Lock "2158a7c2-2f46-4bce-8558-4347a48623d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:09:52 user nova-compute[74669]: DEBUG nova.compute.manager [req-9d90cff3-b595-42b6-9f4e-08f7cdf1e07f req-81595756-565a-4927-8d79-81035381fd76 service nova] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] No waiting events found dispatching network-vif-plugged-ea40d3d9-25df-410d-b2ff-46a980702022 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:09:52 user nova-compute[74669]: WARNING nova.compute.manager [req-9d90cff3-b595-42b6-9f4e-08f7cdf1e07f req-81595756-565a-4927-8d79-81035381fd76 service nova] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Received unexpected event network-vif-plugged-ea40d3d9-25df-410d-b2ff-46a980702022 for instance with vm_state building and task_state spawning.
Nov 08 17:09:52 user nova-compute[74669]: INFO nova.compute.manager [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Took 5.61 seconds to spawn the instance on the hypervisor.
Nov 08 17:09:52 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:09:52 user nova-compute[74669]: INFO nova.compute.manager [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Took 6.27 seconds to build instance.
Nov 08 17:09:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ff7d387a-9629-47c8-88de-977fe45564c1 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "2158a7c2-2f46-4bce-8558-4347a48623d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.461s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:09:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:55 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:09:56 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:09:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "746bdbac-3e36-4a08-989a-c004634890f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:09:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "746bdbac-3e36-4a08-989a-c004634890f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:09:57 user nova-compute[74669]: DEBUG nova.compute.manager [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:09:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:57 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:09:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:09:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:09:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:09:57 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:09:57 user nova-compute[74669]: INFO nova.compute.claims [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Claim successful on node user
Nov 08 17:09:58 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG nova.compute.manager [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.410s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG nova.compute.manager [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG nova.network.neutron [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:09:58 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:09:58 user nova-compute[74669]: DEBUG nova.compute.manager [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:09:58 user nova-compute[74669]: INFO nova.virt.block_device [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Booting with volume 26643eca-01db-4eae-9621-c1371bd1e66b at /dev/vda
Nov 08 17:09:58 user nova-compute[74669]: DEBUG nova.policy [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e118c178ece2492bb2d975643c405196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b82c0c2cd480f96d155adf4f6de4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG os_brick.utils [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4ee47f-5b1b-4ad6-9cf2-e8158ffd694e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[441d3ca8-4189-47f0-a8a6-3d61a310dd56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6354a06-450f-4361-ab12-9f9251749c0d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac636428-fc62-4411-a597-384bc0fbcba4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:09:58 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[87641c7c-9788-46a2-b092-bbd33d5f07b8]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG os_brick.utils [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Updating existing volume attachment record: 96297157-a46a-42bd-9df0-400e83ec8842 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:09:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:09:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:09:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:09:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:09:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:09:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:09:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:09:59 user nova-compute[74669]: DEBUG nova.network.neutron [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Successfully created port: f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:09:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:09:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:00 user nova-compute[74669]: DEBUG nova.network.neutron [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Successfully updated port: f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:10:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "refresh_cache-746bdbac-3e36-4a08-989a-c004634890f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:10:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquired lock "refresh_cache-746bdbac-3e36-4a08-989a-c004634890f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:10:00 user nova-compute[74669]: DEBUG nova.network.neutron [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:10:00 user nova-compute[74669]: DEBUG nova.compute.manager [req-50551487-ff8d-49ae-8f55-38df3b4e7a07 req-d8409c15-4755-4f54-b660-997a312030a2 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Received event network-changed-f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:10:00 user nova-compute[74669]: DEBUG nova.compute.manager [req-50551487-ff8d-49ae-8f55-38df3b4e7a07 req-d8409c15-4755-4f54-b660-997a312030a2 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Refreshing instance network info cache due to event network-changed-f33d0612-bda7-41c8-ba61-d965030f2304. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:10:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-50551487-ff8d-49ae-8f55-38df3b4e7a07 req-d8409c15-4755-4f54-b660-997a312030a2 service nova] Acquiring lock "refresh_cache-746bdbac-3e36-4a08-989a-c004634890f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:10:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:00 user nova-compute[74669]: DEBUG nova.network.neutron [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:10:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:01 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:10:01 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:10:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8264MB free_disk=25.405059814453125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7b335462-0d93-4899-a223-5c2e36932578 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance af8b58ff-90d5-4a04-844a-ac0534a7e413 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance dff7cbf2-497a-4a27-a0b1-2e97f1391090 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance bf46a10b-747a-490c-8e22-a76ec65fafdf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2158a7c2-2f46-4bce-8558-4347a48623d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 746bdbac-3e36-4a08-989a-c004634890f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Updating instance_info_cache with network_info: [{"id": "f33d0612-bda7-41c8-ba61-d965030f2304", "address": "fa:16:3e:55:1b:72", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33d0612-bd", "ovs_interfaceid": "f33d0612-bda7-41c8-ba61-d965030f2304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-803587c4-3409-4223-9678-a36d17e0485d req-68425e2f-6796-41f5-8aaf-139211bb6adf service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Received event network-changed-48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-803587c4-3409-4223-9678-a36d17e0485d req-68425e2f-6796-41f5-8aaf-139211bb6adf service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Refreshing instance network info cache due to event network-changed-48c33fc5-13e1-4b32-b706-55d5f033b4d7. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-803587c4-3409-4223-9678-a36d17e0485d req-68425e2f-6796-41f5-8aaf-139211bb6adf service nova] Acquiring lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-803587c4-3409-4223-9678-a36d17e0485d req-68425e2f-6796-41f5-8aaf-139211bb6adf service nova] Acquired lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG nova.network.neutron [req-803587c4-3409-4223-9678-a36d17e0485d req-68425e2f-6796-41f5-8aaf-139211bb6adf service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Refreshing network info cache for port 48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Releasing lock "refresh_cache-746bdbac-3e36-4a08-989a-c004634890f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Instance network_info: |[{"id": "f33d0612-bda7-41c8-ba61-d965030f2304", "address": "fa:16:3e:55:1b:72", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33d0612-bd", "ovs_interfaceid": "f33d0612-bda7-41c8-ba61-d965030f2304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-50551487-ff8d-49ae-8f55-38df3b4e7a07 req-d8409c15-4755-4f54-b660-997a312030a2 service nova] Acquired lock "refresh_cache-746bdbac-3e36-4a08-989a-c004634890f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:10:01 user nova-compute[74669]: DEBUG nova.network.neutron [req-50551487-ff8d-49ae-8f55-38df3b4e7a07 req-d8409c15-4755-4f54-b660-997a312030a2 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Refreshing network info cache for port f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:10:02 user nova-compute[74669]: DEBUG nova.network.neutron [req-803587c4-3409-4223-9678-a36d17e0485d req-68425e2f-6796-41f5-8aaf-139211bb6adf service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Updated VIF entry in instance network info cache for port 48c33fc5-13e1-4b32-b706-55d5f033b4d7. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:10:02 user nova-compute[74669]: DEBUG nova.network.neutron [req-803587c4-3409-4223-9678-a36d17e0485d req-68425e2f-6796-41f5-8aaf-139211bb6adf service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Updating instance_info_cache with network_info: [{"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c33fc5-13", "ovs_interfaceid": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:10:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-803587c4-3409-4223-9678-a36d17e0485d req-68425e2f-6796-41f5-8aaf-139211bb6adf service nova] Releasing lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:10:02 user nova-compute[74669]: DEBUG nova.network.neutron [req-50551487-ff8d-49ae-8f55-38df3b4e7a07 req-d8409c15-4755-4f54-b660-997a312030a2 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Updated VIF entry in instance network info cache for port f33d0612-bda7-41c8-ba61-d965030f2304. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:10:02 user nova-compute[74669]: DEBUG nova.network.neutron [req-50551487-ff8d-49ae-8f55-38df3b4e7a07 req-d8409c15-4755-4f54-b660-997a312030a2 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Updating instance_info_cache with network_info: [{"id": "f33d0612-bda7-41c8-ba61-d965030f2304", "address": "fa:16:3e:55:1b:72", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33d0612-bd", "ovs_interfaceid": "f33d0612-bda7-41c8-ba61-d965030f2304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:10:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-50551487-ff8d-49ae-8f55-38df3b4e7a07 req-d8409c15-4755-4f54-b660-997a312030a2 service nova] Releasing lock "refresh_cache-746bdbac-3e36-4a08-989a-c004634890f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:10:02 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:10:02 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:10:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-af8b58ff-90d5-4a04-844a-ac0534a7e413" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:10:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-af8b58ff-90d5-4a04-844a-ac0534a7e413" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:10:02 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:10:03 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Updating instance_info_cache with network_info: [{"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:10:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-af8b58ff-90d5-4a04-844a-ac0534a7e413" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:10:03 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:10:03 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:10:03 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:10:03 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:10:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:03 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:10:03 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:10:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:04 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:10:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "bf46a10b-747a-490c-8e22-a76ec65fafdf" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:10:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:10:09 user nova-compute[74669]: INFO nova.compute.manager [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Shelving
Nov 08 17:10:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:09 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Instance destroyed successfully.
Nov 08 17:10:09 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Beginning cold snapshot process
Nov 08 17:10:10 user nova-compute[74669]: DEBUG nova.privsep.utils [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74669) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 17:10:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk /opt/stack/data/nova/instances/snapshots/tmpftfee50s/e2f1c3dc12084cf6bcd00dfa0781edc0 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk /opt/stack/data/nova/instances/snapshots/tmpftfee50s/e2f1c3dc12084cf6bcd00dfa0781edc0" returned: 0 in 0.831s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:10 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Snapshot extracted, beginning image upload
Nov 08 17:10:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:11 user nova-compute[74669]: DEBUG nova.compute.manager [req-9e829e6b-766c-4bcd-b35b-bd70e1bc0854 req-1f1464b8-2fcc-464e-8c72-42c9b6822bd7 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Received event network-vif-unplugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:10:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9e829e6b-766c-4bcd-b35b-bd70e1bc0854 req-1f1464b8-2fcc-464e-8c72-42c9b6822bd7 service nova] Acquiring lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:10:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9e829e6b-766c-4bcd-b35b-bd70e1bc0854 req-1f1464b8-2fcc-464e-8c72-42c9b6822bd7 service nova] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:10:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9e829e6b-766c-4bcd-b35b-bd70e1bc0854 req-1f1464b8-2fcc-464e-8c72-42c9b6822bd7 service nova] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:10:11 user nova-compute[74669]: DEBUG nova.compute.manager [req-9e829e6b-766c-4bcd-b35b-bd70e1bc0854 req-1f1464b8-2fcc-464e-8c72-42c9b6822bd7 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] No waiting events found dispatching network-vif-unplugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:10:11 user nova-compute[74669]: WARNING nova.compute.manager [req-9e829e6b-766c-4bcd-b35b-bd70e1bc0854 req-1f1464b8-2fcc-464e-8c72-42c9b6822bd7 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Received unexpected event network-vif-unplugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 for instance with vm_state active and task_state shelving_image_uploading.
Nov 08 17:10:13 user nova-compute[74669]: DEBUG nova.compute.manager [req-4edca398-d673-4c6c-8874-94da852aef21 req-472cb86a-40a9-474c-9947-8716b0fe89fa service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Received event network-vif-plugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:10:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4edca398-d673-4c6c-8874-94da852aef21 req-472cb86a-40a9-474c-9947-8716b0fe89fa service nova] Acquiring lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:10:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4edca398-d673-4c6c-8874-94da852aef21 req-472cb86a-40a9-474c-9947-8716b0fe89fa service nova] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:10:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4edca398-d673-4c6c-8874-94da852aef21 req-472cb86a-40a9-474c-9947-8716b0fe89fa service nova] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:10:13 user nova-compute[74669]: DEBUG nova.compute.manager [req-4edca398-d673-4c6c-8874-94da852aef21 req-472cb86a-40a9-474c-9947-8716b0fe89fa service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] No waiting events found dispatching network-vif-plugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:10:13 user nova-compute[74669]: WARNING nova.compute.manager [req-4edca398-d673-4c6c-8874-94da852aef21 req-472cb86a-40a9-474c-9947-8716b0fe89fa service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Received unexpected event network-vif-plugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 for instance with vm_state active and task_state shelving_image_uploading.
Nov 08 17:10:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:13 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Snapshot image upload complete
Nov 08 17:10:13 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:10:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:13 user nova-compute[74669]: INFO nova.compute.manager [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Shelve offloading
Nov 08 17:10:13 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Instance destroyed successfully.
Nov 08 17:10:13 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:10:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:10:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquired lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:10:13 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:10:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "3754330e-8b41-4e69-93f9-508ef5adf772" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:10:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "3754330e-8b41-4e69-93f9-508ef5adf772" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:10:14 user nova-compute[74669]: DEBUG nova.compute.manager [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:10:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:10:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:10:14 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:10:14 user nova-compute[74669]: INFO nova.compute.claims [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Claim successful on node user
Nov 08 17:10:14 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Updating instance_info_cache with network_info: [{"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c33fc5-13", "ovs_interfaceid": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:10:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Releasing lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:10:14 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:10:14 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:10:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:10:14 user nova-compute[74669]: DEBUG nova.compute.manager [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:10:14 user nova-compute[74669]: DEBUG nova.compute.manager [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:10:14 user nova-compute[74669]: DEBUG nova.network.neutron [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:10:14 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:10:14 user nova-compute[74669]: DEBUG nova.compute.manager [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:10:14 user nova-compute[74669]: DEBUG nova.policy [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '565488b722e44809a7cff5e617daae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58f78f65e774cf78ca0c49aa11f9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG nova.compute.manager [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:10:15 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Creating image(s)
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "/opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "/opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "/opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:15 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Instance destroyed successfully.
Nov 08 17:10:15 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lazy-loading 'resources' on Instance uuid bf46a10b-747a-490c-8e22-a76ec65fafdf {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-4007e16f-7554-442a-b723-a0d39930de2e req-ca96713c-cd8b-4c85-ae7e-86e84dcc251f service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Received event network-changed-48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-4007e16f-7554-442a-b723-a0d39930de2e req-ca96713c-cd8b-4c85-ae7e-86e84dcc251f service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Refreshing instance network info cache due to event network-changed-48c33fc5-13e1-4b32-b706-55d5f033b4d7. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4007e16f-7554-442a-b723-a0d39930de2e req-ca96713c-cd8b-4c85-ae7e-86e84dcc251f service nova] Acquiring lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4007e16f-7554-442a-b723-a0d39930de2e req-ca96713c-cd8b-4c85-ae7e-86e84dcc251f service nova] Acquired lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG nova.network.neutron [req-4007e16f-7554-442a-b723-a0d39930de2e req-ca96713c-cd8b-4c85-ae7e-86e84dcc251f service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Refreshing network info cache for port 48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:08:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-906635481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-906635481',id=28,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCctGPvKViiOdXyrKx2lAWsKGEcF4bmf760ubgVvLN8IGOdz+Pa7cVVnJvWEDYvDETcr24w3bBjYR4gpcxGKh61GsWSFIwhCTGo213jwflFd1nP4PIE1jH6lMuTDSsl37Q==',key_name='tempest-keypair-1645684870',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:08:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9f1e9778e17a4e0fa1aa1f41d323a88c',ramdisk_id='',reservation_id='r-3gqwmia3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-317302826',owner_user_name='tempest-AttachVolumeShelveTestJSON-317302826-project-member',shelved_at='2023-11-08T17:10:13.839909',shelved_host='user',shelved_image_id='31e6aebb-7c00-49e8-a0ae-527720bd9859'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:10:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8bcb0586bce42a3a1a59b2cbc99f846',uuid=bf46a10b-747a-490c-8e22-a76ec65fafdf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c33fc5-13", "ovs_interfaceid": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converting VIF {"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c33fc5-13", "ovs_interfaceid": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:64:e8,bridge_name='br-int',has_traffic_filtering=True,id=48c33fc5-13e1-4b32-b706-55d5f033b4d7,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c33fc5-13') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG os_vif [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:64:e8,bridge_name='br-int',has_traffic_filtering=True,id=48c33fc5-13e1-4b32-b706-55d5f033b4d7,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c33fc5-13') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48c33fc5-13, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7837644e-270d-41dc-bb39-dd43b1c566d6) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:15 user nova-compute[74669]: INFO os_vif [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:64:e8,bridge_name='br-int',has_traffic_filtering=True,id=48c33fc5-13e1-4b32-b706-55d5f033b4d7,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c33fc5-13')
Nov 08 17:10:15 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Deleting instance files /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf_del
Nov 08 17:10:15 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Deletion of /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf_del complete
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.237s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:15 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Deleted allocations for instance bf46a10b-747a-490c-8e22-a76ec65fafdf
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lazy-loading 'numa_topology' on Instance uuid bf46a10b-747a-490c-8e22-a76ec65fafdf {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.185s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG nova.objects.base [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Object Instance<bf46a10b-747a-490c-8e22-a76ec65fafdf> lazy-loaded attributes: resources,numa_topology {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk 1073741824" returned: 0 in 0.062s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG nova.network.neutron [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Successfully created port: e1e01142-baa0-4410-a147-a0981b4bbd54 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.185s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG nova.network.neutron [req-4007e16f-7554-442a-b723-a0d39930de2e req-ca96713c-cd8b-4c85-ae7e-86e84dcc251f service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Updated VIF entry in instance network info cache for port 48c33fc5-13e1-4b32-b706-55d5f033b4d7. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG nova.network.neutron [req-4007e16f-7554-442a-b723-a0d39930de2e req-ca96713c-cd8b-4c85-ae7e-86e84dcc251f service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Updating instance_info_cache with network_info: [{"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap48c33fc5-13", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4007e16f-7554-442a-b723-a0d39930de2e req-ca96713c-cd8b-4c85-ae7e-86e84dcc251f service nova] Releasing lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Cannot resize image /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Ensure instance console log exists: /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:10:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d5f69ad3-5e0b-406f-bcc0-d695f24b94f3 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.924s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.network.neutron [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Successfully updated port: e1e01142-baa0-4410-a147-a0981b4bbd54 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "refresh_cache-3754330e-8b41-4e69-93f9-508ef5adf772" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquired lock "refresh_cache-3754330e-8b41-4e69-93f9-508ef5adf772" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.network.neutron [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.compute.manager [req-6e8f830a-80e4-4ec4-87f4-1eae9cc473d6 req-c7ae2f1c-6e12-4278-b363-8d4b87956757 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Received event network-changed-e1e01142-baa0-4410-a147-a0981b4bbd54 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.compute.manager [req-6e8f830a-80e4-4ec4-87f4-1eae9cc473d6 req-c7ae2f1c-6e12-4278-b363-8d4b87956757 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Refreshing instance network info cache due to event network-changed-e1e01142-baa0-4410-a147-a0981b4bbd54. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6e8f830a-80e4-4ec4-87f4-1eae9cc473d6 req-c7ae2f1c-6e12-4278-b363-8d4b87956757 service nova] Acquiring lock "refresh_cache-3754330e-8b41-4e69-93f9-508ef5adf772" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.network.neutron [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.network.neutron [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Updating instance_info_cache with network_info: [{"id": "e1e01142-baa0-4410-a147-a0981b4bbd54", "address": "fa:16:3e:b6:8f:c8", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e01142-ba", "ovs_interfaceid": "e1e01142-baa0-4410-a147-a0981b4bbd54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Releasing lock "refresh_cache-3754330e-8b41-4e69-93f9-508ef5adf772" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.compute.manager [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Instance network_info: |[{"id": "e1e01142-baa0-4410-a147-a0981b4bbd54", "address": "fa:16:3e:b6:8f:c8", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e01142-ba", "ovs_interfaceid": "e1e01142-baa0-4410-a147-a0981b4bbd54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6e8f830a-80e4-4ec4-87f4-1eae9cc473d6 req-c7ae2f1c-6e12-4278-b363-8d4b87956757 service nova] Acquired lock "refresh_cache-3754330e-8b41-4e69-93f9-508ef5adf772" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.network.neutron [req-6e8f830a-80e4-4ec4-87f4-1eae9cc473d6 req-c7ae2f1c-6e12-4278-b363-8d4b87956757 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Refreshing network info cache for port e1e01142-baa0-4410-a147-a0981b4bbd54 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Start _get_guest_xml network_info=[{"id": "e1e01142-baa0-4410-a147-a0981b4bbd54", "address": "fa:16:3e:b6:8f:c8", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e01142-ba", "ovs_interfaceid": "e1e01142-baa0-4410-a147-a0981b4bbd54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:10:16 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:10:16 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:10:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-590350783',display_name='tempest-AttachVolumeNegativeTest-server-590350783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-590350783',id=31,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4GgY0bFzCvuFysSfG+ayqqZin61DX+ouTxt65eTuj9s3YTMeT2wjnTaTNUCBoTZJzLpwQUNzZ9JN9LgaGxFGYdn+z5/kAAHocLOG/tYRJcO1QfxbbkjbQnQmxyVZlp6g==',key_name='tempest-keypair-617492706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f58f78f65e774cf78ca0c49aa11f9b54',ramdisk_id='',reservation_id='r-epuggkon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1846694333',owner_user_name='tempest-AttachVolumeNegativeTest-1846694333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:10:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='565488b722e44809a7cff5e617daae84',uuid=3754330e-8b41-4e69-93f9-508ef5adf772,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1e01142-baa0-4410-a147-a0981b4bbd54", "address": "fa:16:3e:b6:8f:c8", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e01142-ba", "ovs_interfaceid": "e1e01142-baa0-4410-a147-a0981b4bbd54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converting VIF {"id": "e1e01142-baa0-4410-a147-a0981b4bbd54", "address": "fa:16:3e:b6:8f:c8", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e01142-ba", "ovs_interfaceid": "e1e01142-baa0-4410-a147-a0981b4bbd54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:8f:c8,bridge_name='br-int',has_traffic_filtering=True,id=e1e01142-baa0-4410-a147-a0981b4bbd54,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1e01142-ba') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.objects.instance [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lazy-loading 'pci_devices' on Instance uuid 3754330e-8b41-4e69-93f9-508ef5adf772 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:10:16 user nova-compute[74669]:   <uuid>3754330e-8b41-4e69-93f9-508ef5adf772</uuid>
Nov 08 17:10:16 user nova-compute[74669]:   <name>instance-0000001f</name>
Nov 08 17:10:16 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:10:16 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:10:16 user nova-compute[74669]:   <metadata>
Nov 08 17:10:16 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:10:16 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:10:16 user nova-compute[74669]:       <nova:name>tempest-AttachVolumeNegativeTest-server-590350783</nova:name>
Nov 08 17:10:16 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:10:16</nova:creationTime>
Nov 08 17:10:16 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:10:16 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:10:16 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:10:16 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:10:16 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:10:16 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:10:16 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:10:16 user nova-compute[74669]:       <nova:owner>
Nov 08 17:10:16 user nova-compute[74669]:         <nova:user uuid="565488b722e44809a7cff5e617daae84">tempest-AttachVolumeNegativeTest-1846694333-project-member</nova:user>
Nov 08 17:10:16 user nova-compute[74669]:         <nova:project uuid="f58f78f65e774cf78ca0c49aa11f9b54">tempest-AttachVolumeNegativeTest-1846694333</nova:project>
Nov 08 17:10:16 user nova-compute[74669]:       </nova:owner>
Nov 08 17:10:16 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:10:16 user nova-compute[74669]:       <nova:ports>
Nov 08 17:10:16 user nova-compute[74669]:         <nova:port uuid="e1e01142-baa0-4410-a147-a0981b4bbd54">
Nov 08 17:10:16 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 17:10:16 user nova-compute[74669]:         </nova:port>
Nov 08 17:10:16 user nova-compute[74669]:       </nova:ports>
Nov 08 17:10:16 user nova-compute[74669]:     </nova:instance>
Nov 08 17:10:16 user nova-compute[74669]:   </metadata>
Nov 08 17:10:16 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:10:16 user nova-compute[74669]:     <system>
Nov 08 17:10:16 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:10:16 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:10:16 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:10:16 user nova-compute[74669]:       <entry name="serial">3754330e-8b41-4e69-93f9-508ef5adf772</entry>
Nov 08 17:10:16 user nova-compute[74669]:       <entry name="uuid">3754330e-8b41-4e69-93f9-508ef5adf772</entry>
Nov 08 17:10:16 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:10:16 user nova-compute[74669]:     </system>
Nov 08 17:10:16 user nova-compute[74669]:   </sysinfo>
Nov 08 17:10:16 user nova-compute[74669]:   <os>
Nov 08 17:10:16 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:10:16 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:10:16 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:10:16 user nova-compute[74669]:   </os>
Nov 08 17:10:16 user nova-compute[74669]:   <features>
Nov 08 17:10:16 user nova-compute[74669]:     <acpi/>
Nov 08 17:10:16 user nova-compute[74669]:     <apic/>
Nov 08 17:10:16 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:10:16 user nova-compute[74669]:   </features>
Nov 08 17:10:16 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:10:16 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:10:16 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:10:16 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:10:16 user nova-compute[74669]:   </clock>
Nov 08 17:10:16 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:10:16 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:10:16 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:10:16 user nova-compute[74669]:   </cpu>
Nov 08 17:10:16 user nova-compute[74669]:   <devices>
Nov 08 17:10:16 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:10:16 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:10:16 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk"/>
Nov 08 17:10:16 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:10:16 user nova-compute[74669]:     </disk>
Nov 08 17:10:16 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:10:16 user nova-compute[74669]:       <mac address="fa:16:3e:b6:8f:c8"/>
Nov 08 17:10:16 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:10:16 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:10:16 user nova-compute[74669]:       <target dev="tape1e01142-ba"/>
Nov 08 17:10:16 user nova-compute[74669]:     </interface>
Nov 08 17:10:16 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:10:16 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/console.log" append="off"/>
Nov 08 17:10:16 user nova-compute[74669]:     </serial>
Nov 08 17:10:16 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:10:16 user nova-compute[74669]:     <video>
Nov 08 17:10:16 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:10:16 user nova-compute[74669]:     </video>
Nov 08 17:10:16 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:10:16 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:10:16 user nova-compute[74669]:     </rng>
Nov 08 17:10:16 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:10:16 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:10:16 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:10:16 user nova-compute[74669]:     </memballoon>
Nov 08 17:10:16 user nova-compute[74669]:   </devices>
Nov 08 17:10:16 user nova-compute[74669]: </domain>
Nov 08 17:10:16 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:10:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-590350783',display_name='tempest-AttachVolumeNegativeTest-server-590350783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-590350783',id=31,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4GgY0bFzCvuFysSfG+ayqqZin61DX+ouTxt65eTuj9s3YTMeT2wjnTaTNUCBoTZJzLpwQUNzZ9JN9LgaGxFGYdn+z5/kAAHocLOG/tYRJcO1QfxbbkjbQnQmxyVZlp6g==',key_name='tempest-keypair-617492706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f58f78f65e774cf78ca0c49aa11f9b54',ramdisk_id='',reservation_id='r-epuggkon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1846694333',owner_user_name='tempest-AttachVolumeNegativeTest-1846694333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:10:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='565488b722e44809a7cff5e617daae84',uuid=3754330e-8b41-4e69-93f9-508ef5adf772,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1e01142-baa0-4410-a147-a0981b4bbd54", "address": "fa:16:3e:b6:8f:c8", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e01142-ba", "ovs_interfaceid": "e1e01142-baa0-4410-a147-a0981b4bbd54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converting VIF {"id": "e1e01142-baa0-4410-a147-a0981b4bbd54", "address": "fa:16:3e:b6:8f:c8", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e01142-ba", "ovs_interfaceid": "e1e01142-baa0-4410-a147-a0981b4bbd54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:8f:c8,bridge_name='br-int',has_traffic_filtering=True,id=e1e01142-baa0-4410-a147-a0981b4bbd54,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1e01142-ba') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG os_vif [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:8f:c8,bridge_name='br-int',has_traffic_filtering=True,id=e1e01142-baa0-4410-a147-a0981b4bbd54,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1e01142-ba') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f1340ab-2ea1-5e53-abae-6b23f28df532', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1e01142-ba, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1e01142-ba, col_values=(('qos', UUID('9abb81dc-9ee3-44c5-8c62-799c8d4cf0b3')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1e01142-ba, col_values=(('external_ids', {'iface-id': 'e1e01142-baa0-4410-a147-a0981b4bbd54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:8f:c8', 'vm-uuid': '3754330e-8b41-4e69-93f9-508ef5adf772'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:16 user nova-compute[74669]: INFO os_vif [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:8f:c8,bridge_name='br-int',has_traffic_filtering=True,id=e1e01142-baa0-4410-a147-a0981b4bbd54,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1e01142-ba')
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:10:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] No VIF found with MAC fa:16:3e:b6:8f:c8, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:10:17 user nova-compute[74669]: DEBUG nova.network.neutron [req-6e8f830a-80e4-4ec4-87f4-1eae9cc473d6 req-c7ae2f1c-6e12-4278-b363-8d4b87956757 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Updated VIF entry in instance network info cache for port e1e01142-baa0-4410-a147-a0981b4bbd54. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:10:17 user nova-compute[74669]: DEBUG nova.network.neutron [req-6e8f830a-80e4-4ec4-87f4-1eae9cc473d6 req-c7ae2f1c-6e12-4278-b363-8d4b87956757 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Updating instance_info_cache with network_info: [{"id": "e1e01142-baa0-4410-a147-a0981b4bbd54", "address": "fa:16:3e:b6:8f:c8", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e01142-ba", "ovs_interfaceid": "e1e01142-baa0-4410-a147-a0981b4bbd54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:10:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6e8f830a-80e4-4ec4-87f4-1eae9cc473d6 req-c7ae2f1c-6e12-4278-b363-8d4b87956757 service nova] Releasing lock "refresh_cache-3754330e-8b41-4e69-93f9-508ef5adf772" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:10:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:18 user nova-compute[74669]: DEBUG nova.compute.manager [req-32aaad76-2bbc-43f9-be0d-243ec7ac73de req-6ed5127f-7018-4bf6-a5e1-fb58d03514c0 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Received event network-vif-plugged-e1e01142-baa0-4410-a147-a0981b4bbd54 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:10:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-32aaad76-2bbc-43f9-be0d-243ec7ac73de req-6ed5127f-7018-4bf6-a5e1-fb58d03514c0 service nova] Acquiring lock "3754330e-8b41-4e69-93f9-508ef5adf772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:10:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-32aaad76-2bbc-43f9-be0d-243ec7ac73de req-6ed5127f-7018-4bf6-a5e1-fb58d03514c0 service nova] Lock "3754330e-8b41-4e69-93f9-508ef5adf772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:10:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-32aaad76-2bbc-43f9-be0d-243ec7ac73de req-6ed5127f-7018-4bf6-a5e1-fb58d03514c0 service nova] Lock "3754330e-8b41-4e69-93f9-508ef5adf772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:10:18 user nova-compute[74669]: DEBUG nova.compute.manager [req-32aaad76-2bbc-43f9-be0d-243ec7ac73de req-6ed5127f-7018-4bf6-a5e1-fb58d03514c0 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] No waiting events found dispatching network-vif-plugged-e1e01142-baa0-4410-a147-a0981b4bbd54 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:10:18 user nova-compute[74669]: WARNING nova.compute.manager [req-32aaad76-2bbc-43f9-be0d-243ec7ac73de req-6ed5127f-7018-4bf6-a5e1-fb58d03514c0 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Received unexpected event network-vif-plugged-e1e01142-baa0-4410-a147-a0981b4bbd54 for instance with vm_state building and task_state spawning.
Nov 08 17:10:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:20 user nova-compute[74669]: DEBUG nova.compute.manager [req-be856638-6122-4542-be5e-93b38c43c436 req-61471356-2be6-4b76-badb-0c8b83897974 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Received event network-vif-plugged-e1e01142-baa0-4410-a147-a0981b4bbd54 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:10:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-be856638-6122-4542-be5e-93b38c43c436 req-61471356-2be6-4b76-badb-0c8b83897974 service nova] Acquiring lock "3754330e-8b41-4e69-93f9-508ef5adf772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:10:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-be856638-6122-4542-be5e-93b38c43c436 req-61471356-2be6-4b76-badb-0c8b83897974 service nova] Lock "3754330e-8b41-4e69-93f9-508ef5adf772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:10:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-be856638-6122-4542-be5e-93b38c43c436 req-61471356-2be6-4b76-badb-0c8b83897974 service nova] Lock "3754330e-8b41-4e69-93f9-508ef5adf772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:10:20 user nova-compute[74669]: DEBUG nova.compute.manager [req-be856638-6122-4542-be5e-93b38c43c436 req-61471356-2be6-4b76-badb-0c8b83897974 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] No waiting events found dispatching network-vif-plugged-e1e01142-baa0-4410-a147-a0981b4bbd54 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:10:20 user nova-compute[74669]: WARNING nova.compute.manager [req-be856638-6122-4542-be5e-93b38c43c436 req-61471356-2be6-4b76-badb-0c8b83897974 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Received unexpected event network-vif-plugged-e1e01142-baa0-4410-a147-a0981b4bbd54 for instance with vm_state building and task_state spawning.
Nov 08 17:10:20 user nova-compute[74669]: DEBUG nova.compute.manager [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:10:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:10:20 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Instance spawned successfully.
Nov 08 17:10:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:10:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:10:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:10:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:10:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:10:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:10:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:10:20 user nova-compute[74669]: INFO nova.compute.manager [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Took 5.78 seconds to spawn the instance on the hypervisor.
Nov 08 17:10:20 user nova-compute[74669]: DEBUG nova.compute.manager [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:10:20 user nova-compute[74669]: INFO nova.compute.manager [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Took 6.58 seconds to build instance.
Nov 08 17:10:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9bd14df7-e7d6-4daf-a2dc-a211216cae9c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "3754330e-8b41-4e69-93f9-508ef5adf772" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.702s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:10:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:10:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:10:21 user nova-compute[74669]: INFO nova.compute.manager [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Detaching volume a2d3bf54-9d77-4c85-a92a-6192eae32c7b
Nov 08 17:10:21 user nova-compute[74669]: INFO nova.virt.block_device [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Attempting to driver detach volume a2d3bf54-9d77-4c85-a92a-6192eae32c7b from mountpoint /dev/vdb
Nov 08 17:10:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Attempting to detach device vdb from instance af8b58ff-90d5-4a04-844a-ac0534a7e413 from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 17:10:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:10:21 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:10:21 user nova-compute[74669]:   <source dev="/dev/sdb"/>
Nov 08 17:10:21 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:10:21 user nova-compute[74669]:   <serial>a2d3bf54-9d77-4c85-a92a-6192eae32c7b</serial>
Nov 08 17:10:21 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 17:10:21 user nova-compute[74669]: </disk>
Nov 08 17:10:21 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:10:21 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Successfully detached device vdb from instance af8b58ff-90d5-4a04-844a-ac0534a7e413 from the persistent domain config.
Nov 08 17:10:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance af8b58ff-90d5-4a04-844a-ac0534a7e413 from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 17:10:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:10:21 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:10:21 user nova-compute[74669]:   <source dev="/dev/sdb"/>
Nov 08 17:10:21 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:10:21 user nova-compute[74669]:   <serial>a2d3bf54-9d77-4c85-a92a-6192eae32c7b</serial>
Nov 08 17:10:21 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 17:10:21 user nova-compute[74669]: </disk>
Nov 08 17:10:21 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:10:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:22 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 17:10:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG nova.compute.manager [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:10:24 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Creating image(s)
Nov 08 17:10:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Did not create local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Ensure instance console log exists: /opt/stack/data/nova/instances/746bdbac-3e36-4a08-989a-c004634890f9/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Start _get_guest_xml network_info=[{"id": "f33d0612-bda7-41c8-ba61-d965030f2304", "address": "fa:16:3e:55:1b:72", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33d0612-bd", "ovs_interfaceid": "f33d0612-bda7-41c8-ba61-d965030f2304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '96297157-a46a-42bd-9df0-400e83ec8842', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHlwFeBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '746bdbac-3e36-4a08-989a-c004634890f9', 'attached_at': '', 'detached_at': '', 'volume_id': '26643eca-01db-4eae-9621-c1371bd1e66b', 'serial': '26643eca-01db-4eae-9621-c1371bd1e66b'}, 'guest_format': None, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:10:24 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:10:24 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:10:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHlwFeBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:10:24 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:10:24 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:10:24 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0c4687-5418-4358-a377-46e8f875a060]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:10:24 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[248dd04b-922e-4d8c-a1ee-4534834d0343]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b] added
Nov 08 17:10:24 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[792c1c07-3846-46b7-81ef-3f50fa7f1006]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0840be-f843-4e61-8c6a-52485c27f172]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nHlwFeBI {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nHlwFeBI" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07037fd-aa88-4893-bc35-a0d56ccb64fc]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nHlwFeBI'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c82ffa-bdbb-4d85-8dcb-89d89345e1de]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39fac1a-7562-4b29-9e62-29bbac95aa7e]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:10:24 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:10:24 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[87367e46-7135-48ae-9dc0-eb26c02e075a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b, portal: 172.16.0.220,3260]
Nov 08 17:10:24 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b, portal: 172.16.0.220,3260] successful.
Nov 08 17:10:24 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67d39a4-9f4f-4203-bf97-2e2b0eeae244]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a02e92-4a8e-4fc5-8fc6-87430c97d898]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:10:24 user nova-compute[74669]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:10:24 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:10:24 user nova-compute[74669]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:10:24 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[60db3e6e-a20c-4a2d-baf0-5db565c9b708]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:10:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHlwFeBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23733326165613539', 'path': '/dev/sdc'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733326165613539', 'path': '/dev/sdc'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1960764715',display_name='tempest-ServerActionsTestOtherA-server-1960764715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1960764715',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVa16AMO6wxCfNzgZtwDGNOHyvTHwI2kbeRR1JWZMRp/+84NydbzrImNzwJFwUc5Mt6eRV8qh3XhhGBx3qjvshZcC9T6FOe5uxOhgTpdbBqJBGj5+jnhuvk7Bsl6Ed/tQ==',key_name='tempest-keypair-2114035891',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='766b82c0c2cd480f96d155adf4f6de4c',ramdisk_id='',reservation_id='r-3who8v2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-23582724',owner_user_name='tempest-ServerActionsTestOtherA-23582724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:09:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e118c178ece2492bb2d975643c405196',uuid=746bdbac-3e36-4a08-989a-c004634890f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f33d0612-bda7-41c8-ba61-d965030f2304", "address": "fa:16:3e:55:1b:72", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33d0612-bd", "ovs_interfaceid": "f33d0612-bda7-41c8-ba61-d965030f2304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converting VIF {"id": "f33d0612-bda7-41c8-ba61-d965030f2304", "address": "fa:16:3e:55:1b:72", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33d0612-bd", "ovs_interfaceid": "f33d0612-bda7-41c8-ba61-d965030f2304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:1b:72,bridge_name='br-int',has_traffic_filtering=True,id=f33d0612-bda7-41c8-ba61-d965030f2304,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33d0612-bd') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG nova.objects.instance [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lazy-loading 'pci_devices' on Instance uuid 746bdbac-3e36-4a08-989a-c004634890f9 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:10:25 user nova-compute[74669]:   <uuid>746bdbac-3e36-4a08-989a-c004634890f9</uuid>
Nov 08 17:10:25 user nova-compute[74669]:   <name>instance-0000001e</name>
Nov 08 17:10:25 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:10:25 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:10:25 user nova-compute[74669]:   <metadata>
Nov 08 17:10:25 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:10:25 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:10:25 user nova-compute[74669]:       <nova:name>tempest-ServerActionsTestOtherA-server-1960764715</nova:name>
Nov 08 17:10:25 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:10:24</nova:creationTime>
Nov 08 17:10:25 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:10:25 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:10:25 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:10:25 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:10:25 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:10:25 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:10:25 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:10:25 user nova-compute[74669]:       <nova:owner>
Nov 08 17:10:25 user nova-compute[74669]:         <nova:user uuid="e118c178ece2492bb2d975643c405196">tempest-ServerActionsTestOtherA-23582724-project-member</nova:user>
Nov 08 17:10:25 user nova-compute[74669]:         <nova:project uuid="766b82c0c2cd480f96d155adf4f6de4c">tempest-ServerActionsTestOtherA-23582724</nova:project>
Nov 08 17:10:25 user nova-compute[74669]:       </nova:owner>
Nov 08 17:10:25 user nova-compute[74669]:       <nova:ports>
Nov 08 17:10:25 user nova-compute[74669]:         <nova:port uuid="f33d0612-bda7-41c8-ba61-d965030f2304">
Nov 08 17:10:25 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 17:10:25 user nova-compute[74669]:         </nova:port>
Nov 08 17:10:25 user nova-compute[74669]:       </nova:ports>
Nov 08 17:10:25 user nova-compute[74669]:     </nova:instance>
Nov 08 17:10:25 user nova-compute[74669]:   </metadata>
Nov 08 17:10:25 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:10:25 user nova-compute[74669]:     <system>
Nov 08 17:10:25 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:10:25 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:10:25 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:10:25 user nova-compute[74669]:       <entry name="serial">746bdbac-3e36-4a08-989a-c004634890f9</entry>
Nov 08 17:10:25 user nova-compute[74669]:       <entry name="uuid">746bdbac-3e36-4a08-989a-c004634890f9</entry>
Nov 08 17:10:25 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:10:25 user nova-compute[74669]:     </system>
Nov 08 17:10:25 user nova-compute[74669]:   </sysinfo>
Nov 08 17:10:25 user nova-compute[74669]:   <os>
Nov 08 17:10:25 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:10:25 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:10:25 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:10:25 user nova-compute[74669]:   </os>
Nov 08 17:10:25 user nova-compute[74669]:   <features>
Nov 08 17:10:25 user nova-compute[74669]:     <acpi/>
Nov 08 17:10:25 user nova-compute[74669]:     <apic/>
Nov 08 17:10:25 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:10:25 user nova-compute[74669]:   </features>
Nov 08 17:10:25 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:10:25 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:10:25 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:10:25 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:10:25 user nova-compute[74669]:   </clock>
Nov 08 17:10:25 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:10:25 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:10:25 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:10:25 user nova-compute[74669]:   </cpu>
Nov 08 17:10:25 user nova-compute[74669]:   <devices>
Nov 08 17:10:25 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 17:10:25 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:10:25 user nova-compute[74669]:       <source dev="/dev/sdc"/>
Nov 08 17:10:25 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:10:25 user nova-compute[74669]:       <serial>26643eca-01db-4eae-9621-c1371bd1e66b</serial>
Nov 08 17:10:25 user nova-compute[74669]:     </disk>
Nov 08 17:10:25 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:10:25 user nova-compute[74669]:       <mac address="fa:16:3e:55:1b:72"/>
Nov 08 17:10:25 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:10:25 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:10:25 user nova-compute[74669]:       <target dev="tapf33d0612-bd"/>
Nov 08 17:10:25 user nova-compute[74669]:     </interface>
Nov 08 17:10:25 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:10:25 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/746bdbac-3e36-4a08-989a-c004634890f9/console.log" append="off"/>
Nov 08 17:10:25 user nova-compute[74669]:     </serial>
Nov 08 17:10:25 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:10:25 user nova-compute[74669]:     <video>
Nov 08 17:10:25 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:10:25 user nova-compute[74669]:     </video>
Nov 08 17:10:25 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:10:25 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:10:25 user nova-compute[74669]:     </rng>
Nov 08 17:10:25 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:10:25 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:10:25 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:10:25 user nova-compute[74669]:     </memballoon>
Nov 08 17:10:25 user nova-compute[74669]:   </devices>
Nov 08 17:10:25 user nova-compute[74669]: </domain>
Nov 08 17:10:25 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1960764715',display_name='tempest-ServerActionsTestOtherA-server-1960764715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1960764715',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVa16AMO6wxCfNzgZtwDGNOHyvTHwI2kbeRR1JWZMRp/+84NydbzrImNzwJFwUc5Mt6eRV8qh3XhhGBx3qjvshZcC9T6FOe5uxOhgTpdbBqJBGj5+jnhuvk7Bsl6Ed/tQ==',key_name='tempest-keypair-2114035891',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='766b82c0c2cd480f96d155adf4f6de4c',ramdisk_id='',reservation_id='r-3who8v2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-23582724',owner_user_name='tempest-ServerActionsTestOtherA-23582724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:09:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e118c178ece2492bb2d975643c405196',uuid=746bdbac-3e36-4a08-989a-c004634890f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f33d0612-bda7-41c8-ba61-d965030f2304", "address": "fa:16:3e:55:1b:72", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33d0612-bd", "ovs_interfaceid": "f33d0612-bda7-41c8-ba61-d965030f2304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converting VIF {"id": "f33d0612-bda7-41c8-ba61-d965030f2304", "address": "fa:16:3e:55:1b:72", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33d0612-bd", "ovs_interfaceid": "f33d0612-bda7-41c8-ba61-d965030f2304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:1b:72,bridge_name='br-int',has_traffic_filtering=True,id=f33d0612-bda7-41c8-ba61-d965030f2304,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33d0612-bd') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG os_vif [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:1b:72,bridge_name='br-int',has_traffic_filtering=True,id=f33d0612-bda7-41c8-ba61-d965030f2304,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33d0612-bd') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ade60105-48c0-5606-8af8-020fad8c2be2', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf33d0612-bd, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf33d0612-bd, col_values=(('qos', UUID('19f2693e-c1db-4b16-88ff-93520790706a')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf33d0612-bd, col_values=(('external_ids', {'iface-id': 'f33d0612-bda7-41c8-ba61-d965030f2304', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:1b:72', 'vm-uuid': '746bdbac-3e36-4a08-989a-c004634890f9'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:25 user nova-compute[74669]: INFO os_vif [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:1b:72,bridge_name='br-int',has_traffic_filtering=True,id=f33d0612-bda7-41c8-ba61-d965030f2304,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33d0612-bd')
Nov 08 17:10:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:10:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] No VIF found with MAC fa:16:3e:55:1b:72, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:10:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-111054bf-5750-40db-bcb0-479ce518c917 req-b5aba301-d860-4180-9596-1d9839045871 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Received event network-vif-plugged-f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:10:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-111054bf-5750-40db-bcb0-479ce518c917 req-b5aba301-d860-4180-9596-1d9839045871 service nova] Acquiring lock "746bdbac-3e36-4a08-989a-c004634890f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:10:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-111054bf-5750-40db-bcb0-479ce518c917 req-b5aba301-d860-4180-9596-1d9839045871 service nova] Lock "746bdbac-3e36-4a08-989a-c004634890f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:10:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-111054bf-5750-40db-bcb0-479ce518c917 req-b5aba301-d860-4180-9596-1d9839045871 service nova] Lock "746bdbac-3e36-4a08-989a-c004634890f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:10:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-111054bf-5750-40db-bcb0-479ce518c917 req-b5aba301-d860-4180-9596-1d9839045871 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] No waiting events found dispatching network-vif-plugged-f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:10:27 user nova-compute[74669]: WARNING nova.compute.manager [req-111054bf-5750-40db-bcb0-479ce518c917 req-b5aba301-d860-4180-9596-1d9839045871 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Received unexpected event network-vif-plugged-f33d0612-bda7-41c8-ba61-d965030f2304 for instance with vm_state building and task_state spawning.
Nov 08 17:10:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:29 user nova-compute[74669]: DEBUG nova.compute.manager [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:10:29 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:10:29 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Instance spawned successfully.
Nov 08 17:10:29 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:10:29 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:10:29 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:10:29 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:10:29 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:10:29 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:10:29 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:10:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-5e6e5922-2bc7-4609-8515-caa6a9bdd53f req-9761ed83-91d2-4620-9620-86648c8ee876 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Received event network-vif-plugged-f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:10:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5e6e5922-2bc7-4609-8515-caa6a9bdd53f req-9761ed83-91d2-4620-9620-86648c8ee876 service nova] Acquiring lock "746bdbac-3e36-4a08-989a-c004634890f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:10:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5e6e5922-2bc7-4609-8515-caa6a9bdd53f req-9761ed83-91d2-4620-9620-86648c8ee876 service nova] Lock "746bdbac-3e36-4a08-989a-c004634890f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:10:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5e6e5922-2bc7-4609-8515-caa6a9bdd53f req-9761ed83-91d2-4620-9620-86648c8ee876 service nova] Lock "746bdbac-3e36-4a08-989a-c004634890f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:10:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-5e6e5922-2bc7-4609-8515-caa6a9bdd53f req-9761ed83-91d2-4620-9620-86648c8ee876 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] No waiting events found dispatching network-vif-plugged-f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:10:29 user nova-compute[74669]: WARNING nova.compute.manager [req-5e6e5922-2bc7-4609-8515-caa6a9bdd53f req-9761ed83-91d2-4620-9620-86648c8ee876 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Received unexpected event network-vif-plugged-f33d0612-bda7-41c8-ba61-d965030f2304 for instance with vm_state building and task_state spawning.
Nov 08 17:10:29 user nova-compute[74669]: INFO nova.compute.manager [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Took 5.20 seconds to spawn the instance on the hypervisor.
Nov 08 17:10:29 user nova-compute[74669]: DEBUG nova.compute.manager [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:10:29 user nova-compute[74669]: INFO nova.compute.manager [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Took 31.97 seconds to build instance.
Nov 08 17:10:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-154f7d17-6538-4c8e-94dd-c6f7b75a6ba6 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "746bdbac-3e36-4a08-989a-c004634890f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.092s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:10:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:31 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:42 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance af8b58ff-90d5-4a04-844a-ac0534a7e413 is timed out.
Nov 08 17:10:42 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Successfully detached device vdb from instance af8b58ff-90d5-4a04-844a-ac0534a7e413 from the live domain config.
Nov 08 17:10:42 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGaVbyCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:10:42 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:10:42 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[786e9f1d-3b77-41d5-9fa5-bfbd47e49f63]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:10:42 user nova-compute[74669]: No targets found.
Nov 08 17:10:42 user nova-compute[74669]: iSNS:
Nov 08 17:10:42 user nova-compute[74669]: No targets found.
Nov 08 17:10:42 user nova-compute[74669]: STATIC:
Nov 08 17:10:42 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b
Nov 08 17:10:42 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:10:42 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:10:42 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b
Nov 08 17:10:42 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:10:42 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:10:42 user nova-compute[74669]: FIRMWARE:
Nov 08 17:10:42 user nova-compute[74669]: No targets found.
Nov 08 17:10:42 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:10:42 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:10:42 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f4dd59-864c-42ff-942e-ebf3fd78b1e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1320cb7b-6b46-43e6-8c9f-61b19129ccc1]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:10:42 user nova-compute[74669]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:10:42 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b (non-flash)
Nov 08 17:10:42 user nova-compute[74669]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:10:42 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd98450d5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b'): ({'sdb'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Removing single pathed devices sdb {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96f6fc8-7294-4f4a-8fa0-47ccea9ddf4a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[723ef7c6-6449-4e37-b98e-e03a62d81f9c]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Flushing IO for device /dev/sdb {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0116582-77a1-4860-b8fd-b5de3778aeb7]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c76ae8e-ef69-4699-b0df-c0b36b47b4b1]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b654a35-7f78-41d8-a7fb-73cb6a5e97a1]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3eec6a-a5c6-455d-9bb2-9d7b155c7bf9]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b, portal: 172.16.0.220,3260]
Nov 08 17:10:42 user nova-compute[74669]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b, portal: 172.16.0.220,3260] successful.
Nov 08 17:10:42 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d3bf54-9d77-4c85-a92a-6192eae32c7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[77224db3-4a52-44c3-8bb6-2d2336b417ea]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] <== disconnect_volume: return (325ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:10:42 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:10:43 user nova-compute[74669]: DEBUG nova.objects.instance [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'flavor' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:10:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2c436831-5191-4915-a001-1f39b7afce4f tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.985s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:10:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-cc264602-c02e-4946-9621-6a361e811a0c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:10:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-cc264602-c02e-4946-9621-6a361e811a0c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:10:44 user nova-compute[74669]: DEBUG nova.compute.manager [None req-cc264602-c02e-4946-9621-6a361e811a0c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:10:44 user nova-compute[74669]: DEBUG nova.compute.manager [None req-cc264602-c02e-4946-9621-6a361e811a0c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74669) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 08 17:10:44 user nova-compute[74669]: DEBUG nova.objects.instance [None req-cc264602-c02e-4946-9621-6a361e811a0c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'flavor' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:10:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-e678479d-c7c6-4d88-96f9-7e824b9f41f4 req-5bd41c24-a0ad-40a7-aa2f-778d892ef5ba service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received event network-vif-unplugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:10:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e678479d-c7c6-4d88-96f9-7e824b9f41f4 req-5bd41c24-a0ad-40a7-aa2f-778d892ef5ba service nova] Acquiring lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:10:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e678479d-c7c6-4d88-96f9-7e824b9f41f4 req-5bd41c24-a0ad-40a7-aa2f-778d892ef5ba service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:10:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e678479d-c7c6-4d88-96f9-7e824b9f41f4 req-5bd41c24-a0ad-40a7-aa2f-778d892ef5ba service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:10:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-e678479d-c7c6-4d88-96f9-7e824b9f41f4 req-5bd41c24-a0ad-40a7-aa2f-778d892ef5ba service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] No waiting events found dispatching network-vif-unplugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:10:44 user nova-compute[74669]: WARNING nova.compute.manager [req-e678479d-c7c6-4d88-96f9-7e824b9f41f4 req-5bd41c24-a0ad-40a7-aa2f-778d892ef5ba service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received unexpected event network-vif-unplugged-d0dc10aa-3fca-4242-8895-241190da8780 for instance with vm_state active and task_state powering-off.
Nov 08 17:10:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:45 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Instance destroyed successfully.
Nov 08 17:10:45 user nova-compute[74669]: DEBUG nova.compute.manager [None req-cc264602-c02e-4946-9621-6a361e811a0c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:10:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-cc264602-c02e-4946-9621-6a361e811a0c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.863s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:10:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-00de98e5-1912-41a4-b4bf-8e00d456b794 req-e8e5a641-9af7-459e-9510-b7928c716e48 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received event network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:10:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-00de98e5-1912-41a4-b4bf-8e00d456b794 req-e8e5a641-9af7-459e-9510-b7928c716e48 service nova] Acquiring lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:10:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-00de98e5-1912-41a4-b4bf-8e00d456b794 req-e8e5a641-9af7-459e-9510-b7928c716e48 service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:10:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-00de98e5-1912-41a4-b4bf-8e00d456b794 req-e8e5a641-9af7-459e-9510-b7928c716e48 service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:10:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-00de98e5-1912-41a4-b4bf-8e00d456b794 req-e8e5a641-9af7-459e-9510-b7928c716e48 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] No waiting events found dispatching network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:10:47 user nova-compute[74669]: WARNING nova.compute.manager [req-00de98e5-1912-41a4-b4bf-8e00d456b794 req-e8e5a641-9af7-459e-9510-b7928c716e48 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received unexpected event network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 for instance with vm_state stopped and task_state None.
Nov 08 17:10:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:55 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:10:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:58 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:10:58 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:10:58 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:10:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:10:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:10:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:10:58 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:10:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:10:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:10:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:10:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:11:01 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:11:01 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:11:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8160MB free_disk=25.314300537109375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:11:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7b335462-0d93-4899-a223-5c2e36932578 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:11:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance af8b58ff-90d5-4a04-844a-ac0534a7e413 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:11:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance dff7cbf2-497a-4a27-a0b1-2e97f1391090 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:11:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2158a7c2-2f46-4bce-8558-4347a48623d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:11:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 746bdbac-3e36-4a08-989a-c004634890f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:11:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 3754330e-8b41-4e69-93f9-508ef5adf772 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:11:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:11:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:11:01 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:11:01 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:11:01 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:11:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.344s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:03 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:11:03 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:11:03 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:11:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-dff7cbf2-497a-4a27-a0b1-2e97f1391090" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:11:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-dff7cbf2-497a-4a27-a0b1-2e97f1391090" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:11:04 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:11:04 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Updating instance_info_cache with network_info: [{"id": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "address": "fa:16:3e:6d:12:7d", "network": {"id": "03c29fa9-39a4-4633-8c7e-1c69b147193a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276510167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a409449798dc4b25acdd09d4930a8b28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf75b32-76", "ovs_interfaceid": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:11:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-dff7cbf2-497a-4a27-a0b1-2e97f1391090" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:11:04 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:11:04 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:11:04 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:11:04 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:11:04 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:11:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:11:06 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:11:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:11:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Acquiring lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Acquiring lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:24 user nova-compute[74669]: INFO nova.compute.manager [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Terminating instance
Nov 08 17:11:24 user nova-compute[74669]: DEBUG nova.compute.manager [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG nova.compute.manager [req-4bfbff16-b7a5-4444-824e-ac3b49a4bdc0 req-ef894827-29ac-4e7e-aba0-fb925a896558 service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Received event network-vif-unplugged-adf75b32-76fa-4ce3-b1bd-2a6170848b58 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4bfbff16-b7a5-4444-824e-ac3b49a4bdc0 req-ef894827-29ac-4e7e-aba0-fb925a896558 service nova] Acquiring lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4bfbff16-b7a5-4444-824e-ac3b49a4bdc0 req-ef894827-29ac-4e7e-aba0-fb925a896558 service nova] Lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4bfbff16-b7a5-4444-824e-ac3b49a4bdc0 req-ef894827-29ac-4e7e-aba0-fb925a896558 service nova] Lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG nova.compute.manager [req-4bfbff16-b7a5-4444-824e-ac3b49a4bdc0 req-ef894827-29ac-4e7e-aba0-fb925a896558 service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] No waiting events found dispatching network-vif-unplugged-adf75b32-76fa-4ce3-b1bd-2a6170848b58 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG nova.compute.manager [req-4bfbff16-b7a5-4444-824e-ac3b49a4bdc0 req-ef894827-29ac-4e7e-aba0-fb925a896558 service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Received event network-vif-unplugged-adf75b32-76fa-4ce3-b1bd-2a6170848b58 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:11:24 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Instance destroyed successfully.
Nov 08 17:11:24 user nova-compute[74669]: DEBUG nova.objects.instance [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lazy-loading 'resources' on Instance uuid dff7cbf2-497a-4a27-a0b1-2e97f1391090 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1971736995',display_name='tempest-SnapshotDataIntegrityTests-server-1971736995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1971736995',id=27,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMn768SphUSH6G7QsOgDlSrxumlFf8fMJDoxiOJZTlQPHXhl1ec1Nn4fpL5e2hlp1naGSgzb3bbqX7IHdk0MwpqFRFnx4ycPiV6D829LLGvtfn2kDU1fRgnawcNtLaFQjQ==',key_name='tempest-keypair-604512327',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:06:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a409449798dc4b25acdd09d4930a8b28',ramdisk_id='',reservation_id='r-lc2y4955',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-714924060',owner_user_name='tempest-SnapshotDataIntegrityTests-714924060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:06:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4579628656354f278a6cc2e79b062025',uuid=dff7cbf2-497a-4a27-a0b1-2e97f1391090,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "address": "fa:16:3e:6d:12:7d", "network": {"id": "03c29fa9-39a4-4633-8c7e-1c69b147193a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276510167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a409449798dc4b25acdd09d4930a8b28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf75b32-76", "ovs_interfaceid": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Converting VIF {"id": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "address": "fa:16:3e:6d:12:7d", "network": {"id": "03c29fa9-39a4-4633-8c7e-1c69b147193a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-276510167-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a409449798dc4b25acdd09d4930a8b28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadf75b32-76", "ovs_interfaceid": "adf75b32-76fa-4ce3-b1bd-2a6170848b58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:12:7d,bridge_name='br-int',has_traffic_filtering=True,id=adf75b32-76fa-4ce3-b1bd-2a6170848b58,network=Network(03c29fa9-39a4-4633-8c7e-1c69b147193a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadf75b32-76') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG os_vif [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:12:7d,bridge_name='br-int',has_traffic_filtering=True,id=adf75b32-76fa-4ce3-b1bd-2a6170848b58,network=Network(03c29fa9-39a4-4633-8c7e-1c69b147193a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadf75b32-76') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadf75b32-76, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64addedf-4f8d-4ef7-b6c9-653ef2577f73) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:11:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:24 user nova-compute[74669]: INFO os_vif [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:12:7d,bridge_name='br-int',has_traffic_filtering=True,id=adf75b32-76fa-4ce3-b1bd-2a6170848b58,network=Network(03c29fa9-39a4-4633-8c7e-1c69b147193a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadf75b32-76')
Nov 08 17:11:24 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Deleting instance files /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090_del
Nov 08 17:11:24 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Deletion of /opt/stack/data/nova/instances/dff7cbf2-497a-4a27-a0b1-2e97f1391090_del complete
Nov 08 17:11:25 user nova-compute[74669]: INFO nova.compute.manager [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 08 17:11:25 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:11:25 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:11:25 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:11:25 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:11:25 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Took 0.95 seconds to deallocate network for instance.
Nov 08 17:11:25 user nova-compute[74669]: DEBUG nova.compute.manager [req-5c05be15-3027-4755-af6e-381a9ce4c90d req-7237c16f-60e0-47de-a10b-a46349812ecf service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Received event network-vif-deleted-adf75b32-76fa-4ce3-b1bd-2a6170848b58 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:11:25 user nova-compute[74669]: INFO nova.compute.manager [req-5c05be15-3027-4755-af6e-381a9ce4c90d req-7237c16f-60e0-47de-a10b-a46349812ecf service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Neutron deleted interface adf75b32-76fa-4ce3-b1bd-2a6170848b58; detaching it from the instance and deleting it from the info cache
Nov 08 17:11:25 user nova-compute[74669]: DEBUG nova.network.neutron [req-5c05be15-3027-4755-af6e-381a9ce4c90d req-7237c16f-60e0-47de-a10b-a46349812ecf service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:11:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-5c05be15-3027-4755-af6e-381a9ce4c90d req-7237c16f-60e0-47de-a10b-a46349812ecf service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Detach interface failed, port_id=adf75b32-76fa-4ce3-b1bd-2a6170848b58, reason: Instance dff7cbf2-497a-4a27-a0b1-2e97f1391090 could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 17:11:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:26 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:11:26 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:11:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:26 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Deleted allocations for instance dff7cbf2-497a-4a27-a0b1-2e97f1391090
Nov 08 17:11:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-65e5f8ab-f45b-47db-bd76-ceab66c71e69 tempest-SnapshotDataIntegrityTests-714924060 tempest-SnapshotDataIntegrityTests-714924060-project-member] Lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.311s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-5130f83e-f7a1-4501-9c03-56c0ee76ca98 req-6515df78-b304-4257-aacd-a6be55ec2d89 service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Received event network-vif-plugged-adf75b32-76fa-4ce3-b1bd-2a6170848b58 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:11:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5130f83e-f7a1-4501-9c03-56c0ee76ca98 req-6515df78-b304-4257-aacd-a6be55ec2d89 service nova] Acquiring lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5130f83e-f7a1-4501-9c03-56c0ee76ca98 req-6515df78-b304-4257-aacd-a6be55ec2d89 service nova] Lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5130f83e-f7a1-4501-9c03-56c0ee76ca98 req-6515df78-b304-4257-aacd-a6be55ec2d89 service nova] Lock "dff7cbf2-497a-4a27-a0b1-2e97f1391090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-5130f83e-f7a1-4501-9c03-56c0ee76ca98 req-6515df78-b304-4257-aacd-a6be55ec2d89 service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] No waiting events found dispatching network-vif-plugged-adf75b32-76fa-4ce3-b1bd-2a6170848b58 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:11:26 user nova-compute[74669]: WARNING nova.compute.manager [req-5130f83e-f7a1-4501-9c03-56c0ee76ca98 req-6515df78-b304-4257-aacd-a6be55ec2d89 service nova] [instance: dff7cbf2-497a-4a27-a0b1-2e97f1391090] Received unexpected event network-vif-plugged-adf75b32-76fa-4ce3-b1bd-2a6170848b58 for instance with vm_state deleted and task_state None.
Nov 08 17:11:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:11:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Acquiring lock "efe10edb-fda0-4a16-8cf4-faf7d6d8c93f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "efe10edb-fda0-4a16-8cf4-faf7d6d8c93f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:37 user nova-compute[74669]: DEBUG nova.compute.manager [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:11:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:37 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:11:37 user nova-compute[74669]: INFO nova.compute.claims [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Claim successful on node user
Nov 08 17:11:37 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:11:37 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:11:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:37 user nova-compute[74669]: DEBUG nova.compute.manager [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:11:37 user nova-compute[74669]: DEBUG nova.compute.manager [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:11:37 user nova-compute[74669]: DEBUG nova.network.neutron [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:11:37 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:11:37 user nova-compute[74669]: DEBUG nova.compute.manager [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:11:37 user nova-compute[74669]: DEBUG nova.policy [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3b60e9d47ab49f8bd3614621e2bd890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae1a781163a345dc8be717e3e7c73788', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:11:37 user nova-compute[74669]: DEBUG nova.compute.manager [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:11:37 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:11:37 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Creating image(s)
Nov 08 17:11:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Acquiring lock "/opt/stack/data/nova/instances/efe10edb-fda0-4a16-8cf4-faf7d6d8c93f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "/opt/stack/data/nova/instances/efe10edb-fda0-4a16-8cf4-faf7d6d8c93f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "/opt/stack/data/nova/instances/efe10edb-fda0-4a16-8cf4-faf7d6d8c93f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.169s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.192s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/efe10edb-fda0-4a16-8cf4-faf7d6d8c93f/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/efe10edb-fda0-4a16-8cf4-faf7d6d8c93f/disk 1073741824" returned: 0 in 0.053s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG nova.network.neutron [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Successfully created port: f8dc2550-66e7-4d47-9ea3-bd2afe97a056 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Checking if we can resize image /opt/stack/data/nova/instances/efe10edb-fda0-4a16-8cf4-faf7d6d8c93f/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe10edb-fda0-4a16-8cf4-faf7d6d8c93f/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe10edb-fda0-4a16-8cf4-faf7d6d8c93f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Cannot resize image /opt/stack/data/nova/instances/efe10edb-fda0-4a16-8cf4-faf7d6d8c93f/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Ensure instance console log exists: /opt/stack/data/nova/instances/efe10edb-fda0-4a16-8cf4-faf7d6d8c93f/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "e33217d2-fd96-49fb-9727-faeb76f0e219" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "e33217d2-fd96-49fb-9727-faeb76f0e219" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:11:38 user nova-compute[74669]: INFO nova.compute.claims [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Claim successful on node user
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.network.neutron [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Successfully updated port: f8dc2550-66e7-4d47-9ea3-bd2afe97a056 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Acquiring lock "refresh_cache-efe10edb-fda0-4a16-8cf4-faf7d6d8c93f" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Acquired lock "refresh_cache-efe10edb-fda0-4a16-8cf4-faf7d6d8c93f" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.network.neutron [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.compute.manager [req-f7088925-0c10-4dc5-b525-8cddfc40cf76 req-b70749cb-e73e-4074-b93a-dd2a79df784a service nova] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Received event network-changed-f8dc2550-66e7-4d47-9ea3-bd2afe97a056 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.compute.manager [req-f7088925-0c10-4dc5-b525-8cddfc40cf76 req-b70749cb-e73e-4074-b93a-dd2a79df784a service nova] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Refreshing instance network info cache due to event network-changed-f8dc2550-66e7-4d47-9ea3-bd2afe97a056. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f7088925-0c10-4dc5-b525-8cddfc40cf76 req-b70749cb-e73e-4074-b93a-dd2a79df784a service nova] Acquiring lock "refresh_cache-efe10edb-fda0-4a16-8cf4-faf7d6d8c93f" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.network.neutron [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.network.neutron [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:11:39 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.network.neutron [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Updating instance_info_cache with network_info: [{"id": "f8dc2550-66e7-4d47-9ea3-bd2afe97a056", "address": "fa:16:3e:56:09:cb", "network": {"id": "52bf51f6-cf7e-403b-b601-0660b9c8544f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-17276515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1a781163a345dc8be717e3e7c73788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc2550-66", "ovs_interfaceid": "f8dc2550-66e7-4d47-9ea3-bd2afe97a056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.policy [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64378f1b06c14150b824b1c29a5430fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7557a75c804d1da4c2d6fea8364f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Releasing lock "refresh_cache-efe10edb-fda0-4a16-8cf4-faf7d6d8c93f" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Instance network_info: |[{"id": "f8dc2550-66e7-4d47-9ea3-bd2afe97a056", "address": "fa:16:3e:56:09:cb", "network": {"id": "52bf51f6-cf7e-403b-b601-0660b9c8544f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-17276515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1a781163a345dc8be717e3e7c73788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc2550-66", "ovs_interfaceid": "f8dc2550-66e7-4d47-9ea3-bd2afe97a056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f7088925-0c10-4dc5-b525-8cddfc40cf76 req-b70749cb-e73e-4074-b93a-dd2a79df784a service nova] Acquired lock "refresh_cache-efe10edb-fda0-4a16-8cf4-faf7d6d8c93f" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.network.neutron [req-f7088925-0c10-4dc5-b525-8cddfc40cf76 req-b70749cb-e73e-4074-b93a-dd2a79df784a service nova] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Refreshing network info cache for port f8dc2550-66e7-4d47-9ea3-bd2afe97a056 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Start _get_guest_xml network_info=[{"id": "f8dc2550-66e7-4d47-9ea3-bd2afe97a056", "address": "fa:16:3e:56:09:cb", "network": {"id": "52bf51f6-cf7e-403b-b601-0660b9c8544f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-17276515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1a781163a345dc8be717e3e7c73788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc2550-66", "ovs_interfaceid": "f8dc2550-66e7-4d47-9ea3-bd2afe97a056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:11:39 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:11:39 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:11:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1861934215',display_name='tempest-ServersNegativeTestJSON-server-1861934215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1861934215',id=32,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae1a781163a345dc8be717e3e7c73788',ramdisk_id='',reservation_id='r-wa8kabbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1017043905',owner_user_name='tempest-ServersNegativeTestJSON-1017043905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:11:38Z,user_data=None,user_id='a3b60e9d47ab49f8bd3614621e2bd890',uuid=efe10edb-fda0-4a16-8cf4-faf7d6d8c93f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8dc2550-66e7-4d47-9ea3-bd2afe97a056", "address": "fa:16:3e:56:09:cb", "network": {"id": "52bf51f6-cf7e-403b-b601-0660b9c8544f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-17276515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1a781163a345dc8be717e3e7c73788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc2550-66", "ovs_interfaceid": "f8dc2550-66e7-4d47-9ea3-bd2afe97a056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Converting VIF {"id": "f8dc2550-66e7-4d47-9ea3-bd2afe97a056", "address": "fa:16:3e:56:09:cb", "network": {"id": "52bf51f6-cf7e-403b-b601-0660b9c8544f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-17276515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1a781163a345dc8be717e3e7c73788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc2550-66", "ovs_interfaceid": "f8dc2550-66e7-4d47-9ea3-bd2afe97a056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:09:cb,bridge_name='br-int',has_traffic_filtering=True,id=f8dc2550-66e7-4d47-9ea3-bd2afe97a056,network=Network(52bf51f6-cf7e-403b-b601-0660b9c8544f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8dc2550-66') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.objects.instance [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lazy-loading 'pci_devices' on Instance uuid efe10edb-fda0-4a16-8cf4-faf7d6d8c93f {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:11:39 user nova-compute[74669]:   <uuid>efe10edb-fda0-4a16-8cf4-faf7d6d8c93f</uuid>
Nov 08 17:11:39 user nova-compute[74669]:   <name>instance-00000020</name>
Nov 08 17:11:39 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:11:39 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:11:39 user nova-compute[74669]:   <metadata>
Nov 08 17:11:39 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:11:39 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:11:39 user nova-compute[74669]:       <nova:name>tempest-ServersNegativeTestJSON-server-1861934215</nova:name>
Nov 08 17:11:39 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:11:39</nova:creationTime>
Nov 08 17:11:39 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:11:39 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:11:39 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:11:39 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:11:39 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:11:39 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:11:39 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:11:39 user nova-compute[74669]:       <nova:owner>
Nov 08 17:11:39 user nova-compute[74669]:         <nova:user uuid="a3b60e9d47ab49f8bd3614621e2bd890">tempest-ServersNegativeTestJSON-1017043905-project-member</nova:user>
Nov 08 17:11:39 user nova-compute[74669]:         <nova:project uuid="ae1a781163a345dc8be717e3e7c73788">tempest-ServersNegativeTestJSON-1017043905</nova:project>
Nov 08 17:11:39 user nova-compute[74669]:       </nova:owner>
Nov 08 17:11:39 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:11:39 user nova-compute[74669]:       <nova:ports>
Nov 08 17:11:39 user nova-compute[74669]:         <nova:port uuid="f8dc2550-66e7-4d47-9ea3-bd2afe97a056">
Nov 08 17:11:39 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 17:11:39 user nova-compute[74669]:         </nova:port>
Nov 08 17:11:39 user nova-compute[74669]:       </nova:ports>
Nov 08 17:11:39 user nova-compute[74669]:     </nova:instance>
Nov 08 17:11:39 user nova-compute[74669]:   </metadata>
Nov 08 17:11:39 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:11:39 user nova-compute[74669]:     <system>
Nov 08 17:11:39 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:11:39 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:11:39 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:11:39 user nova-compute[74669]:       <entry name="serial">efe10edb-fda0-4a16-8cf4-faf7d6d8c93f</entry>
Nov 08 17:11:39 user nova-compute[74669]:       <entry name="uuid">efe10edb-fda0-4a16-8cf4-faf7d6d8c93f</entry>
Nov 08 17:11:39 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:11:39 user nova-compute[74669]:     </system>
Nov 08 17:11:39 user nova-compute[74669]:   </sysinfo>
Nov 08 17:11:39 user nova-compute[74669]:   <os>
Nov 08 17:11:39 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:11:39 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:11:39 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:11:39 user nova-compute[74669]:   </os>
Nov 08 17:11:39 user nova-compute[74669]:   <features>
Nov 08 17:11:39 user nova-compute[74669]:     <acpi/>
Nov 08 17:11:39 user nova-compute[74669]:     <apic/>
Nov 08 17:11:39 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:11:39 user nova-compute[74669]:   </features>
Nov 08 17:11:39 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:11:39 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:11:39 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:11:39 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:11:39 user nova-compute[74669]:   </clock>
Nov 08 17:11:39 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:11:39 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:11:39 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:11:39 user nova-compute[74669]:   </cpu>
Nov 08 17:11:39 user nova-compute[74669]:   <devices>
Nov 08 17:11:39 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:11:39 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:11:39 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/efe10edb-fda0-4a16-8cf4-faf7d6d8c93f/disk"/>
Nov 08 17:11:39 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:11:39 user nova-compute[74669]:     </disk>
Nov 08 17:11:39 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:11:39 user nova-compute[74669]:       <mac address="fa:16:3e:56:09:cb"/>
Nov 08 17:11:39 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:11:39 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:11:39 user nova-compute[74669]:       <target dev="tapf8dc2550-66"/>
Nov 08 17:11:39 user nova-compute[74669]:     </interface>
Nov 08 17:11:39 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:11:39 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/efe10edb-fda0-4a16-8cf4-faf7d6d8c93f/console.log" append="off"/>
Nov 08 17:11:39 user nova-compute[74669]:     </serial>
Nov 08 17:11:39 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:11:39 user nova-compute[74669]:     <video>
Nov 08 17:11:39 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:11:39 user nova-compute[74669]:     </video>
Nov 08 17:11:39 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:11:39 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:11:39 user nova-compute[74669]:     </rng>
Nov 08 17:11:39 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:11:39 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:11:39 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:11:39 user nova-compute[74669]:     </memballoon>
Nov 08 17:11:39 user nova-compute[74669]:   </devices>
Nov 08 17:11:39 user nova-compute[74669]: </domain>
Nov 08 17:11:39 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:11:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1861934215',display_name='tempest-ServersNegativeTestJSON-server-1861934215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1861934215',id=32,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae1a781163a345dc8be717e3e7c73788',ramdisk_id='',reservation_id='r-wa8kabbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1017043905',owner_user_name='tempest-ServersNegativeTestJSON-1017043905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:11:38Z,user_data=None,user_id='a3b60e9d47ab49f8bd3614621e2bd890',uuid=efe10edb-fda0-4a16-8cf4-faf7d6d8c93f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8dc2550-66e7-4d47-9ea3-bd2afe97a056", "address": "fa:16:3e:56:09:cb", "network": {"id": "52bf51f6-cf7e-403b-b601-0660b9c8544f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-17276515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1a781163a345dc8be717e3e7c73788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc2550-66", "ovs_interfaceid": "f8dc2550-66e7-4d47-9ea3-bd2afe97a056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Converting VIF {"id": "f8dc2550-66e7-4d47-9ea3-bd2afe97a056", "address": "fa:16:3e:56:09:cb", "network": {"id": "52bf51f6-cf7e-403b-b601-0660b9c8544f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-17276515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1a781163a345dc8be717e3e7c73788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc2550-66", "ovs_interfaceid": "f8dc2550-66e7-4d47-9ea3-bd2afe97a056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:09:cb,bridge_name='br-int',has_traffic_filtering=True,id=f8dc2550-66e7-4d47-9ea3-bd2afe97a056,network=Network(52bf51f6-cf7e-403b-b601-0660b9c8544f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8dc2550-66') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG os_vif [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:09:cb,bridge_name='br-int',has_traffic_filtering=True,id=f8dc2550-66e7-4d47-9ea3-bd2afe97a056,network=Network(52bf51f6-cf7e-403b-b601-0660b9c8544f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8dc2550-66') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:11:39 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Creating image(s)
Nov 08 17:11:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "/opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "/opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "/opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4cce4e32-6a92-58cd-b5e4-c03d3b110f15', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8dc2550-66, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8dc2550-66, col_values=(('qos', UUID('f6b83c1d-6fd9-4e1b-87f9-78a478cadee3')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8dc2550-66, col_values=(('external_ids', {'iface-id': 'f8dc2550-66e7-4d47-9ea3-bd2afe97a056', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:09:cb', 'vm-uuid': 'efe10edb-fda0-4a16-8cf4-faf7d6d8c93f'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:39 user nova-compute[74669]: INFO os_vif [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:09:cb,bridge_name='br-int',has_traffic_filtering=True,id=f8dc2550-66e7-4d47-9ea3-bd2afe97a056,network=Network(52bf51f6-cf7e-403b-b601-0660b9c8544f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8dc2550-66')
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] No VIF found with MAC fa:16:3e:56:09:cb, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.191s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.network.neutron [req-f7088925-0c10-4dc5-b525-8cddfc40cf76 req-b70749cb-e73e-4074-b93a-dd2a79df784a service nova] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Updated VIF entry in instance network info cache for port f8dc2550-66e7-4d47-9ea3-bd2afe97a056. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG nova.network.neutron [req-f7088925-0c10-4dc5-b525-8cddfc40cf76 req-b70749cb-e73e-4074-b93a-dd2a79df784a service nova] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Updating instance_info_cache with network_info: [{"id": "f8dc2550-66e7-4d47-9ea3-bd2afe97a056", "address": "fa:16:3e:56:09:cb", "network": {"id": "52bf51f6-cf7e-403b-b601-0660b9c8544f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-17276515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1a781163a345dc8be717e3e7c73788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc2550-66", "ovs_interfaceid": "f8dc2550-66e7-4d47-9ea3-bd2afe97a056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f7088925-0c10-4dc5-b525-8cddfc40cf76 req-b70749cb-e73e-4074-b93a-dd2a79df784a service nova] Releasing lock "refresh_cache-efe10edb-fda0-4a16-8cf4-faf7d6d8c93f" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.168s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk 1073741824" returned: 0 in 0.049s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:39 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.network.neutron [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Successfully created port: 47ecb2d0-7388-4a1f-a5c1-a7090c790f36 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.203s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Cannot resize image /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Ensure instance console log exists: /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.network.neutron [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Successfully updated port: 47ecb2d0-7388-4a1f-a5c1-a7090c790f36 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "refresh_cache-e33217d2-fd96-49fb-9727-faeb76f0e219" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquired lock "refresh_cache-e33217d2-fd96-49fb-9727-faeb76f0e219" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.network.neutron [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-37181613-c3e0-4aca-b841-632741317a7e req-8d39b4cd-d750-4d37-a042-ac18be0b6aa6 service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Received event network-changed-47ecb2d0-7388-4a1f-a5c1-a7090c790f36 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-37181613-c3e0-4aca-b841-632741317a7e req-8d39b4cd-d750-4d37-a042-ac18be0b6aa6 service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Refreshing instance network info cache due to event network-changed-47ecb2d0-7388-4a1f-a5c1-a7090c790f36. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-37181613-c3e0-4aca-b841-632741317a7e req-8d39b4cd-d750-4d37-a042-ac18be0b6aa6 service nova] Acquiring lock "refresh_cache-e33217d2-fd96-49fb-9727-faeb76f0e219" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.network.neutron [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.network.neutron [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Updating instance_info_cache with network_info: [{"id": "47ecb2d0-7388-4a1f-a5c1-a7090c790f36", "address": "fa:16:3e:68:6f:55", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ecb2d0-73", "ovs_interfaceid": "47ecb2d0-7388-4a1f-a5c1-a7090c790f36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Releasing lock "refresh_cache-e33217d2-fd96-49fb-9727-faeb76f0e219" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.compute.manager [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Instance network_info: |[{"id": "47ecb2d0-7388-4a1f-a5c1-a7090c790f36", "address": "fa:16:3e:68:6f:55", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ecb2d0-73", "ovs_interfaceid": "47ecb2d0-7388-4a1f-a5c1-a7090c790f36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-37181613-c3e0-4aca-b841-632741317a7e req-8d39b4cd-d750-4d37-a042-ac18be0b6aa6 service nova] Acquired lock "refresh_cache-e33217d2-fd96-49fb-9727-faeb76f0e219" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.network.neutron [req-37181613-c3e0-4aca-b841-632741317a7e req-8d39b4cd-d750-4d37-a042-ac18be0b6aa6 service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Refreshing network info cache for port 47ecb2d0-7388-4a1f-a5c1-a7090c790f36 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Start _get_guest_xml network_info=[{"id": "47ecb2d0-7388-4a1f-a5c1-a7090c790f36", "address": "fa:16:3e:68:6f:55", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ecb2d0-73", "ovs_interfaceid": "47ecb2d0-7388-4a1f-a5c1-a7090c790f36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:11:40 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:11:40 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:11:40 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:11:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-948176804',display_name='tempest-VolumesSnapshotTestJSON-instance-948176804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-948176804',id=33,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyAiUwT66QRj+WXj1Ky7tKVlAzCdxQDPWXzuLhlIS5mu8LTRNEJLbjlE9DOF7TnK7wQ8BPM0EM1785HJo+sD0OUHXdCpZlFAmxzf2we2UxQZ8JOpHd80mUG1MP+fxsSnA==',key_name='tempest-keypair-1720310976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f7557a75c804d1da4c2d6fea8364f6d',ramdisk_id='',reservation_id='r-xwldbxrv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-600470725',owner_user_name='tempest-VolumesSnapshotTestJSON-600470725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64378f1b06c14150b824b1c29a5430fd',uuid=e33217d2-fd96-49fb-9727-faeb76f0e219,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47ecb2d0-7388-4a1f-a5c1-a7090c790f36", "address": "fa:16:3e:68:6f:55", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ecb2d0-73", "ovs_interfaceid": "47ecb2d0-7388-4a1f-a5c1-a7090c790f36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Converting VIF {"id": "47ecb2d0-7388-4a1f-a5c1-a7090c790f36", "address": "fa:16:3e:68:6f:55", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ecb2d0-73", "ovs_interfaceid": "47ecb2d0-7388-4a1f-a5c1-a7090c790f36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:6f:55,bridge_name='br-int',has_traffic_filtering=True,id=47ecb2d0-7388-4a1f-a5c1-a7090c790f36,network=Network(284f544e-dabf-4ae2-b70c-f8ce15736863),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ecb2d0-73') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG nova.objects.instance [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lazy-loading 'pci_devices' on Instance uuid e33217d2-fd96-49fb-9727-faeb76f0e219 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:11:41 user nova-compute[74669]:   <uuid>e33217d2-fd96-49fb-9727-faeb76f0e219</uuid>
Nov 08 17:11:41 user nova-compute[74669]:   <name>instance-00000021</name>
Nov 08 17:11:41 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:11:41 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:11:41 user nova-compute[74669]:   <metadata>
Nov 08 17:11:41 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:11:41 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:11:41 user nova-compute[74669]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-948176804</nova:name>
Nov 08 17:11:41 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:11:40</nova:creationTime>
Nov 08 17:11:41 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:11:41 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:11:41 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:11:41 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:11:41 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:11:41 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:11:41 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:11:41 user nova-compute[74669]:       <nova:owner>
Nov 08 17:11:41 user nova-compute[74669]:         <nova:user uuid="64378f1b06c14150b824b1c29a5430fd">tempest-VolumesSnapshotTestJSON-600470725-project-member</nova:user>
Nov 08 17:11:41 user nova-compute[74669]:         <nova:project uuid="3f7557a75c804d1da4c2d6fea8364f6d">tempest-VolumesSnapshotTestJSON-600470725</nova:project>
Nov 08 17:11:41 user nova-compute[74669]:       </nova:owner>
Nov 08 17:11:41 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:11:41 user nova-compute[74669]:       <nova:ports>
Nov 08 17:11:41 user nova-compute[74669]:         <nova:port uuid="47ecb2d0-7388-4a1f-a5c1-a7090c790f36">
Nov 08 17:11:41 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 17:11:41 user nova-compute[74669]:         </nova:port>
Nov 08 17:11:41 user nova-compute[74669]:       </nova:ports>
Nov 08 17:11:41 user nova-compute[74669]:     </nova:instance>
Nov 08 17:11:41 user nova-compute[74669]:   </metadata>
Nov 08 17:11:41 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:11:41 user nova-compute[74669]:     <system>
Nov 08 17:11:41 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:11:41 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:11:41 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:11:41 user nova-compute[74669]:       <entry name="serial">e33217d2-fd96-49fb-9727-faeb76f0e219</entry>
Nov 08 17:11:41 user nova-compute[74669]:       <entry name="uuid">e33217d2-fd96-49fb-9727-faeb76f0e219</entry>
Nov 08 17:11:41 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:11:41 user nova-compute[74669]:     </system>
Nov 08 17:11:41 user nova-compute[74669]:   </sysinfo>
Nov 08 17:11:41 user nova-compute[74669]:   <os>
Nov 08 17:11:41 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:11:41 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:11:41 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:11:41 user nova-compute[74669]:   </os>
Nov 08 17:11:41 user nova-compute[74669]:   <features>
Nov 08 17:11:41 user nova-compute[74669]:     <acpi/>
Nov 08 17:11:41 user nova-compute[74669]:     <apic/>
Nov 08 17:11:41 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:11:41 user nova-compute[74669]:   </features>
Nov 08 17:11:41 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:11:41 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:11:41 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:11:41 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:11:41 user nova-compute[74669]:   </clock>
Nov 08 17:11:41 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:11:41 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:11:41 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:11:41 user nova-compute[74669]:   </cpu>
Nov 08 17:11:41 user nova-compute[74669]:   <devices>
Nov 08 17:11:41 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:11:41 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:11:41 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk"/>
Nov 08 17:11:41 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:11:41 user nova-compute[74669]:     </disk>
Nov 08 17:11:41 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:11:41 user nova-compute[74669]:       <mac address="fa:16:3e:68:6f:55"/>
Nov 08 17:11:41 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:11:41 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:11:41 user nova-compute[74669]:       <target dev="tap47ecb2d0-73"/>
Nov 08 17:11:41 user nova-compute[74669]:     </interface>
Nov 08 17:11:41 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:11:41 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/console.log" append="off"/>
Nov 08 17:11:41 user nova-compute[74669]:     </serial>
Nov 08 17:11:41 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:11:41 user nova-compute[74669]:     <video>
Nov 08 17:11:41 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:11:41 user nova-compute[74669]:     </video>
Nov 08 17:11:41 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:11:41 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:11:41 user nova-compute[74669]:     </rng>
Nov 08 17:11:41 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:11:41 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:11:41 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:11:41 user nova-compute[74669]:     </memballoon>
Nov 08 17:11:41 user nova-compute[74669]:   </devices>
Nov 08 17:11:41 user nova-compute[74669]: </domain>
Nov 08 17:11:41 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:11:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-948176804',display_name='tempest-VolumesSnapshotTestJSON-instance-948176804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-948176804',id=33,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyAiUwT66QRj+WXj1Ky7tKVlAzCdxQDPWXzuLhlIS5mu8LTRNEJLbjlE9DOF7TnK7wQ8BPM0EM1785HJo+sD0OUHXdCpZlFAmxzf2we2UxQZ8JOpHd80mUG1MP+fxsSnA==',key_name='tempest-keypair-1720310976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f7557a75c804d1da4c2d6fea8364f6d',ramdisk_id='',reservation_id='r-xwldbxrv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-600470725',owner_user_name='tempest-VolumesSnapshotTestJSON-600470725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64378f1b06c14150b824b1c29a5430fd',uuid=e33217d2-fd96-49fb-9727-faeb76f0e219,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47ecb2d0-7388-4a1f-a5c1-a7090c790f36", "address": "fa:16:3e:68:6f:55", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ecb2d0-73", "ovs_interfaceid": "47ecb2d0-7388-4a1f-a5c1-a7090c790f36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Converting VIF {"id": "47ecb2d0-7388-4a1f-a5c1-a7090c790f36", "address": "fa:16:3e:68:6f:55", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ecb2d0-73", "ovs_interfaceid": "47ecb2d0-7388-4a1f-a5c1-a7090c790f36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:6f:55,bridge_name='br-int',has_traffic_filtering=True,id=47ecb2d0-7388-4a1f-a5c1-a7090c790f36,network=Network(284f544e-dabf-4ae2-b70c-f8ce15736863),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ecb2d0-73') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG os_vif [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:6f:55,bridge_name='br-int',has_traffic_filtering=True,id=47ecb2d0-7388-4a1f-a5c1-a7090c790f36,network=Network(284f544e-dabf-4ae2-b70c-f8ce15736863),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ecb2d0-73') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a33380c-2ff6-5b45-9671-ead39b7bfaca', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47ecb2d0-73, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47ecb2d0-73, col_values=(('qos', UUID('05ec808a-f915-4a26-996d-d97725dc928a')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47ecb2d0-73, col_values=(('external_ids', {'iface-id': '47ecb2d0-7388-4a1f-a5c1-a7090c790f36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:6f:55', 'vm-uuid': 'e33217d2-fd96-49fb-9727-faeb76f0e219'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:41 user nova-compute[74669]: INFO os_vif [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:6f:55,bridge_name='br-int',has_traffic_filtering=True,id=47ecb2d0-7388-4a1f-a5c1-a7090c790f36,network=Network(284f544e-dabf-4ae2-b70c-f8ce15736863),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ecb2d0-73')
Nov 08 17:11:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] No VIF found with MAC fa:16:3e:68:6f:55, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG nova.network.neutron [req-37181613-c3e0-4aca-b841-632741317a7e req-8d39b4cd-d750-4d37-a042-ac18be0b6aa6 service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Updated VIF entry in instance network info cache for port 47ecb2d0-7388-4a1f-a5c1-a7090c790f36. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG nova.network.neutron [req-37181613-c3e0-4aca-b841-632741317a7e req-8d39b4cd-d750-4d37-a042-ac18be0b6aa6 service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Updating instance_info_cache with network_info: [{"id": "47ecb2d0-7388-4a1f-a5c1-a7090c790f36", "address": "fa:16:3e:68:6f:55", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ecb2d0-73", "ovs_interfaceid": "47ecb2d0-7388-4a1f-a5c1-a7090c790f36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:11:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-37181613-c3e0-4aca-b841-632741317a7e req-8d39b4cd-d750-4d37-a042-ac18be0b6aa6 service nova] Releasing lock "refresh_cache-e33217d2-fd96-49fb-9727-faeb76f0e219" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:11:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-b1d8fba0-e109-4c5d-838b-e155155b3c25 req-1b30c421-2748-4cd3-8887-a0c9109e9e53 service nova] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Received event network-vif-plugged-f8dc2550-66e7-4d47-9ea3-bd2afe97a056 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:11:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b1d8fba0-e109-4c5d-838b-e155155b3c25 req-1b30c421-2748-4cd3-8887-a0c9109e9e53 service nova] Acquiring lock "efe10edb-fda0-4a16-8cf4-faf7d6d8c93f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b1d8fba0-e109-4c5d-838b-e155155b3c25 req-1b30c421-2748-4cd3-8887-a0c9109e9e53 service nova] Lock "efe10edb-fda0-4a16-8cf4-faf7d6d8c93f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b1d8fba0-e109-4c5d-838b-e155155b3c25 req-1b30c421-2748-4cd3-8887-a0c9109e9e53 service nova] Lock "efe10edb-fda0-4a16-8cf4-faf7d6d8c93f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-b1d8fba0-e109-4c5d-838b-e155155b3c25 req-1b30c421-2748-4cd3-8887-a0c9109e9e53 service nova] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] No waiting events found dispatching network-vif-plugged-f8dc2550-66e7-4d47-9ea3-bd2afe97a056 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:11:42 user nova-compute[74669]: WARNING nova.compute.manager [req-b1d8fba0-e109-4c5d-838b-e155155b3c25 req-1b30c421-2748-4cd3-8887-a0c9109e9e53 service nova] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Received unexpected event network-vif-plugged-f8dc2550-66e7-4d47-9ea3-bd2afe97a056 for instance with vm_state building and task_state spawning.
Nov 08 17:11:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-b1d8fba0-e109-4c5d-838b-e155155b3c25 req-1b30c421-2748-4cd3-8887-a0c9109e9e53 service nova] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Received event network-vif-plugged-f8dc2550-66e7-4d47-9ea3-bd2afe97a056 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:11:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b1d8fba0-e109-4c5d-838b-e155155b3c25 req-1b30c421-2748-4cd3-8887-a0c9109e9e53 service nova] Acquiring lock "efe10edb-fda0-4a16-8cf4-faf7d6d8c93f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b1d8fba0-e109-4c5d-838b-e155155b3c25 req-1b30c421-2748-4cd3-8887-a0c9109e9e53 service nova] Lock "efe10edb-fda0-4a16-8cf4-faf7d6d8c93f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b1d8fba0-e109-4c5d-838b-e155155b3c25 req-1b30c421-2748-4cd3-8887-a0c9109e9e53 service nova] Lock "efe10edb-fda0-4a16-8cf4-faf7d6d8c93f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-b1d8fba0-e109-4c5d-838b-e155155b3c25 req-1b30c421-2748-4cd3-8887-a0c9109e9e53 service nova] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] No waiting events found dispatching network-vif-plugged-f8dc2550-66e7-4d47-9ea3-bd2afe97a056 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:11:42 user nova-compute[74669]: WARNING nova.compute.manager [req-b1d8fba0-e109-4c5d-838b-e155155b3c25 req-1b30c421-2748-4cd3-8887-a0c9109e9e53 service nova] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Received unexpected event network-vif-plugged-f8dc2550-66e7-4d47-9ea3-bd2afe97a056 for instance with vm_state building and task_state spawning.
Nov 08 17:11:43 user nova-compute[74669]: DEBUG nova.compute.manager [req-2e551b6f-600d-47c5-8ea4-080497a75ce6 req-550ad818-40ec-45d2-af12-c7ad72a1ad36 service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Received event network-vif-plugged-47ecb2d0-7388-4a1f-a5c1-a7090c790f36 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:11:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2e551b6f-600d-47c5-8ea4-080497a75ce6 req-550ad818-40ec-45d2-af12-c7ad72a1ad36 service nova] Acquiring lock "e33217d2-fd96-49fb-9727-faeb76f0e219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2e551b6f-600d-47c5-8ea4-080497a75ce6 req-550ad818-40ec-45d2-af12-c7ad72a1ad36 service nova] Lock "e33217d2-fd96-49fb-9727-faeb76f0e219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2e551b6f-600d-47c5-8ea4-080497a75ce6 req-550ad818-40ec-45d2-af12-c7ad72a1ad36 service nova] Lock "e33217d2-fd96-49fb-9727-faeb76f0e219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:43 user nova-compute[74669]: DEBUG nova.compute.manager [req-2e551b6f-600d-47c5-8ea4-080497a75ce6 req-550ad818-40ec-45d2-af12-c7ad72a1ad36 service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] No waiting events found dispatching network-vif-plugged-47ecb2d0-7388-4a1f-a5c1-a7090c790f36 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:11:43 user nova-compute[74669]: WARNING nova.compute.manager [req-2e551b6f-600d-47c5-8ea4-080497a75ce6 req-550ad818-40ec-45d2-af12-c7ad72a1ad36 service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Received unexpected event network-vif-plugged-47ecb2d0-7388-4a1f-a5c1-a7090c790f36 for instance with vm_state building and task_state spawning.
Nov 08 17:11:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:44 user nova-compute[74669]: DEBUG nova.compute.manager [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:11:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:11:44 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Instance spawned successfully.
Nov 08 17:11:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:11:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:11:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:11:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:11:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:11:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:11:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:11:44 user nova-compute[74669]: INFO nova.compute.manager [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Took 6.72 seconds to spawn the instance on the hypervisor.
Nov 08 17:11:44 user nova-compute[74669]: DEBUG nova.compute.manager [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:11:44 user nova-compute[74669]: INFO nova.compute.manager [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Took 7.33 seconds to build instance.
Nov 08 17:11:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b01dd17c-9fed-44dc-9095-09afe3f233e2 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "efe10edb-fda0-4a16-8cf4-faf7d6d8c93f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.418s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:44 user nova-compute[74669]: DEBUG nova.compute.manager [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:11:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:11:44 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Instance spawned successfully.
Nov 08 17:11:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:11:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:11:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:11:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:11:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:11:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:11:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:11:45 user nova-compute[74669]: INFO nova.compute.manager [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 08 17:11:45 user nova-compute[74669]: DEBUG nova.compute.manager [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:11:45 user nova-compute[74669]: DEBUG nova.compute.manager [req-e81a6a66-0237-458d-9d2c-c869bf4ce0f7 req-6a2f1501-ebd8-4c43-8d2f-1d9f560f5486 service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Received event network-vif-plugged-47ecb2d0-7388-4a1f-a5c1-a7090c790f36 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:11:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e81a6a66-0237-458d-9d2c-c869bf4ce0f7 req-6a2f1501-ebd8-4c43-8d2f-1d9f560f5486 service nova] Acquiring lock "e33217d2-fd96-49fb-9727-faeb76f0e219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e81a6a66-0237-458d-9d2c-c869bf4ce0f7 req-6a2f1501-ebd8-4c43-8d2f-1d9f560f5486 service nova] Lock "e33217d2-fd96-49fb-9727-faeb76f0e219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e81a6a66-0237-458d-9d2c-c869bf4ce0f7 req-6a2f1501-ebd8-4c43-8d2f-1d9f560f5486 service nova] Lock "e33217d2-fd96-49fb-9727-faeb76f0e219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:45 user nova-compute[74669]: DEBUG nova.compute.manager [req-e81a6a66-0237-458d-9d2c-c869bf4ce0f7 req-6a2f1501-ebd8-4c43-8d2f-1d9f560f5486 service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] No waiting events found dispatching network-vif-plugged-47ecb2d0-7388-4a1f-a5c1-a7090c790f36 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:11:45 user nova-compute[74669]: WARNING nova.compute.manager [req-e81a6a66-0237-458d-9d2c-c869bf4ce0f7 req-6a2f1501-ebd8-4c43-8d2f-1d9f560f5486 service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Received unexpected event network-vif-plugged-47ecb2d0-7388-4a1f-a5c1-a7090c790f36 for instance with vm_state building and task_state spawning.
Nov 08 17:11:45 user nova-compute[74669]: INFO nova.compute.manager [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Took 6.26 seconds to build instance.
Nov 08 17:11:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-634cde86-8ad8-4c81-b9c5-ccf78b81e051 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "e33217d2-fd96-49fb-9727-faeb76f0e219" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.363s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-de7c4e9d-f97c-4e02-bd7a-549dbfebe67d req-d9c2a44d-f3f4-47bd-a7b3-d7534cf2e66c service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Received event network-changed-9bfc353f-1fb9-412e-80c7-64b5a2ecc32c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:11:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-de7c4e9d-f97c-4e02-bd7a-549dbfebe67d req-d9c2a44d-f3f4-47bd-a7b3-d7534cf2e66c service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Refreshing instance network info cache due to event network-changed-9bfc353f-1fb9-412e-80c7-64b5a2ecc32c. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:11:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-de7c4e9d-f97c-4e02-bd7a-549dbfebe67d req-d9c2a44d-f3f4-47bd-a7b3-d7534cf2e66c service nova] Acquiring lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:11:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-de7c4e9d-f97c-4e02-bd7a-549dbfebe67d req-d9c2a44d-f3f4-47bd-a7b3-d7534cf2e66c service nova] Acquired lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:11:48 user nova-compute[74669]: DEBUG nova.network.neutron [req-de7c4e9d-f97c-4e02-bd7a-549dbfebe67d req-d9c2a44d-f3f4-47bd-a7b3-d7534cf2e66c service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Refreshing network info cache for port 9bfc353f-1fb9-412e-80c7-64b5a2ecc32c {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:11:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:49 user nova-compute[74669]: DEBUG nova.network.neutron [req-de7c4e9d-f97c-4e02-bd7a-549dbfebe67d req-d9c2a44d-f3f4-47bd-a7b3-d7534cf2e66c service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Updated VIF entry in instance network info cache for port 9bfc353f-1fb9-412e-80c7-64b5a2ecc32c. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:11:49 user nova-compute[74669]: DEBUG nova.network.neutron [req-de7c4e9d-f97c-4e02-bd7a-549dbfebe67d req-d9c2a44d-f3f4-47bd-a7b3-d7534cf2e66c service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Updating instance_info_cache with network_info: [{"id": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "address": "fa:16:3e:e6:99:99", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bfc353f-1f", "ovs_interfaceid": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:11:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-de7c4e9d-f97c-4e02-bd7a-549dbfebe67d req-d9c2a44d-f3f4-47bd-a7b3-d7534cf2e66c service nova] Releasing lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:11:50 user nova-compute[74669]: DEBUG nova.compute.manager [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Stashing vm_state: active {{(pid=74669) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 08 17:11:50 user nova-compute[74669]: DEBUG nova.compute.manager [req-2b26378f-96ec-4fe9-9904-2e5129e55d09 req-9861b373-e762-4430-8396-7c4c8e593ee3 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Received event network-changed-f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:11:50 user nova-compute[74669]: DEBUG nova.compute.manager [req-2b26378f-96ec-4fe9-9904-2e5129e55d09 req-9861b373-e762-4430-8396-7c4c8e593ee3 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Refreshing instance network info cache due to event network-changed-f33d0612-bda7-41c8-ba61-d965030f2304. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:11:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2b26378f-96ec-4fe9-9904-2e5129e55d09 req-9861b373-e762-4430-8396-7c4c8e593ee3 service nova] Acquiring lock "refresh_cache-746bdbac-3e36-4a08-989a-c004634890f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:11:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2b26378f-96ec-4fe9-9904-2e5129e55d09 req-9861b373-e762-4430-8396-7c4c8e593ee3 service nova] Acquired lock "refresh_cache-746bdbac-3e36-4a08-989a-c004634890f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:11:50 user nova-compute[74669]: DEBUG nova.network.neutron [req-2b26378f-96ec-4fe9-9904-2e5129e55d09 req-9861b373-e762-4430-8396-7c4c8e593ee3 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Refreshing network info cache for port f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:11:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:50 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:11:50 user nova-compute[74669]: INFO nova.compute.claims [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Claim successful on node user
Nov 08 17:11:50 user nova-compute[74669]: INFO nova.compute.resource_tracker [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Updating resource usage from migration 18964ccc-62a7-41dd-ae99-01443023dc5f
Nov 08 17:11:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:51 user nova-compute[74669]: DEBUG nova.network.neutron [req-2b26378f-96ec-4fe9-9904-2e5129e55d09 req-9861b373-e762-4430-8396-7c4c8e593ee3 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Updated VIF entry in instance network info cache for port f33d0612-bda7-41c8-ba61-d965030f2304. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:11:51 user nova-compute[74669]: DEBUG nova.network.neutron [req-2b26378f-96ec-4fe9-9904-2e5129e55d09 req-9861b373-e762-4430-8396-7c4c8e593ee3 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Updating instance_info_cache with network_info: [{"id": "f33d0612-bda7-41c8-ba61-d965030f2304", "address": "fa:16:3e:55:1b:72", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33d0612-bd", "ovs_interfaceid": "f33d0612-bda7-41c8-ba61-d965030f2304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:11:51 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:11:51 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:11:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2b26378f-96ec-4fe9-9904-2e5129e55d09 req-9861b373-e762-4430-8396-7c4c8e593ee3 service nova] Releasing lock "refresh_cache-746bdbac-3e36-4a08-989a-c004634890f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:11:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.626s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:51 user nova-compute[74669]: INFO nova.compute.manager [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Migrating
Nov 08 17:11:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "refresh_cache-746bdbac-3e36-4a08-989a-c004634890f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:11:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquired lock "refresh_cache-746bdbac-3e36-4a08-989a-c004634890f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:11:51 user nova-compute[74669]: DEBUG nova.network.neutron [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:11:51 user nova-compute[74669]: DEBUG nova.network.neutron [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Updating instance_info_cache with network_info: [{"id": "f33d0612-bda7-41c8-ba61-d965030f2304", "address": "fa:16:3e:55:1b:72", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33d0612-bd", "ovs_interfaceid": "f33d0612-bda7-41c8-ba61-d965030f2304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:11:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Releasing lock "refresh_cache-746bdbac-3e36-4a08-989a-c004634890f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:11:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Starting migrate_disk_and_power_off {{(pid=74669) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 08 17:11:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:52 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Instance destroyed successfully.
Nov 08 17:11:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1960764715',display_name='tempest-ServerActionsTestOtherA-server-1960764715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1960764715',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVa16AMO6wxCfNzgZtwDGNOHyvTHwI2kbeRR1JWZMRp/+84NydbzrImNzwJFwUc5Mt6eRV8qh3XhhGBx3qjvshZcC9T6FOe5uxOhgTpdbBqJBGj5+jnhuvk7Bsl6Ed/tQ==',key_name='tempest-keypair-2114035891',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:10:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='766b82c0c2cd480f96d155adf4f6de4c',ramdisk_id='',reservation_id='r-3who8v2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-23582724',owner_user_name='tempest-ServerActionsTestOtherA-23582724-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:11:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e118c178ece2492bb2d975643c405196',uuid=746bdbac-3e36-4a08-989a-c004634890f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f33d0612-bda7-41c8-ba61-d965030f2304", "address": "fa:16:3e:55:1b:72", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2050130925-network", "vif_mac": "fa:16:3e:55:1b:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33d0612-bd", "ovs_interfaceid": "f33d0612-bda7-41c8-ba61-d965030f2304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converting VIF {"id": "f33d0612-bda7-41c8-ba61-d965030f2304", "address": "fa:16:3e:55:1b:72", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2050130925-network", "vif_mac": "fa:16:3e:55:1b:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33d0612-bd", "ovs_interfaceid": "f33d0612-bda7-41c8-ba61-d965030f2304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:1b:72,bridge_name='br-int',has_traffic_filtering=True,id=f33d0612-bda7-41c8-ba61-d965030f2304,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33d0612-bd') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG os_vif [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:1b:72,bridge_name='br-int',has_traffic_filtering=True,id=f33d0612-bda7-41c8-ba61-d965030f2304,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33d0612-bd') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf33d0612-bd, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19f2693e-c1db-4b16-88ff-93520790706a) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:52 user nova-compute[74669]: INFO os_vif [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:1b:72,bridge_name='br-int',has_traffic_filtering=True,id=f33d0612-bda7-41c8-ba61-d965030f2304,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33d0612-bd')
Nov 08 17:11:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHlwFeBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:11:52 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:11:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cabe3c-437a-4b6c-8712-d61caf7ced78]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:11:52 user nova-compute[74669]: No targets found.
Nov 08 17:11:52 user nova-compute[74669]: iSNS:
Nov 08 17:11:52 user nova-compute[74669]: No targets found.
Nov 08 17:11:52 user nova-compute[74669]: STATIC:
Nov 08 17:11:52 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b
Nov 08 17:11:52 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:11:52 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:11:52 user nova-compute[74669]: FIRMWARE:
Nov 08 17:11:52 user nova-compute[74669]: No targets found.
Nov 08 17:11:52 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:11:52 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:11:52 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG nova.compute.manager [req-4ccdbfea-8df3-4d89-9f84-7df9c13242dd req-004ad4cb-b47a-4e0a-a5d7-1456086d1fcf service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Received event network-vif-unplugged-f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4ccdbfea-8df3-4d89-9f84-7df9c13242dd req-004ad4cb-b47a-4e0a-a5d7-1456086d1fcf service nova] Acquiring lock "746bdbac-3e36-4a08-989a-c004634890f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4ccdbfea-8df3-4d89-9f84-7df9c13242dd req-004ad4cb-b47a-4e0a-a5d7-1456086d1fcf service nova] Lock "746bdbac-3e36-4a08-989a-c004634890f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4ccdbfea-8df3-4d89-9f84-7df9c13242dd req-004ad4cb-b47a-4e0a-a5d7-1456086d1fcf service nova] Lock "746bdbac-3e36-4a08-989a-c004634890f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG nova.compute.manager [req-4ccdbfea-8df3-4d89-9f84-7df9c13242dd req-004ad4cb-b47a-4e0a-a5d7-1456086d1fcf service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] No waiting events found dispatching network-vif-unplugged-f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:11:52 user nova-compute[74669]: WARNING nova.compute.manager [req-4ccdbfea-8df3-4d89-9f84-7df9c13242dd req-004ad4cb-b47a-4e0a-a5d7-1456086d1fcf service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Received unexpected event network-vif-unplugged-f33d0612-bda7-41c8-ba61-d965030f2304 for instance with vm_state active and task_state resize_migrating.
Nov 08 17:11:52 user nova-compute[74669]: DEBUG nova.compute.manager [req-4ccdbfea-8df3-4d89-9f84-7df9c13242dd req-004ad4cb-b47a-4e0a-a5d7-1456086d1fcf service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Received event network-vif-plugged-f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4ccdbfea-8df3-4d89-9f84-7df9c13242dd req-004ad4cb-b47a-4e0a-a5d7-1456086d1fcf service nova] Acquiring lock "746bdbac-3e36-4a08-989a-c004634890f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4ccdbfea-8df3-4d89-9f84-7df9c13242dd req-004ad4cb-b47a-4e0a-a5d7-1456086d1fcf service nova] Lock "746bdbac-3e36-4a08-989a-c004634890f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4ccdbfea-8df3-4d89-9f84-7df9c13242dd req-004ad4cb-b47a-4e0a-a5d7-1456086d1fcf service nova] Lock "746bdbac-3e36-4a08-989a-c004634890f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG nova.compute.manager [req-4ccdbfea-8df3-4d89-9f84-7df9c13242dd req-004ad4cb-b47a-4e0a-a5d7-1456086d1fcf service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] No waiting events found dispatching network-vif-plugged-f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:11:52 user nova-compute[74669]: WARNING nova.compute.manager [req-4ccdbfea-8df3-4d89-9f84-7df9c13242dd req-004ad4cb-b47a-4e0a-a5d7-1456086d1fcf service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Received unexpected event network-vif-plugged-f33d0612-bda7-41c8-ba61-d965030f2304 for instance with vm_state active and task_state resize_migrating.
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5c4489-b11b-4c57-ab00-71f81ee86267]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b41990-dbb1-436f-be57-1b8b2c87cfcb]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:11:52 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:11:52 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9a8259bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b'): ({'sdc'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Removing single pathed devices sdc {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cff71fb-9ca2-467e-a6f3-534a7c380211]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02e0092-0c1e-4acf-8bb7-8d7debda9fdd]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Flushing IO for device /dev/sdc {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b96515-7a96-48cc-92d0-d2f6fe8d4673]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4d2f92-c65d-466e-80ef-03bf2e31bbcf]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[67eb2070-1dab-4a3c-8453-5e132d5bdb12]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:11:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f087fcd-e4a7-42df-8a43-05c7af85cb88]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:11:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b, portal: 172.16.0.220,3260]
Nov 08 17:11:53 user nova-compute[74669]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b, portal: 172.16.0.220,3260] successful.
Nov 08 17:11:53 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:11:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e63587a-2292-4f2d-9a15-5ceea0a344b5]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:11:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:11:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:11:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] <== disconnect_volume: return (309ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:11:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:11:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:11:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:54 user nova-compute[74669]: DEBUG nova.network.neutron [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Port f33d0612-bda7-41c8-ba61-d965030f2304 binding to destination host user is already ACTIVE {{(pid=74669) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 17:11:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "746bdbac-3e36-4a08-989a-c004634890f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "746bdbac-3e36-4a08-989a-c004634890f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "746bdbac-3e36-4a08-989a-c004634890f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "refresh_cache-746bdbac-3e36-4a08-989a-c004634890f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:11:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquired lock "refresh_cache-746bdbac-3e36-4a08-989a-c004634890f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:11:54 user nova-compute[74669]: DEBUG nova.network.neutron [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:11:55 user nova-compute[74669]: DEBUG nova.network.neutron [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Updating instance_info_cache with network_info: [{"id": "f33d0612-bda7-41c8-ba61-d965030f2304", "address": "fa:16:3e:55:1b:72", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33d0612-bd", "ovs_interfaceid": "f33d0612-bda7-41c8-ba61-d965030f2304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:11:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Releasing lock "refresh_cache-746bdbac-3e36-4a08-989a-c004634890f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:11:55 user nova-compute[74669]: DEBUG os_brick.utils [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:11:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[751d43df-0f97-4e1d-b355-9ed139ade9e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:11:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[24873826-0068-4818-8161-715eb8600190]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:11:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:11:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[164c977e-4327-4e91-9835-5c4d0a09c239]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:11:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9eb753-c1d3-4d2e-a400-4af5a2fd94e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:11:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:11:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:11:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:11:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:11:55 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:11:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d27c4a8-fa44-4815-a2a6-f9f1ce38dcab]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:11:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:11:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:11:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:11:55 user nova-compute[74669]: DEBUG os_brick.utils [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:11:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:11:57 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:11:58 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:11:58 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74669) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 17:11:59 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:11:59 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:11:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:11:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:11:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:11:59 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:11:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe10edb-fda0-4a16-8cf4-faf7d6d8c93f/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe10edb-fda0-4a16-8cf4-faf7d6d8c93f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe10edb-fda0-4a16-8cf4-faf7d6d8c93f/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe10edb-fda0-4a16-8cf4-faf7d6d8c93f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:12:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "bf46a10b-747a-490c-8e22-a76ec65fafdf" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:01 user nova-compute[74669]: INFO nova.compute.manager [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Unshelving
Nov 08 17:12:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:02 user nova-compute[74669]: DEBUG nova.objects.instance [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lazy-loading 'pci_requests' on Instance uuid bf46a10b-747a-490c-8e22-a76ec65fafdf {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:12:02 user nova-compute[74669]: DEBUG nova.objects.instance [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lazy-loading 'numa_topology' on Instance uuid bf46a10b-747a-490c-8e22-a76ec65fafdf {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:12:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:12:02 user nova-compute[74669]: INFO nova.compute.claims [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Claim successful on node user
Nov 08 17:12:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:02 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Refreshing inventories for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 17:12:02 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:12:02 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:12:02 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8132MB free_disk=25.285518646240234GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:12:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:02 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Updating ProviderTree inventory for provider ce26964b-e55b-43d2-801a-7221ff1fe64b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 17:12:02 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Updating inventory in ProviderTree for provider ce26964b-e55b-43d2-801a-7221ff1fe64b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 17:12:02 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Refreshing aggregate associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, aggregates: None {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 17:12:02 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Refreshing trait associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, traits: HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 17:12:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:02 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:12:02 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:12:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.908s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.380s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:03 user nova-compute[74669]: INFO nova.network.neutron [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Updating port 48c33fc5-13e1-4b32-b706-55d5f033b4d7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Applying migration context for instance 746bdbac-3e36-4a08-989a-c004634890f9 as it has an incoming, in-progress migration 18964ccc-62a7-41dd-ae99-01443023dc5f. Migration status is post-migrating {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 17:12:03 user nova-compute[74669]: INFO nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Updating resource usage from migration 18964ccc-62a7-41dd-ae99-01443023dc5f
Nov 08 17:12:03 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7b335462-0d93-4899-a223-5c2e36932578 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance af8b58ff-90d5-4a04-844a-ac0534a7e413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2158a7c2-2f46-4bce-8558-4347a48623d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 3754330e-8b41-4e69-93f9-508ef5adf772 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance efe10edb-fda0-4a16-8cf4-faf7d6d8c93f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance e33217d2-fd96-49fb-9727-faeb76f0e219 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Migration 18964ccc-62a7-41dd-ae99-01443023dc5f is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 746bdbac-3e36-4a08-989a-c004634890f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (ce26964b-e55b-43d2-801a-7221ff1fe64b): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.402s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquired lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG nova.network.neutron [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG nova.compute.manager [req-385be1ef-7000-4834-bc5c-fb6de4fc2ea3 req-36f92be1-dfa1-4ce0-8ef8-77fd6f2a47f0 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Received event network-changed-48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG nova.compute.manager [req-385be1ef-7000-4834-bc5c-fb6de4fc2ea3 req-36f92be1-dfa1-4ce0-8ef8-77fd6f2a47f0 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Refreshing instance network info cache due to event network-changed-48c33fc5-13e1-4b32-b706-55d5f033b4d7. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-385be1ef-7000-4834-bc5c-fb6de4fc2ea3 req-36f92be1-dfa1-4ce0-8ef8-77fd6f2a47f0 service nova] Acquiring lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:12:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:04 user nova-compute[74669]: DEBUG nova.network.neutron [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Updating instance_info_cache with network_info: [{"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c33fc5-13", "ovs_interfaceid": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:12:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Releasing lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:12:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:12:04 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Creating image(s)
Nov 08 17:12:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "/opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "/opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:04 user nova-compute[74669]: DEBUG nova.objects.instance [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lazy-loading 'trusted_certs' on Instance uuid bf46a10b-747a-490c-8e22-a76ec65fafdf {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:12:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-385be1ef-7000-4834-bc5c-fb6de4fc2ea3 req-36f92be1-dfa1-4ce0-8ef8-77fd6f2a47f0 service nova] Acquired lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:12:04 user nova-compute[74669]: DEBUG nova.network.neutron [req-385be1ef-7000-4834-bc5c-fb6de4fc2ea3 req-36f92be1-dfa1-4ce0-8ef8-77fd6f2a47f0 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Refreshing network info cache for port 48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:12:04 user nova-compute[74669]: DEBUG nova.objects.base [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Object Instance<bf46a10b-747a-490c-8e22-a76ec65fafdf> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:12:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "628cf2431239f3d66297ec42212b020eb83182fd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "628cf2431239f3d66297ec42212b020eb83182fd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/628cf2431239f3d66297ec42212b020eb83182fd.part --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:05 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:12:05 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:12:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:12:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/628cf2431239f3d66297ec42212b020eb83182fd.part --force-share --output=json" returned: 0 in 0.193s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:05 user nova-compute[74669]: DEBUG nova.virt.images [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] 31e6aebb-7c00-49e8-a0ae-527720bd9859 was qcow2, converting to raw {{(pid=74669) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 17:12:05 user nova-compute[74669]: DEBUG nova.privsep.utils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74669) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 17:12:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/628cf2431239f3d66297ec42212b020eb83182fd.part /opt/stack/data/nova/instances/_base/628cf2431239f3d66297ec42212b020eb83182fd.converted {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:05 user nova-compute[74669]: DEBUG nova.compute.manager [req-e4d931ac-d93b-4c50-aa86-48c079f233d8 req-4c5a5e9e-fca8-4be4-babf-532b76423a50 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Received event network-changed-e1e01142-baa0-4410-a147-a0981b4bbd54 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:12:05 user nova-compute[74669]: DEBUG nova.compute.manager [req-e4d931ac-d93b-4c50-aa86-48c079f233d8 req-4c5a5e9e-fca8-4be4-babf-532b76423a50 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Refreshing instance network info cache due to event network-changed-e1e01142-baa0-4410-a147-a0981b4bbd54. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:12:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e4d931ac-d93b-4c50-aa86-48c079f233d8 req-4c5a5e9e-fca8-4be4-babf-532b76423a50 service nova] Acquiring lock "refresh_cache-3754330e-8b41-4e69-93f9-508ef5adf772" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:12:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e4d931ac-d93b-4c50-aa86-48c079f233d8 req-4c5a5e9e-fca8-4be4-babf-532b76423a50 service nova] Acquired lock "refresh_cache-3754330e-8b41-4e69-93f9-508ef5adf772" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:12:05 user nova-compute[74669]: DEBUG nova.network.neutron [req-e4d931ac-d93b-4c50-aa86-48c079f233d8 req-4c5a5e9e-fca8-4be4-babf-532b76423a50 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Refreshing network info cache for port e1e01142-baa0-4410-a147-a0981b4bbd54 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:12:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/628cf2431239f3d66297ec42212b020eb83182fd.part /opt/stack/data/nova/instances/_base/628cf2431239f3d66297ec42212b020eb83182fd.converted" returned: 0 in 0.427s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/628cf2431239f3d66297ec42212b020eb83182fd.converted --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/628cf2431239f3d66297ec42212b020eb83182fd.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "628cf2431239f3d66297ec42212b020eb83182fd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.923s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/628cf2431239f3d66297ec42212b020eb83182fd --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/628cf2431239f3d66297ec42212b020eb83182fd --force-share --output=json" returned: 0 in 0.185s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "628cf2431239f3d66297ec42212b020eb83182fd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "628cf2431239f3d66297ec42212b020eb83182fd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/628cf2431239f3d66297ec42212b020eb83182fd --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG nova.network.neutron [req-385be1ef-7000-4834-bc5c-fb6de4fc2ea3 req-36f92be1-dfa1-4ce0-8ef8-77fd6f2a47f0 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Updated VIF entry in instance network info cache for port 48c33fc5-13e1-4b32-b706-55d5f033b4d7. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG nova.network.neutron [req-385be1ef-7000-4834-bc5c-fb6de4fc2ea3 req-36f92be1-dfa1-4ce0-8ef8-77fd6f2a47f0 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Updating instance_info_cache with network_info: [{"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c33fc5-13", "ovs_interfaceid": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-385be1ef-7000-4834-bc5c-fb6de4fc2ea3 req-36f92be1-dfa1-4ce0-8ef8-77fd6f2a47f0 service nova] Releasing lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG nova.network.neutron [req-e4d931ac-d93b-4c50-aa86-48c079f233d8 req-4c5a5e9e-fca8-4be4-babf-532b76423a50 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Updated VIF entry in instance network info cache for port e1e01142-baa0-4410-a147-a0981b4bbd54. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG nova.network.neutron [req-e4d931ac-d93b-4c50-aa86-48c079f233d8 req-4c5a5e9e-fca8-4be4-babf-532b76423a50 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Updating instance_info_cache with network_info: [{"id": "e1e01142-baa0-4410-a147-a0981b4bbd54", "address": "fa:16:3e:b6:8f:c8", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e01142-ba", "ovs_interfaceid": "e1e01142-baa0-4410-a147-a0981b4bbd54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e4d931ac-d93b-4c50-aa86-48c079f233d8 req-4c5a5e9e-fca8-4be4-babf-532b76423a50 service nova] Releasing lock "refresh_cache-3754330e-8b41-4e69-93f9-508ef5adf772" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/628cf2431239f3d66297ec42212b020eb83182fd --force-share --output=json" returned: 0 in 0.200s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/628cf2431239f3d66297ec42212b020eb83182fd,backing_fmt=raw /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/628cf2431239f3d66297ec42212b020eb83182fd,backing_fmt=raw /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk 1073741824" returned: 0 in 0.107s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "628cf2431239f3d66297ec42212b020eb83182fd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/628cf2431239f3d66297ec42212b020eb83182fd --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/628cf2431239f3d66297ec42212b020eb83182fd --force-share --output=json" returned: 0 in 0.227s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG nova.objects.instance [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lazy-loading 'migration_context' on Instance uuid bf46a10b-747a-490c-8e22-a76ec65fafdf {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG nova.objects.base [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Object Instance<bf46a10b-747a-490c-8e22-a76ec65fafdf> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:12:06 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Rebasing disk image.
Nov 08 17:12:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Updating instance_info_cache with network_info: [{"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c33fc5-13", "ovs_interfaceid": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-bf46a10b-747a-490c-8e22-a76ec65fafdf" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:12:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:12:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.175s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 -F raw /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:08 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:12:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 -F raw /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk" returned: 0 in 2.191s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Ensure instance console log exists: /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Start _get_guest_xml network_info=[{"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c33fc5-13", "ovs_interfaceid": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='837691747fe8f6b91a5bba08e2a2979e',container_format='bare',created_at=2023-11-08T17:10:09Z,direct_url=<?>,disk_format='qcow2',id=31e6aebb-7c00-49e8-a0ae-527720bd9859,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-906635481-shelved',owner='9f1e9778e17a4e0fa1aa1f41d323a88c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T17:10:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:12:09 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:12:09 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='837691747fe8f6b91a5bba08e2a2979e',container_format='bare',created_at=2023-11-08T17:10:09Z,direct_url=<?>,disk_format='qcow2',id=31e6aebb-7c00-49e8-a0ae-527720bd9859,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-906635481-shelved',owner='9f1e9778e17a4e0fa1aa1f41d323a88c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T17:10:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.objects.instance [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lazy-loading 'vcpu_model' on Instance uuid bf46a10b-747a-490c-8e22-a76ec65fafdf {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.objects.base [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Object Instance<bf46a10b-747a-490c-8e22-a76ec65fafdf> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T17:08:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-906635481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-906635481',id=28,image_ref='31e6aebb-7c00-49e8-a0ae-527720bd9859',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1645684870',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:08:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9f1e9778e17a4e0fa1aa1f41d323a88c',ramdisk_id='',reservation_id='r-3gqwmia3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-317302826',owner_user_name='tempest-AttachVolumeShelveTestJSON-317302826-project-member',shelved_at='2023-11-08T17:10:13.839909',shelved_host='user',shelved_image_id='31e6aebb-7c00-49e8-a0ae-527720bd9859'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:12:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8bcb0586bce42a3a1a59b2cbc99f846',uuid=bf46a10b-747a-490c-8e22-a76ec65fafdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c33fc5-13", "ovs_interfaceid": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converting VIF {"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c33fc5-13", "ovs_interfaceid": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:64:e8,bridge_name='br-int',has_traffic_filtering=True,id=48c33fc5-13e1-4b32-b706-55d5f033b4d7,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c33fc5-13') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.objects.instance [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lazy-loading 'pci_devices' on Instance uuid bf46a10b-747a-490c-8e22-a76ec65fafdf {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.objects.base [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Object Instance<bf46a10b-747a-490c-8e22-a76ec65fafdf> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:12:09 user nova-compute[74669]:   <uuid>bf46a10b-747a-490c-8e22-a76ec65fafdf</uuid>
Nov 08 17:12:09 user nova-compute[74669]:   <name>instance-0000001c</name>
Nov 08 17:12:09 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:12:09 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:12:09 user nova-compute[74669]:   <metadata>
Nov 08 17:12:09 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:12:09 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:12:09 user nova-compute[74669]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-906635481</nova:name>
Nov 08 17:12:09 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:12:09</nova:creationTime>
Nov 08 17:12:09 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:12:09 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:12:09 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:12:09 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:12:09 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:12:09 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:12:09 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:12:09 user nova-compute[74669]:       <nova:owner>
Nov 08 17:12:09 user nova-compute[74669]:         <nova:user uuid="d8bcb0586bce42a3a1a59b2cbc99f846">tempest-AttachVolumeShelveTestJSON-317302826-project-member</nova:user>
Nov 08 17:12:09 user nova-compute[74669]:         <nova:project uuid="9f1e9778e17a4e0fa1aa1f41d323a88c">tempest-AttachVolumeShelveTestJSON-317302826</nova:project>
Nov 08 17:12:09 user nova-compute[74669]:       </nova:owner>
Nov 08 17:12:09 user nova-compute[74669]:       <nova:root type="image" uuid="31e6aebb-7c00-49e8-a0ae-527720bd9859"/>
Nov 08 17:12:09 user nova-compute[74669]:       <nova:ports>
Nov 08 17:12:09 user nova-compute[74669]:         <nova:port uuid="48c33fc5-13e1-4b32-b706-55d5f033b4d7">
Nov 08 17:12:09 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 17:12:09 user nova-compute[74669]:         </nova:port>
Nov 08 17:12:09 user nova-compute[74669]:       </nova:ports>
Nov 08 17:12:09 user nova-compute[74669]:     </nova:instance>
Nov 08 17:12:09 user nova-compute[74669]:   </metadata>
Nov 08 17:12:09 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:12:09 user nova-compute[74669]:     <system>
Nov 08 17:12:09 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:12:09 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:12:09 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:12:09 user nova-compute[74669]:       <entry name="serial">bf46a10b-747a-490c-8e22-a76ec65fafdf</entry>
Nov 08 17:12:09 user nova-compute[74669]:       <entry name="uuid">bf46a10b-747a-490c-8e22-a76ec65fafdf</entry>
Nov 08 17:12:09 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:12:09 user nova-compute[74669]:     </system>
Nov 08 17:12:09 user nova-compute[74669]:   </sysinfo>
Nov 08 17:12:09 user nova-compute[74669]:   <os>
Nov 08 17:12:09 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:12:09 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:12:09 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:12:09 user nova-compute[74669]:   </os>
Nov 08 17:12:09 user nova-compute[74669]:   <features>
Nov 08 17:12:09 user nova-compute[74669]:     <acpi/>
Nov 08 17:12:09 user nova-compute[74669]:     <apic/>
Nov 08 17:12:09 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:12:09 user nova-compute[74669]:   </features>
Nov 08 17:12:09 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:12:09 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:12:09 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:12:09 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:12:09 user nova-compute[74669]:   </clock>
Nov 08 17:12:09 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:12:09 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:12:09 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:12:09 user nova-compute[74669]:   </cpu>
Nov 08 17:12:09 user nova-compute[74669]:   <devices>
Nov 08 17:12:09 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:12:09 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:12:09 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk"/>
Nov 08 17:12:09 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:12:09 user nova-compute[74669]:     </disk>
Nov 08 17:12:09 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:12:09 user nova-compute[74669]:       <mac address="fa:16:3e:c8:64:e8"/>
Nov 08 17:12:09 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:12:09 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:12:09 user nova-compute[74669]:       <target dev="tap48c33fc5-13"/>
Nov 08 17:12:09 user nova-compute[74669]:     </interface>
Nov 08 17:12:09 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:12:09 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/console.log" append="off"/>
Nov 08 17:12:09 user nova-compute[74669]:     </serial>
Nov 08 17:12:09 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:12:09 user nova-compute[74669]:     <video>
Nov 08 17:12:09 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:12:09 user nova-compute[74669]:     </video>
Nov 08 17:12:09 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:12:09 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:12:09 user nova-compute[74669]:     </rng>
Nov 08 17:12:09 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:12:09 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:12:09 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:12:09 user nova-compute[74669]:     </memballoon>
Nov 08 17:12:09 user nova-compute[74669]:   </devices>
Nov 08 17:12:09 user nova-compute[74669]: </domain>
Nov 08 17:12:09 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T17:08:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-906635481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-906635481',id=28,image_ref='31e6aebb-7c00-49e8-a0ae-527720bd9859',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1645684870',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:08:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9f1e9778e17a4e0fa1aa1f41d323a88c',ramdisk_id='',reservation_id='r-3gqwmia3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-317302826',owner_user_name='tempest-AttachVolumeShelveTestJSON-317302826-project-member',shelved_at='2023-11-08T17:10:13.839909',shelved_host='user',shelved_image_id='31e6aebb-7c00-49e8-a0ae-527720bd9859'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:12:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8bcb0586bce42a3a1a59b2cbc99f846',uuid=bf46a10b-747a-490c-8e22-a76ec65fafdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c33fc5-13", "ovs_interfaceid": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converting VIF {"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c33fc5-13", "ovs_interfaceid": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:64:e8,bridge_name='br-int',has_traffic_filtering=True,id=48c33fc5-13e1-4b32-b706-55d5f033b4d7,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c33fc5-13') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG os_vif [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:64:e8,bridge_name='br-int',has_traffic_filtering=True,id=48c33fc5-13e1-4b32-b706-55d5f033b4d7,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c33fc5-13') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aad751fa-6481-52f2-ac15-d77cd61f3fa0', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48c33fc5-13, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48c33fc5-13, col_values=(('qos', UUID('7cc62483-82c4-4ce9-a1d6-ed4724ee069f')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48c33fc5-13, col_values=(('external_ids', {'iface-id': '48c33fc5-13e1-4b32-b706-55d5f033b4d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:64:e8', 'vm-uuid': 'bf46a10b-747a-490c-8e22-a76ec65fafdf'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:09 user nova-compute[74669]: INFO os_vif [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:64:e8,bridge_name='br-int',has_traffic_filtering=True,id=48c33fc5-13e1-4b32-b706-55d5f033b4d7,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c33fc5-13')
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:12:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] No VIF found with MAC fa:16:3e:c8:64:e8, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:12:10 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:12:10 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 17:12:10 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] There are 0 instances to clean {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 17:12:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:11 user nova-compute[74669]: DEBUG nova.compute.manager [req-b6301cb8-84c3-44de-8e9e-b2a1be7c1bd2 req-80f79ada-cc2a-4699-b36f-630b2d599899 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Received event network-vif-plugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:12:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b6301cb8-84c3-44de-8e9e-b2a1be7c1bd2 req-80f79ada-cc2a-4699-b36f-630b2d599899 service nova] Acquiring lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b6301cb8-84c3-44de-8e9e-b2a1be7c1bd2 req-80f79ada-cc2a-4699-b36f-630b2d599899 service nova] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b6301cb8-84c3-44de-8e9e-b2a1be7c1bd2 req-80f79ada-cc2a-4699-b36f-630b2d599899 service nova] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:11 user nova-compute[74669]: DEBUG nova.compute.manager [req-b6301cb8-84c3-44de-8e9e-b2a1be7c1bd2 req-80f79ada-cc2a-4699-b36f-630b2d599899 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] No waiting events found dispatching network-vif-plugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:12:11 user nova-compute[74669]: WARNING nova.compute.manager [req-b6301cb8-84c3-44de-8e9e-b2a1be7c1bd2 req-80f79ada-cc2a-4699-b36f-630b2d599899 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Received unexpected event network-vif-plugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 17:12:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "3754330e-8b41-4e69-93f9-508ef5adf772" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "3754330e-8b41-4e69-93f9-508ef5adf772" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG nova.objects.instance [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lazy-loading 'flavor' on Instance uuid 3754330e-8b41-4e69-93f9-508ef5adf772 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "3754330e-8b41-4e69-93f9-508ef5adf772" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "3754330e-8b41-4e69-93f9-508ef5adf772" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "3754330e-8b41-4e69-93f9-508ef5adf772" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:12 user nova-compute[74669]: INFO nova.compute.manager [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Attaching volume 8b98844f-8f0c-44cd-92d2-4650be2efbaa to /dev/vdb
Nov 08 17:12:12 user nova-compute[74669]: DEBUG os_brick.utils [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2defe40b-9d10-4012-96da-830731e78fa9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98ef30b-b3c6-4cc7-b596-2c65bcb5657b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4012ea51-8702-4296-a3c0-ac6b01bf0bbf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bc47ed-d749-4ec9-bd6e-a39960fe262a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:12:12 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:12:12 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0799a67-2f19-4b91-a762-56cdb0234b2d]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG os_brick.utils [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:12:12 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Updating existing volume attachment record: 0b4cbf47-d689-4e1c-9113-d2c8d314a0cd {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:12:13 user nova-compute[74669]: DEBUG nova.compute.manager [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:12:13 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:12:13 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Instance spawned successfully.
Nov 08 17:12:13 user nova-compute[74669]: DEBUG nova.compute.manager [req-2cbfe9e6-90cb-4d53-b354-cf5122033887 req-918cb957-63d2-48a2-a2ed-2b29fb25cd04 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Received event network-vif-plugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:12:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2cbfe9e6-90cb-4d53-b354-cf5122033887 req-918cb957-63d2-48a2-a2ed-2b29fb25cd04 service nova] Acquiring lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2cbfe9e6-90cb-4d53-b354-cf5122033887 req-918cb957-63d2-48a2-a2ed-2b29fb25cd04 service nova] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2cbfe9e6-90cb-4d53-b354-cf5122033887 req-918cb957-63d2-48a2-a2ed-2b29fb25cd04 service nova] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:13 user nova-compute[74669]: DEBUG nova.compute.manager [req-2cbfe9e6-90cb-4d53-b354-cf5122033887 req-918cb957-63d2-48a2-a2ed-2b29fb25cd04 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] No waiting events found dispatching network-vif-plugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:12:13 user nova-compute[74669]: WARNING nova.compute.manager [req-2cbfe9e6-90cb-4d53-b354-cf5122033887 req-918cb957-63d2-48a2-a2ed-2b29fb25cd04 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Received unexpected event network-vif-plugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 17:12:13 user nova-compute[74669]: DEBUG nova.compute.manager [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:12:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-af46bf24-ddca-4e09-9c18-f44bde4514c1 tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.545s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Starting finish_migration {{(pid=74669) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Instance directory exists: not creating {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 17:12:18 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Creating image(s)
Nov 08 17:12:18 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Did not create local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Ensure instance console log exists: /opt/stack/data/nova/instances/746bdbac-3e36-4a08-989a-c004634890f9/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Start _get_guest_xml network_info=[{"id": "f33d0612-bda7-41c8-ba61-d965030f2304", "address": "fa:16:3e:55:1b:72", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2050130925-network", "vif_mac": "fa:16:3e:55:1b:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33d0612-bd", "ovs_interfaceid": "f33d0612-bda7-41c8-ba61-d965030f2304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'c92551e7-985e-453e-93f4-a2d763eb43aa', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHlwFeBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '746bdbac-3e36-4a08-989a-c004634890f9', 'attached_at': '2023-11-08T17:12:18.000000', 'detached_at': '', 'volume_id': '26643eca-01db-4eae-9621-c1371bd1e66b', 'serial': '26643eca-01db-4eae-9621-c1371bd1e66b'}, 'guest_format': None, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:12:18 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:12:18 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:12:18 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHlwFeBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:12:18 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:12:18 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:12:18 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb62ecf-4708-4a7c-aeb5-17c3cabd1cfa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:12:18 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[221ee809-451a-44b5-bb2c-98eedc97b705]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b] added
Nov 08 17:12:18 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba072e29-e40f-4d87-9c83-bb7aa1110a40]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[974d1abd-618d-4de7-b965-569fed18f10c]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nHlwFeBI {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nHlwFeBI" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc77c0c0-0b59-4765-847c-fe4734f96192]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nHlwFeBI'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fa57e1-c767-4396-86d6-0b88c934e29a]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7a88f8-3f48-48b7-b849-3ba134e157b1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 17:12:18 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 17:12:18 user nova-compute[74669]:  {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:12:18 user nova-compute[74669]: WARNING os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 17:12:18 user nova-compute[74669]: 
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b264c893-c716-4779-a568-cf24d918cb4e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b, portal: 172.16.0.220,3260]
Nov 08 17:12:18 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b, portal: 172.16.0.220,3260] successful.
Nov 08 17:12:18 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefd448b-8a6a-4610-a0d9-f8a943f18e98]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f38405-8aba-44f2-8f9e-5fca21a2955d]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:12:18 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:12:18 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12a96b2-8594-48c3-ad9e-3a4afb30d5d2]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHlwFeBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:12:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23733326165613539', 'path': '/dev/sdb'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733326165613539', 'path': '/dev/sdb'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1960764715',display_name='tempest-ServerActionsTestOtherA-server-1960764715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1960764715',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVa16AMO6wxCfNzgZtwDGNOHyvTHwI2kbeRR1JWZMRp/+84NydbzrImNzwJFwUc5Mt6eRV8qh3XhhGBx3qjvshZcC9T6FOe5uxOhgTpdbBqJBGj5+jnhuvk7Bsl6Ed/tQ==',key_name='tempest-keypair-2114035891',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:10:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='766b82c0c2cd480f96d155adf4f6de4c',ramdisk_id='',reservation_id='r-3who8v2k',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-23582724',owner_user_name='tempest-ServerActionsTestOtherA-23582724-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:11:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e118c178ece2492bb2d975643c405196',uuid=746bdbac-3e36-4a08-989a-c004634890f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f33d0612-bda7-41c8-ba61-d965030f2304", "address": "fa:16:3e:55:1b:72", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2050130925-network", "vif_mac": "fa:16:3e:55:1b:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33d0612-bd", "ovs_interfaceid": "f33d0612-bda7-41c8-ba61-d965030f2304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converting VIF {"id": "f33d0612-bda7-41c8-ba61-d965030f2304", "address": "fa:16:3e:55:1b:72", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2050130925-network", "vif_mac": "fa:16:3e:55:1b:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33d0612-bd", "ovs_interfaceid": "f33d0612-bda7-41c8-ba61-d965030f2304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:1b:72,bridge_name='br-int',has_traffic_filtering=True,id=f33d0612-bda7-41c8-ba61-d965030f2304,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33d0612-bd') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:12:19 user nova-compute[74669]:   <uuid>746bdbac-3e36-4a08-989a-c004634890f9</uuid>
Nov 08 17:12:19 user nova-compute[74669]:   <name>instance-0000001e</name>
Nov 08 17:12:19 user nova-compute[74669]:   <memory>2097152</memory>
Nov 08 17:12:19 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:12:19 user nova-compute[74669]:   <metadata>
Nov 08 17:12:19 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:12:19 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:12:19 user nova-compute[74669]:       <nova:name>tempest-ServerActionsTestOtherA-server-1960764715</nova:name>
Nov 08 17:12:19 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:12:18</nova:creationTime>
Nov 08 17:12:19 user nova-compute[74669]:       <nova:flavor name="m1.small">
Nov 08 17:12:19 user nova-compute[74669]:         <nova:memory>2048</nova:memory>
Nov 08 17:12:19 user nova-compute[74669]:         <nova:disk>20</nova:disk>
Nov 08 17:12:19 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:12:19 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:12:19 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:12:19 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:12:19 user nova-compute[74669]:       <nova:owner>
Nov 08 17:12:19 user nova-compute[74669]:         <nova:user uuid="e118c178ece2492bb2d975643c405196">tempest-ServerActionsTestOtherA-23582724-project-member</nova:user>
Nov 08 17:12:19 user nova-compute[74669]:         <nova:project uuid="766b82c0c2cd480f96d155adf4f6de4c">tempest-ServerActionsTestOtherA-23582724</nova:project>
Nov 08 17:12:19 user nova-compute[74669]:       </nova:owner>
Nov 08 17:12:19 user nova-compute[74669]:       <nova:ports>
Nov 08 17:12:19 user nova-compute[74669]:         <nova:port uuid="f33d0612-bda7-41c8-ba61-d965030f2304">
Nov 08 17:12:19 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 17:12:19 user nova-compute[74669]:         </nova:port>
Nov 08 17:12:19 user nova-compute[74669]:       </nova:ports>
Nov 08 17:12:19 user nova-compute[74669]:     </nova:instance>
Nov 08 17:12:19 user nova-compute[74669]:   </metadata>
Nov 08 17:12:19 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:12:19 user nova-compute[74669]:     <system>
Nov 08 17:12:19 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:12:19 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:12:19 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:12:19 user nova-compute[74669]:       <entry name="serial">746bdbac-3e36-4a08-989a-c004634890f9</entry>
Nov 08 17:12:19 user nova-compute[74669]:       <entry name="uuid">746bdbac-3e36-4a08-989a-c004634890f9</entry>
Nov 08 17:12:19 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:12:19 user nova-compute[74669]:     </system>
Nov 08 17:12:19 user nova-compute[74669]:   </sysinfo>
Nov 08 17:12:19 user nova-compute[74669]:   <os>
Nov 08 17:12:19 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:12:19 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:12:19 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:12:19 user nova-compute[74669]:   </os>
Nov 08 17:12:19 user nova-compute[74669]:   <features>
Nov 08 17:12:19 user nova-compute[74669]:     <acpi/>
Nov 08 17:12:19 user nova-compute[74669]:     <apic/>
Nov 08 17:12:19 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:12:19 user nova-compute[74669]:   </features>
Nov 08 17:12:19 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:12:19 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:12:19 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:12:19 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:12:19 user nova-compute[74669]:   </clock>
Nov 08 17:12:19 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:12:19 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:12:19 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:12:19 user nova-compute[74669]:   </cpu>
Nov 08 17:12:19 user nova-compute[74669]:   <devices>
Nov 08 17:12:19 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 17:12:19 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:12:19 user nova-compute[74669]:       <source dev="/dev/sdb"/>
Nov 08 17:12:19 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:12:19 user nova-compute[74669]:       <serial>26643eca-01db-4eae-9621-c1371bd1e66b</serial>
Nov 08 17:12:19 user nova-compute[74669]:     </disk>
Nov 08 17:12:19 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:12:19 user nova-compute[74669]:       <mac address="fa:16:3e:55:1b:72"/>
Nov 08 17:12:19 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:12:19 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:12:19 user nova-compute[74669]:       <target dev="tapf33d0612-bd"/>
Nov 08 17:12:19 user nova-compute[74669]:     </interface>
Nov 08 17:12:19 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:12:19 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/746bdbac-3e36-4a08-989a-c004634890f9/console.log" append="off"/>
Nov 08 17:12:19 user nova-compute[74669]:     </serial>
Nov 08 17:12:19 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:12:19 user nova-compute[74669]:     <video>
Nov 08 17:12:19 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:12:19 user nova-compute[74669]:     </video>
Nov 08 17:12:19 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:12:19 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:12:19 user nova-compute[74669]:     </rng>
Nov 08 17:12:19 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:12:19 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:12:19 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:12:19 user nova-compute[74669]:     </memballoon>
Nov 08 17:12:19 user nova-compute[74669]:   </devices>
Nov 08 17:12:19 user nova-compute[74669]: </domain>
Nov 08 17:12:19 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1960764715',display_name='tempest-ServerActionsTestOtherA-server-1960764715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1960764715',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVa16AMO6wxCfNzgZtwDGNOHyvTHwI2kbeRR1JWZMRp/+84NydbzrImNzwJFwUc5Mt6eRV8qh3XhhGBx3qjvshZcC9T6FOe5uxOhgTpdbBqJBGj5+jnhuvk7Bsl6Ed/tQ==',key_name='tempest-keypair-2114035891',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:10:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='766b82c0c2cd480f96d155adf4f6de4c',ramdisk_id='',reservation_id='r-3who8v2k',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-23582724',owner_user_name='tempest-ServerActionsTestOtherA-23582724-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:11:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e118c178ece2492bb2d975643c405196',uuid=746bdbac-3e36-4a08-989a-c004634890f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f33d0612-bda7-41c8-ba61-d965030f2304", "address": "fa:16:3e:55:1b:72", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2050130925-network", "vif_mac": "fa:16:3e:55:1b:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33d0612-bd", "ovs_interfaceid": "f33d0612-bda7-41c8-ba61-d965030f2304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converting VIF {"id": "f33d0612-bda7-41c8-ba61-d965030f2304", "address": "fa:16:3e:55:1b:72", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2050130925-network", "vif_mac": "fa:16:3e:55:1b:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33d0612-bd", "ovs_interfaceid": "f33d0612-bda7-41c8-ba61-d965030f2304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:1b:72,bridge_name='br-int',has_traffic_filtering=True,id=f33d0612-bda7-41c8-ba61-d965030f2304,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33d0612-bd') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG os_vif [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:1b:72,bridge_name='br-int',has_traffic_filtering=True,id=f33d0612-bda7-41c8-ba61-d965030f2304,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33d0612-bd') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ade60105-48c0-5606-8af8-020fad8c2be2', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf33d0612-bd, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf33d0612-bd, col_values=(('qos', UUID('3f7fc3ab-6af4-4442-810f-11e8c428ceb5')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf33d0612-bd, col_values=(('external_ids', {'iface-id': 'f33d0612-bda7-41c8-ba61-d965030f2304', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:1b:72', 'vm-uuid': '746bdbac-3e36-4a08-989a-c004634890f9'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:19 user nova-compute[74669]: INFO os_vif [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:1b:72,bridge_name='br-int',has_traffic_filtering=True,id=f33d0612-bda7-41c8-ba61-d965030f2304,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33d0612-bd')
Nov 08 17:12:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:12:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] No VIF found with MAC fa:16:3e:55:1b:72, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:12:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:21 user nova-compute[74669]: DEBUG nova.compute.manager [req-d786f69d-0c14-4dff-8f36-e9dcd8529c5d req-44a7fc71-cdc0-4208-b063-6858acbf8782 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Received event network-vif-plugged-f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:12:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d786f69d-0c14-4dff-8f36-e9dcd8529c5d req-44a7fc71-cdc0-4208-b063-6858acbf8782 service nova] Acquiring lock "746bdbac-3e36-4a08-989a-c004634890f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d786f69d-0c14-4dff-8f36-e9dcd8529c5d req-44a7fc71-cdc0-4208-b063-6858acbf8782 service nova] Lock "746bdbac-3e36-4a08-989a-c004634890f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d786f69d-0c14-4dff-8f36-e9dcd8529c5d req-44a7fc71-cdc0-4208-b063-6858acbf8782 service nova] Lock "746bdbac-3e36-4a08-989a-c004634890f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:21 user nova-compute[74669]: DEBUG nova.compute.manager [req-d786f69d-0c14-4dff-8f36-e9dcd8529c5d req-44a7fc71-cdc0-4208-b063-6858acbf8782 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] No waiting events found dispatching network-vif-plugged-f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:12:21 user nova-compute[74669]: WARNING nova.compute.manager [req-d786f69d-0c14-4dff-8f36-e9dcd8529c5d req-44a7fc71-cdc0-4208-b063-6858acbf8782 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Received unexpected event network-vif-plugged-f33d0612-bda7-41c8-ba61-d965030f2304 for instance with vm_state active and task_state resize_finish.
Nov 08 17:12:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:23 user nova-compute[74669]: DEBUG nova.compute.manager [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:12:23 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Instance running successfully.
Nov 08 17:12:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Failed to set time: agent not configured {{(pid=74669) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 08 17:12:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-30916e24-1256-4f26-9c61-1267b32546e9 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] finish_migration finished successfully. {{(pid=74669) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 08 17:12:23 user nova-compute[74669]: DEBUG nova.compute.manager [req-f3bc90c1-6170-407d-9a18-2519b92d5e63 req-bb19b2cf-1dec-4aae-946d-a6c38450d3f9 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Received event network-vif-plugged-f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:12:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f3bc90c1-6170-407d-9a18-2519b92d5e63 req-bb19b2cf-1dec-4aae-946d-a6c38450d3f9 service nova] Acquiring lock "746bdbac-3e36-4a08-989a-c004634890f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f3bc90c1-6170-407d-9a18-2519b92d5e63 req-bb19b2cf-1dec-4aae-946d-a6c38450d3f9 service nova] Lock "746bdbac-3e36-4a08-989a-c004634890f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f3bc90c1-6170-407d-9a18-2519b92d5e63 req-bb19b2cf-1dec-4aae-946d-a6c38450d3f9 service nova] Lock "746bdbac-3e36-4a08-989a-c004634890f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:23 user nova-compute[74669]: DEBUG nova.compute.manager [req-f3bc90c1-6170-407d-9a18-2519b92d5e63 req-bb19b2cf-1dec-4aae-946d-a6c38450d3f9 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] No waiting events found dispatching network-vif-plugged-f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:12:23 user nova-compute[74669]: WARNING nova.compute.manager [req-f3bc90c1-6170-407d-9a18-2519b92d5e63 req-bb19b2cf-1dec-4aae-946d-a6c38450d3f9 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Received unexpected event network-vif-plugged-f33d0612-bda7-41c8-ba61-d965030f2304 for instance with vm_state active and task_state resize_finish.
Nov 08 17:12:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:35 user nova-compute[74669]: DEBUG nova.objects.instance [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'flavor' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:12:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "refresh_cache-af8b58ff-90d5-4a04-844a-ac0534a7e413" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:12:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquired lock "refresh_cache-af8b58ff-90d5-4a04-844a-ac0534a7e413" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:12:35 user nova-compute[74669]: DEBUG nova.network.neutron [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:12:35 user nova-compute[74669]: DEBUG nova.objects.instance [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'info_cache' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:12:35 user nova-compute[74669]: DEBUG nova.objects.base [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Object Instance<af8b58ff-90d5-4a04-844a-ac0534a7e413> lazy-loaded attributes: flavor,info_cache {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URyZvqHI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:12:36 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:12:36 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:12:36 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[be35a333-f676-4fb9-841d-a134679eab6b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:12:36 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c0c792-7292-43e0-b0cf-b43f24d60c71]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa] added
Nov 08 17:12:36 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc14951-88ec-4bc9-ab9a-64e4a2bb1756]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e8d9cb-450e-407c-b26a-f9b0e6e93dda]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v URyZvqHI {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v URyZvqHI" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d1a932-1755-43e1-8c00-56fa597bf947]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'URyZvqHI'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.network.neutron [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Updating instance_info_cache with network_info: [{"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[733376a7-0218-4f1e-a4f4-07fdcdba615e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bb3b82-482d-4be6-97bf-0413eda8e011]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:12:36 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:12:36 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Releasing lock "refresh_cache-af8b58ff-90d5-4a04-844a-ac0534a7e413" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57a2aa9-a648-4efc-a342-0af298096bc4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa, portal: 172.16.0.220,3260]
Nov 08 17:12:36 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa, portal: 172.16.0.220,3260] successful.
Nov 08 17:12:36 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:36 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Instance destroyed successfully.
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.objects.instance [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'resources' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.objects.base [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Object Instance<af8b58ff-90d5-4a04-844a-ac0534a7e413> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:03:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-546386835',display_name='tempest-AttachVolumeTestJSON-server-546386835',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-546386835',id=25,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXViWU/BdYxMm5+lemyfZcP7+TCdB2OaD+dWs6IPD7DtEkJGE2tx2z335cOHjRlBjCNb0QrrgNRKB9Cr8JI7YWfGi7dauKEckz8JkFarm7hJu+kJ/zQZH4rAL4xDCaMWg==',key_name='tempest-keypair-1427520299',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:03:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5a7febf2b00147cfb989380452aba869',ramdisk_id='',reservation_id='r-l53uvaaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-275457186',owner_user_name='tempest-AttachVolumeTestJSON-275457186-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:10:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fd41a7ea7943e6a913c211f6ea2d52',uuid=af8b58ff-90d5-4a04-844a-ac0534a7e413,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converting VIF {"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2d:67,bridge_name='br-int',has_traffic_filtering=True,id=d0dc10aa-3fca-4242-8895-241190da8780,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dc10aa-3f') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_vif [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2d:67,bridge_name='br-int',has_traffic_filtering=True,id=d0dc10aa-3fca-4242-8895-241190da8780,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dc10aa-3f') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e443f804-ab0b-4a09-8679-70555404aa47]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0dc10aa-3f, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39cace03-682a-4abf-a30f-1453a7a6fa02) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:36 user nova-compute[74669]: INFO os_vif [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2d:67,bridge_name='br-int',has_traffic_filtering=True,id=d0dc10aa-3fca-4242-8895-241190da8780,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dc10aa-3f')
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ec2bda-0216-4336-a9e5-13029faabaf7]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:12:36 user nova-compute[74669]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa (non-flash)
Nov 08 17:12:36 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:12:36 user nova-compute[74669]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa (non-flash)
Nov 08 17:12:36 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Start _get_guest_xml network_info=[{"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.objects.instance [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'numa_topology' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d533bee-f752-4fa8-84f1-0080059c5207]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: None {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.objects.base [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Object Instance<af8b58ff-90d5-4a04-844a-ac0534a7e413> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:12:36 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:12:36 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.objects.instance [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'vcpu_model' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.objects.base [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Object Instance<af8b58ff-90d5-4a04-844a-ac0534a7e413> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:03:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-546386835',display_name='tempest-AttachVolumeTestJSON-server-546386835',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-546386835',id=25,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXViWU/BdYxMm5+lemyfZcP7+TCdB2OaD+dWs6IPD7DtEkJGE2tx2z335cOHjRlBjCNb0QrrgNRKB9Cr8JI7YWfGi7dauKEckz8JkFarm7hJu+kJ/zQZH4rAL4xDCaMWg==',key_name='tempest-keypair-1427520299',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:03:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5a7febf2b00147cfb989380452aba869',ramdisk_id='',reservation_id='r-l53uvaaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-275457186',owner_user_name='tempest-AttachVolumeTestJSON-275457186-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:10:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fd41a7ea7943e6a913c211f6ea2d52',uuid=af8b58ff-90d5-4a04-844a-ac0534a7e413,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converting VIF {"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2d:67,bridge_name='br-int',has_traffic_filtering=True,id=d0dc10aa-3fca-4242-8895-241190da8780,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dc10aa-3f') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.objects.instance [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'pci_devices' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.objects.base [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Object Instance<af8b58ff-90d5-4a04-844a-ac0534a7e413> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:12:36 user nova-compute[74669]:   <uuid>af8b58ff-90d5-4a04-844a-ac0534a7e413</uuid>
Nov 08 17:12:36 user nova-compute[74669]:   <name>instance-00000019</name>
Nov 08 17:12:36 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:12:36 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:12:36 user nova-compute[74669]:   <metadata>
Nov 08 17:12:36 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:12:36 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:12:36 user nova-compute[74669]:       <nova:name>tempest-AttachVolumeTestJSON-server-546386835</nova:name>
Nov 08 17:12:36 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:12:36</nova:creationTime>
Nov 08 17:12:36 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:12:36 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:12:36 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:12:36 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:12:36 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:12:36 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:12:36 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:12:36 user nova-compute[74669]:       <nova:owner>
Nov 08 17:12:36 user nova-compute[74669]:         <nova:user uuid="80fd41a7ea7943e6a913c211f6ea2d52">tempest-AttachVolumeTestJSON-275457186-project-member</nova:user>
Nov 08 17:12:36 user nova-compute[74669]:         <nova:project uuid="5a7febf2b00147cfb989380452aba869">tempest-AttachVolumeTestJSON-275457186</nova:project>
Nov 08 17:12:36 user nova-compute[74669]:       </nova:owner>
Nov 08 17:12:36 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:12:36 user nova-compute[74669]:       <nova:ports>
Nov 08 17:12:36 user nova-compute[74669]:         <nova:port uuid="d0dc10aa-3fca-4242-8895-241190da8780">
Nov 08 17:12:36 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 17:12:36 user nova-compute[74669]:         </nova:port>
Nov 08 17:12:36 user nova-compute[74669]:       </nova:ports>
Nov 08 17:12:36 user nova-compute[74669]:     </nova:instance>
Nov 08 17:12:36 user nova-compute[74669]:   </metadata>
Nov 08 17:12:36 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:12:36 user nova-compute[74669]:     <system>
Nov 08 17:12:36 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:12:36 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:12:36 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:12:36 user nova-compute[74669]:       <entry name="serial">af8b58ff-90d5-4a04-844a-ac0534a7e413</entry>
Nov 08 17:12:36 user nova-compute[74669]:       <entry name="uuid">af8b58ff-90d5-4a04-844a-ac0534a7e413</entry>
Nov 08 17:12:36 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:12:36 user nova-compute[74669]:     </system>
Nov 08 17:12:36 user nova-compute[74669]:   </sysinfo>
Nov 08 17:12:36 user nova-compute[74669]:   <os>
Nov 08 17:12:36 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:12:36 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:12:36 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:12:36 user nova-compute[74669]:   </os>
Nov 08 17:12:36 user nova-compute[74669]:   <features>
Nov 08 17:12:36 user nova-compute[74669]:     <acpi/>
Nov 08 17:12:36 user nova-compute[74669]:     <apic/>
Nov 08 17:12:36 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:12:36 user nova-compute[74669]:   </features>
Nov 08 17:12:36 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:12:36 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:12:36 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:12:36 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:12:36 user nova-compute[74669]:   </clock>
Nov 08 17:12:36 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:12:36 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:12:36 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:12:36 user nova-compute[74669]:   </cpu>
Nov 08 17:12:36 user nova-compute[74669]:   <devices>
Nov 08 17:12:36 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:12:36 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:12:36 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk"/>
Nov 08 17:12:36 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:12:36 user nova-compute[74669]:     </disk>
Nov 08 17:12:36 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:12:36 user nova-compute[74669]:       <mac address="fa:16:3e:4d:2d:67"/>
Nov 08 17:12:36 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:12:36 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:12:36 user nova-compute[74669]:       <target dev="tapd0dc10aa-3f"/>
Nov 08 17:12:36 user nova-compute[74669]:     </interface>
Nov 08 17:12:36 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:12:36 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/console.log" append="off"/>
Nov 08 17:12:36 user nova-compute[74669]:     </serial>
Nov 08 17:12:36 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:12:36 user nova-compute[74669]:     <video>
Nov 08 17:12:36 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:12:36 user nova-compute[74669]:     </video>
Nov 08 17:12:36 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:12:36 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:12:36 user nova-compute[74669]:     </rng>
Nov 08 17:12:36 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:12:36 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:12:36 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:12:36 user nova-compute[74669]:     </memballoon>
Nov 08 17:12:36 user nova-compute[74669]:   </devices>
Nov 08 17:12:36 user nova-compute[74669]: </domain>
Nov 08 17:12:36 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.objects.instance [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'trusted_certs' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.objects.base [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Object Instance<af8b58ff-90d5-4a04-844a-ac0534a7e413> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.175s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:36 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Cannot resize image /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG nova.objects.instance [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'migration_context' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG nova.objects.base [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Object Instance<af8b58ff-90d5-4a04-844a-ac0534a7e413> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:03:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-546386835',display_name='tempest-AttachVolumeTestJSON-server-546386835',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-546386835',id=25,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXViWU/BdYxMm5+lemyfZcP7+TCdB2OaD+dWs6IPD7DtEkJGE2tx2z335cOHjRlBjCNb0QrrgNRKB9Cr8JI7YWfGi7dauKEckz8JkFarm7hJu+kJ/zQZH4rAL4xDCaMWg==',key_name='tempest-keypair-1427520299',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:03:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5a7febf2b00147cfb989380452aba869',ramdisk_id='',reservation_id='r-l53uvaaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-275457186',owner_user_name='tempest-AttachVolumeTestJSON-275457186-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:10:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fd41a7ea7943e6a913c211f6ea2d52',uuid=af8b58ff-90d5-4a04-844a-ac0534a7e413,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converting VIF {"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2d:67,bridge_name='br-int',has_traffic_filtering=True,id=d0dc10aa-3fca-4242-8895-241190da8780,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dc10aa-3f') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG os_vif [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2d:67,bridge_name='br-int',has_traffic_filtering=True,id=d0dc10aa-3fca-4242-8895-241190da8780,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dc10aa-3f') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7bec5e43-b5a9-5f52-9259-a92ac9f34e2a', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0dc10aa-3f, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0dc10aa-3f, col_values=(('qos', UUID('7cc0b7ac-d097-4c7f-bbe4-2b80c456c748')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0dc10aa-3f, col_values=(('external_ids', {'iface-id': 'd0dc10aa-3fca-4242-8895-241190da8780', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:2d:67', 'vm-uuid': 'af8b58ff-90d5-4a04-844a-ac0534a7e413'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:37 user nova-compute[74669]: INFO os_vif [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:2d:67,bridge_name='br-int',has_traffic_filtering=True,id=d0dc10aa-3fca-4242-8895-241190da8780,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dc10aa-3f')
Nov 08 17:12:37 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URyZvqHI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23132323961353937', 'path': '/dev/sdc'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132323961353937', 'path': '/dev/sdc'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG nova.objects.instance [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lazy-loading 'flavor' on Instance uuid 3754330e-8b41-4e69-93f9-508ef5adf772 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:12:37 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 17:12:37 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:12:37 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 17:12:37 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:12:37 user nova-compute[74669]:   <serial>8b98844f-8f0c-44cd-92d2-4650be2efbaa</serial>
Nov 08 17:12:37 user nova-compute[74669]: </disk>
Nov 08 17:12:37 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 17:12:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:12:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:12:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] No VIF found with MAC fa:16:3e:b6:8f:c8, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:12:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-25ae9959-7083-4be1-82f8-3467593e775f tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "3754330e-8b41-4e69-93f9-508ef5adf772" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.101s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:39 user nova-compute[74669]: DEBUG nova.compute.manager [req-cc57101a-ac22-4b87-a051-417aa47896bf req-e4946d75-e6ab-404f-86ba-a0c65d80d096 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received event network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:12:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-cc57101a-ac22-4b87-a051-417aa47896bf req-e4946d75-e6ab-404f-86ba-a0c65d80d096 service nova] Acquiring lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-cc57101a-ac22-4b87-a051-417aa47896bf req-e4946d75-e6ab-404f-86ba-a0c65d80d096 service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-cc57101a-ac22-4b87-a051-417aa47896bf req-e4946d75-e6ab-404f-86ba-a0c65d80d096 service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:39 user nova-compute[74669]: DEBUG nova.compute.manager [req-cc57101a-ac22-4b87-a051-417aa47896bf req-e4946d75-e6ab-404f-86ba-a0c65d80d096 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] No waiting events found dispatching network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:12:39 user nova-compute[74669]: WARNING nova.compute.manager [req-cc57101a-ac22-4b87-a051-417aa47896bf req-e4946d75-e6ab-404f-86ba-a0c65d80d096 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received unexpected event network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 for instance with vm_state stopped and task_state powering-on.
Nov 08 17:12:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:40 user nova-compute[74669]: DEBUG nova.compute.manager [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:12:40 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Instance rebooted successfully.
Nov 08 17:12:40 user nova-compute[74669]: DEBUG nova.compute.manager [None req-4ffb8411-b8cc-48a0-9474-28686cbebe52 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:12:41 user nova-compute[74669]: DEBUG nova.compute.manager [req-3c50aacf-85dc-4bb9-ba9c-0b5157bccf54 req-377dd19b-fa8c-486b-bef6-732823301f90 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received event network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:12:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3c50aacf-85dc-4bb9-ba9c-0b5157bccf54 req-377dd19b-fa8c-486b-bef6-732823301f90 service nova] Acquiring lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3c50aacf-85dc-4bb9-ba9c-0b5157bccf54 req-377dd19b-fa8c-486b-bef6-732823301f90 service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3c50aacf-85dc-4bb9-ba9c-0b5157bccf54 req-377dd19b-fa8c-486b-bef6-732823301f90 service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:41 user nova-compute[74669]: DEBUG nova.compute.manager [req-3c50aacf-85dc-4bb9-ba9c-0b5157bccf54 req-377dd19b-fa8c-486b-bef6-732823301f90 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] No waiting events found dispatching network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:12:41 user nova-compute[74669]: WARNING nova.compute.manager [req-3c50aacf-85dc-4bb9-ba9c-0b5157bccf54 req-377dd19b-fa8c-486b-bef6-732823301f90 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received unexpected event network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 for instance with vm_state active and task_state None.
Nov 08 17:12:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "f3559fce-3321-439f-bbed-5e0a8c5dcba0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "f3559fce-3321-439f-bbed-5e0a8c5dcba0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:41 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:12:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:41 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:12:41 user nova-compute[74669]: INFO nova.compute.claims [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Claim successful on node user
Nov 08 17:12:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:42 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:12:42 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:12:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:42 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:12:42 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:12:42 user nova-compute[74669]: DEBUG nova.network.neutron [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:12:42 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:12:42 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:12:42 user nova-compute[74669]: DEBUG nova.policy [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '565488b722e44809a7cff5e617daae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58f78f65e774cf78ca0c49aa11f9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:12:42 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:12:42 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:12:42 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Creating image(s)
Nov 08 17:12:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3559fce-3321-439f-bbed-5e0a8c5dcba0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "/opt/stack/data/nova/instances/f3559fce-3321-439f-bbed-5e0a8c5dcba0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "/opt/stack/data/nova/instances/f3559fce-3321-439f-bbed-5e0a8c5dcba0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.173s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.176s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/f3559fce-3321-439f-bbed-5e0a8c5dcba0/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/f3559fce-3321-439f-bbed-5e0a8c5dcba0/disk 1073741824" returned: 0 in 0.065s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.195s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:43 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3559fce-3321-439f-bbed-5e0a8c5dcba0/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:12:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3559fce-3321-439f-bbed-5e0a8c5dcba0/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:12:43 user nova-compute[74669]: DEBUG nova.network.neutron [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Successfully created port: 8ac1e188-89c7-4f6e-8275-6c2211df8158 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:12:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3559fce-3321-439f-bbed-5e0a8c5dcba0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:12:43 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Cannot resize image /opt/stack/data/nova/instances/f3559fce-3321-439f-bbed-5e0a8c5dcba0/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:12:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:12:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Ensure instance console log exists: /opt/stack/data/nova/instances/f3559fce-3321-439f-bbed-5e0a8c5dcba0/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:12:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.network.neutron [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Successfully updated port: 8ac1e188-89c7-4f6e-8275-6c2211df8158 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "refresh_cache-f3559fce-3321-439f-bbed-5e0a8c5dcba0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquired lock "refresh_cache-f3559fce-3321-439f-bbed-5e0a8c5dcba0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.network.neutron [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-c839e85c-4cec-48c2-b8d0-7a140a24624e req-5c418e6b-aa38-48e2-a06c-989341ff1a34 service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Received event network-changed-8ac1e188-89c7-4f6e-8275-6c2211df8158 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-c839e85c-4cec-48c2-b8d0-7a140a24624e req-5c418e6b-aa38-48e2-a06c-989341ff1a34 service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Refreshing instance network info cache due to event network-changed-8ac1e188-89c7-4f6e-8275-6c2211df8158. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c839e85c-4cec-48c2-b8d0-7a140a24624e req-5c418e6b-aa38-48e2-a06c-989341ff1a34 service nova] Acquiring lock "refresh_cache-f3559fce-3321-439f-bbed-5e0a8c5dcba0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.network.neutron [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.network.neutron [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Updating instance_info_cache with network_info: [{"id": "8ac1e188-89c7-4f6e-8275-6c2211df8158", "address": "fa:16:3e:12:fc:1f", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac1e188-89", "ovs_interfaceid": "8ac1e188-89c7-4f6e-8275-6c2211df8158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Releasing lock "refresh_cache-f3559fce-3321-439f-bbed-5e0a8c5dcba0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Instance network_info: |[{"id": "8ac1e188-89c7-4f6e-8275-6c2211df8158", "address": "fa:16:3e:12:fc:1f", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac1e188-89", "ovs_interfaceid": "8ac1e188-89c7-4f6e-8275-6c2211df8158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c839e85c-4cec-48c2-b8d0-7a140a24624e req-5c418e6b-aa38-48e2-a06c-989341ff1a34 service nova] Acquired lock "refresh_cache-f3559fce-3321-439f-bbed-5e0a8c5dcba0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.network.neutron [req-c839e85c-4cec-48c2-b8d0-7a140a24624e req-5c418e6b-aa38-48e2-a06c-989341ff1a34 service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Refreshing network info cache for port 8ac1e188-89c7-4f6e-8275-6c2211df8158 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Start _get_guest_xml network_info=[{"id": "8ac1e188-89c7-4f6e-8275-6c2211df8158", "address": "fa:16:3e:12:fc:1f", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac1e188-89", "ovs_interfaceid": "8ac1e188-89c7-4f6e-8275-6c2211df8158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:12:44 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:12:44 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:12:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1246546367',display_name='tempest-AttachVolumeNegativeTest-server-1246546367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1246546367',id=34,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3A5E9GrzoXp3mLdbaxzhOaqS+o9VB3b55lSO1/mDRCt4wlAshMSqmt2lc6J5HS1JNpeGEFvoPmrn2uo8kUuwvwg+rfDx6/8h0KAwGvXHxTskCBo99aEgrP0HPqz2eNcw==',key_name='tempest-keypair-1759484736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f58f78f65e774cf78ca0c49aa11f9b54',ramdisk_id='',reservation_id='r-1zxc0c36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1846694333',owner_user_name='tempest-AttachVolumeNegativeTest-1846694333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:12:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='565488b722e44809a7cff5e617daae84',uuid=f3559fce-3321-439f-bbed-5e0a8c5dcba0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ac1e188-89c7-4f6e-8275-6c2211df8158", "address": "fa:16:3e:12:fc:1f", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac1e188-89", "ovs_interfaceid": "8ac1e188-89c7-4f6e-8275-6c2211df8158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converting VIF {"id": "8ac1e188-89c7-4f6e-8275-6c2211df8158", "address": "fa:16:3e:12:fc:1f", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac1e188-89", "ovs_interfaceid": "8ac1e188-89c7-4f6e-8275-6c2211df8158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:fc:1f,bridge_name='br-int',has_traffic_filtering=True,id=8ac1e188-89c7-4f6e-8275-6c2211df8158,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac1e188-89') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.objects.instance [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lazy-loading 'pci_devices' on Instance uuid f3559fce-3321-439f-bbed-5e0a8c5dcba0 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:12:44 user nova-compute[74669]:   <uuid>f3559fce-3321-439f-bbed-5e0a8c5dcba0</uuid>
Nov 08 17:12:44 user nova-compute[74669]:   <name>instance-00000022</name>
Nov 08 17:12:44 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:12:44 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:12:44 user nova-compute[74669]:   <metadata>
Nov 08 17:12:44 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:12:44 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:12:44 user nova-compute[74669]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1246546367</nova:name>
Nov 08 17:12:44 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:12:44</nova:creationTime>
Nov 08 17:12:44 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:12:44 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:12:44 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:12:44 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:12:44 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:12:44 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:12:44 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:12:44 user nova-compute[74669]:       <nova:owner>
Nov 08 17:12:44 user nova-compute[74669]:         <nova:user uuid="565488b722e44809a7cff5e617daae84">tempest-AttachVolumeNegativeTest-1846694333-project-member</nova:user>
Nov 08 17:12:44 user nova-compute[74669]:         <nova:project uuid="f58f78f65e774cf78ca0c49aa11f9b54">tempest-AttachVolumeNegativeTest-1846694333</nova:project>
Nov 08 17:12:44 user nova-compute[74669]:       </nova:owner>
Nov 08 17:12:44 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:12:44 user nova-compute[74669]:       <nova:ports>
Nov 08 17:12:44 user nova-compute[74669]:         <nova:port uuid="8ac1e188-89c7-4f6e-8275-6c2211df8158">
Nov 08 17:12:44 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 17:12:44 user nova-compute[74669]:         </nova:port>
Nov 08 17:12:44 user nova-compute[74669]:       </nova:ports>
Nov 08 17:12:44 user nova-compute[74669]:     </nova:instance>
Nov 08 17:12:44 user nova-compute[74669]:   </metadata>
Nov 08 17:12:44 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:12:44 user nova-compute[74669]:     <system>
Nov 08 17:12:44 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:12:44 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:12:44 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:12:44 user nova-compute[74669]:       <entry name="serial">f3559fce-3321-439f-bbed-5e0a8c5dcba0</entry>
Nov 08 17:12:44 user nova-compute[74669]:       <entry name="uuid">f3559fce-3321-439f-bbed-5e0a8c5dcba0</entry>
Nov 08 17:12:44 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:12:44 user nova-compute[74669]:     </system>
Nov 08 17:12:44 user nova-compute[74669]:   </sysinfo>
Nov 08 17:12:44 user nova-compute[74669]:   <os>
Nov 08 17:12:44 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:12:44 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:12:44 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:12:44 user nova-compute[74669]:   </os>
Nov 08 17:12:44 user nova-compute[74669]:   <features>
Nov 08 17:12:44 user nova-compute[74669]:     <acpi/>
Nov 08 17:12:44 user nova-compute[74669]:     <apic/>
Nov 08 17:12:44 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:12:44 user nova-compute[74669]:   </features>
Nov 08 17:12:44 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:12:44 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:12:44 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:12:44 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:12:44 user nova-compute[74669]:   </clock>
Nov 08 17:12:44 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:12:44 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:12:44 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:12:44 user nova-compute[74669]:   </cpu>
Nov 08 17:12:44 user nova-compute[74669]:   <devices>
Nov 08 17:12:44 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:12:44 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:12:44 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/f3559fce-3321-439f-bbed-5e0a8c5dcba0/disk"/>
Nov 08 17:12:44 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:12:44 user nova-compute[74669]:     </disk>
Nov 08 17:12:44 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:12:44 user nova-compute[74669]:       <mac address="fa:16:3e:12:fc:1f"/>
Nov 08 17:12:44 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:12:44 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:12:44 user nova-compute[74669]:       <target dev="tap8ac1e188-89"/>
Nov 08 17:12:44 user nova-compute[74669]:     </interface>
Nov 08 17:12:44 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:12:44 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/f3559fce-3321-439f-bbed-5e0a8c5dcba0/console.log" append="off"/>
Nov 08 17:12:44 user nova-compute[74669]:     </serial>
Nov 08 17:12:44 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:12:44 user nova-compute[74669]:     <video>
Nov 08 17:12:44 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:12:44 user nova-compute[74669]:     </video>
Nov 08 17:12:44 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:12:44 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:12:44 user nova-compute[74669]:     </rng>
Nov 08 17:12:44 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:12:44 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:12:44 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:12:44 user nova-compute[74669]:     </memballoon>
Nov 08 17:12:44 user nova-compute[74669]:   </devices>
Nov 08 17:12:44 user nova-compute[74669]: </domain>
Nov 08 17:12:44 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:12:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1246546367',display_name='tempest-AttachVolumeNegativeTest-server-1246546367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1246546367',id=34,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3A5E9GrzoXp3mLdbaxzhOaqS+o9VB3b55lSO1/mDRCt4wlAshMSqmt2lc6J5HS1JNpeGEFvoPmrn2uo8kUuwvwg+rfDx6/8h0KAwGvXHxTskCBo99aEgrP0HPqz2eNcw==',key_name='tempest-keypair-1759484736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f58f78f65e774cf78ca0c49aa11f9b54',ramdisk_id='',reservation_id='r-1zxc0c36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1846694333',owner_user_name='tempest-AttachVolumeNegativeTest-1846694333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:12:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='565488b722e44809a7cff5e617daae84',uuid=f3559fce-3321-439f-bbed-5e0a8c5dcba0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ac1e188-89c7-4f6e-8275-6c2211df8158", "address": "fa:16:3e:12:fc:1f", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac1e188-89", "ovs_interfaceid": "8ac1e188-89c7-4f6e-8275-6c2211df8158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converting VIF {"id": "8ac1e188-89c7-4f6e-8275-6c2211df8158", "address": "fa:16:3e:12:fc:1f", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac1e188-89", "ovs_interfaceid": "8ac1e188-89c7-4f6e-8275-6c2211df8158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:fc:1f,bridge_name='br-int',has_traffic_filtering=True,id=8ac1e188-89c7-4f6e-8275-6c2211df8158,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac1e188-89') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG os_vif [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:fc:1f,bridge_name='br-int',has_traffic_filtering=True,id=8ac1e188-89c7-4f6e-8275-6c2211df8158,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac1e188-89') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9b63b2a-f1c4-58b7-8c4e-5c6e263d8e46', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ac1e188-89, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ac1e188-89, col_values=(('qos', UUID('bd16333f-e69a-4b71-b0db-1de99cb074d9')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ac1e188-89, col_values=(('external_ids', {'iface-id': '8ac1e188-89c7-4f6e-8275-6c2211df8158', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:fc:1f', 'vm-uuid': 'f3559fce-3321-439f-bbed-5e0a8c5dcba0'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:44 user nova-compute[74669]: INFO os_vif [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:fc:1f,bridge_name='br-int',has_traffic_filtering=True,id=8ac1e188-89c7-4f6e-8275-6c2211df8158,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac1e188-89')
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:12:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] No VIF found with MAC fa:16:3e:12:fc:1f, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:12:45 user nova-compute[74669]: DEBUG nova.network.neutron [req-c839e85c-4cec-48c2-b8d0-7a140a24624e req-5c418e6b-aa38-48e2-a06c-989341ff1a34 service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Updated VIF entry in instance network info cache for port 8ac1e188-89c7-4f6e-8275-6c2211df8158. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:12:45 user nova-compute[74669]: DEBUG nova.network.neutron [req-c839e85c-4cec-48c2-b8d0-7a140a24624e req-5c418e6b-aa38-48e2-a06c-989341ff1a34 service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Updating instance_info_cache with network_info: [{"id": "8ac1e188-89c7-4f6e-8275-6c2211df8158", "address": "fa:16:3e:12:fc:1f", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac1e188-89", "ovs_interfaceid": "8ac1e188-89c7-4f6e-8275-6c2211df8158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:12:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c839e85c-4cec-48c2-b8d0-7a140a24624e req-5c418e6b-aa38-48e2-a06c-989341ff1a34 service nova] Releasing lock "refresh_cache-f3559fce-3321-439f-bbed-5e0a8c5dcba0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:12:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:46 user nova-compute[74669]: DEBUG nova.compute.manager [req-0934006f-90d3-4d99-9954-0ba8dd1020d5 req-61f042d4-f226-4c4c-a1f2-5bab3a9938dd service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Received event network-vif-plugged-8ac1e188-89c7-4f6e-8275-6c2211df8158 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:12:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0934006f-90d3-4d99-9954-0ba8dd1020d5 req-61f042d4-f226-4c4c-a1f2-5bab3a9938dd service nova] Acquiring lock "f3559fce-3321-439f-bbed-5e0a8c5dcba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0934006f-90d3-4d99-9954-0ba8dd1020d5 req-61f042d4-f226-4c4c-a1f2-5bab3a9938dd service nova] Lock "f3559fce-3321-439f-bbed-5e0a8c5dcba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0934006f-90d3-4d99-9954-0ba8dd1020d5 req-61f042d4-f226-4c4c-a1f2-5bab3a9938dd service nova] Lock "f3559fce-3321-439f-bbed-5e0a8c5dcba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:46 user nova-compute[74669]: DEBUG nova.compute.manager [req-0934006f-90d3-4d99-9954-0ba8dd1020d5 req-61f042d4-f226-4c4c-a1f2-5bab3a9938dd service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] No waiting events found dispatching network-vif-plugged-8ac1e188-89c7-4f6e-8275-6c2211df8158 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:12:46 user nova-compute[74669]: WARNING nova.compute.manager [req-0934006f-90d3-4d99-9954-0ba8dd1020d5 req-61f042d4-f226-4c4c-a1f2-5bab3a9938dd service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Received unexpected event network-vif-plugged-8ac1e188-89c7-4f6e-8275-6c2211df8158 for instance with vm_state building and task_state spawning.
Nov 08 17:12:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:48 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:12:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:12:48 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Instance spawned successfully.
Nov 08 17:12:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:12:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:12:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:12:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:12:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:12:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:12:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:12:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-e216c519-0d1f-4b10-81e4-854ba356ce6f req-d9a0cac1-ab6e-4224-9904-4837b5bce704 service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Received event network-vif-plugged-8ac1e188-89c7-4f6e-8275-6c2211df8158 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:12:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e216c519-0d1f-4b10-81e4-854ba356ce6f req-d9a0cac1-ab6e-4224-9904-4837b5bce704 service nova] Acquiring lock "f3559fce-3321-439f-bbed-5e0a8c5dcba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:12:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e216c519-0d1f-4b10-81e4-854ba356ce6f req-d9a0cac1-ab6e-4224-9904-4837b5bce704 service nova] Lock "f3559fce-3321-439f-bbed-5e0a8c5dcba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:12:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e216c519-0d1f-4b10-81e4-854ba356ce6f req-d9a0cac1-ab6e-4224-9904-4837b5bce704 service nova] Lock "f3559fce-3321-439f-bbed-5e0a8c5dcba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-e216c519-0d1f-4b10-81e4-854ba356ce6f req-d9a0cac1-ab6e-4224-9904-4837b5bce704 service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] No waiting events found dispatching network-vif-plugged-8ac1e188-89c7-4f6e-8275-6c2211df8158 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:12:48 user nova-compute[74669]: WARNING nova.compute.manager [req-e216c519-0d1f-4b10-81e4-854ba356ce6f req-d9a0cac1-ab6e-4224-9904-4837b5bce704 service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Received unexpected event network-vif-plugged-8ac1e188-89c7-4f6e-8275-6c2211df8158 for instance with vm_state building and task_state spawning.
Nov 08 17:12:48 user nova-compute[74669]: INFO nova.compute.manager [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Took 6.07 seconds to spawn the instance on the hypervisor.
Nov 08 17:12:48 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:12:48 user nova-compute[74669]: INFO nova.compute.manager [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Took 6.83 seconds to build instance.
Nov 08 17:12:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5cfa3401-7fc2-4cab-9fcc-e090fa407190 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "f3559fce-3321-439f-bbed-5e0a8c5dcba0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.961s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:12:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:58 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:12:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:12:59 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:13:00 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:13:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:13:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:13:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:13:00 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:13:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe10edb-fda0-4a16-8cf4-faf7d6d8c93f/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe10edb-fda0-4a16-8cf4-faf7d6d8c93f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe10edb-fda0-4a16-8cf4-faf7d6d8c93f/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efe10edb-fda0-4a16-8cf4-faf7d6d8c93f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:13:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3559fce-3321-439f-bbed-5e0a8c5dcba0/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3559fce-3321-439f-bbed-5e0a8c5dcba0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3559fce-3321-439f-bbed-5e0a8c5dcba0/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3559fce-3321-439f-bbed-5e0a8c5dcba0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:13:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:04 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:13:04 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:13:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=7694MB free_disk=25.243091583251953GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:13:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:13:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:13:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Applying migration context for instance 746bdbac-3e36-4a08-989a-c004634890f9 as it has an incoming, in-progress migration 18964ccc-62a7-41dd-ae99-01443023dc5f. Migration status is finished {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 17:13:04 user nova-compute[74669]: INFO nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Updating resource usage from migration 18964ccc-62a7-41dd-ae99-01443023dc5f
Nov 08 17:13:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7b335462-0d93-4899-a223-5c2e36932578 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:13:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance af8b58ff-90d5-4a04-844a-ac0534a7e413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:13:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2158a7c2-2f46-4bce-8558-4347a48623d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:13:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 3754330e-8b41-4e69-93f9-508ef5adf772 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:13:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance efe10edb-fda0-4a16-8cf4-faf7d6d8c93f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:13:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance e33217d2-fd96-49fb-9727-faeb76f0e219 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:13:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Migration 18964ccc-62a7-41dd-ae99-01443023dc5f is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 17:13:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 746bdbac-3e36-4a08-989a-c004634890f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:13:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance bf46a10b-747a-490c-8e22-a76ec65fafdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:13:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance f3559fce-3321-439f-bbed-5e0a8c5dcba0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:13:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:13:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:13:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:04 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:13:04 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:13:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:13:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.455s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:13:06 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:13:06 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:13:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:13:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 17:13:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:13:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:13:07 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:13:07 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lazy-loading 'info_cache' on Instance uuid 7b335462-0d93-4899-a223-5c2e36932578 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:13:07 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Updating instance_info_cache with network_info: [{"id": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "address": "fa:16:3e:e6:99:99", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bfc353f-1f", "ovs_interfaceid": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:13:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-7b335462-0d93-4899-a223-5c2e36932578" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:13:07 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:13:07 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:13:07 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:13:07 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:13:07 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:13:07 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:13:08 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:13:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Acquiring lock "efe10edb-fda0-4a16-8cf4-faf7d6d8c93f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "efe10edb-fda0-4a16-8cf4-faf7d6d8c93f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Acquiring lock "efe10edb-fda0-4a16-8cf4-faf7d6d8c93f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "efe10edb-fda0-4a16-8cf4-faf7d6d8c93f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "efe10edb-fda0-4a16-8cf4-faf7d6d8c93f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:13:27 user nova-compute[74669]: INFO nova.compute.manager [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Terminating instance
Nov 08 17:13:27 user nova-compute[74669]: DEBUG nova.compute.manager [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-fc72ba51-8f94-4a43-a5e5-de0fbb81075b req-60848b71-7b2c-4b1e-b916-f4bd66e62a0e service nova] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Received event network-vif-unplugged-f8dc2550-66e7-4d47-9ea3-bd2afe97a056 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-fc72ba51-8f94-4a43-a5e5-de0fbb81075b req-60848b71-7b2c-4b1e-b916-f4bd66e62a0e service nova] Acquiring lock "efe10edb-fda0-4a16-8cf4-faf7d6d8c93f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-fc72ba51-8f94-4a43-a5e5-de0fbb81075b req-60848b71-7b2c-4b1e-b916-f4bd66e62a0e service nova] Lock "efe10edb-fda0-4a16-8cf4-faf7d6d8c93f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-fc72ba51-8f94-4a43-a5e5-de0fbb81075b req-60848b71-7b2c-4b1e-b916-f4bd66e62a0e service nova] Lock "efe10edb-fda0-4a16-8cf4-faf7d6d8c93f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-fc72ba51-8f94-4a43-a5e5-de0fbb81075b req-60848b71-7b2c-4b1e-b916-f4bd66e62a0e service nova] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] No waiting events found dispatching network-vif-unplugged-f8dc2550-66e7-4d47-9ea3-bd2afe97a056 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-fc72ba51-8f94-4a43-a5e5-de0fbb81075b req-60848b71-7b2c-4b1e-b916-f4bd66e62a0e service nova] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Received event network-vif-unplugged-f8dc2550-66e7-4d47-9ea3-bd2afe97a056 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:27 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Instance destroyed successfully.
Nov 08 17:13:27 user nova-compute[74669]: DEBUG nova.objects.instance [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lazy-loading 'resources' on Instance uuid efe10edb-fda0-4a16-8cf4-faf7d6d8c93f {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:11:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1861934215',display_name='tempest-ServersNegativeTestJSON-server-1861934215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1861934215',id=32,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:11:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae1a781163a345dc8be717e3e7c73788',ramdisk_id='',reservation_id='r-wa8kabbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1017043905',owner_user_name='tempest-ServersNegativeTestJSON-1017043905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:11:45Z,user_data=None,user_id='a3b60e9d47ab49f8bd3614621e2bd890',uuid=efe10edb-fda0-4a16-8cf4-faf7d6d8c93f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8dc2550-66e7-4d47-9ea3-bd2afe97a056", "address": "fa:16:3e:56:09:cb", "network": {"id": "52bf51f6-cf7e-403b-b601-0660b9c8544f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-17276515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1a781163a345dc8be717e3e7c73788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc2550-66", "ovs_interfaceid": "f8dc2550-66e7-4d47-9ea3-bd2afe97a056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Converting VIF {"id": "f8dc2550-66e7-4d47-9ea3-bd2afe97a056", "address": "fa:16:3e:56:09:cb", "network": {"id": "52bf51f6-cf7e-403b-b601-0660b9c8544f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-17276515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1a781163a345dc8be717e3e7c73788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8dc2550-66", "ovs_interfaceid": "f8dc2550-66e7-4d47-9ea3-bd2afe97a056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:09:cb,bridge_name='br-int',has_traffic_filtering=True,id=f8dc2550-66e7-4d47-9ea3-bd2afe97a056,network=Network(52bf51f6-cf7e-403b-b601-0660b9c8544f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8dc2550-66') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG os_vif [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:09:cb,bridge_name='br-int',has_traffic_filtering=True,id=f8dc2550-66e7-4d47-9ea3-bd2afe97a056,network=Network(52bf51f6-cf7e-403b-b601-0660b9c8544f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8dc2550-66') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8dc2550-66, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6b83c1d-6fd9-4e1b-87f9-78a478cadee3) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:27 user nova-compute[74669]: INFO os_vif [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:09:cb,bridge_name='br-int',has_traffic_filtering=True,id=f8dc2550-66e7-4d47-9ea3-bd2afe97a056,network=Network(52bf51f6-cf7e-403b-b601-0660b9c8544f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8dc2550-66')
Nov 08 17:13:27 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Deleting instance files /opt/stack/data/nova/instances/efe10edb-fda0-4a16-8cf4-faf7d6d8c93f_del
Nov 08 17:13:27 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Deletion of /opt/stack/data/nova/instances/efe10edb-fda0-4a16-8cf4-faf7d6d8c93f_del complete
Nov 08 17:13:28 user nova-compute[74669]: INFO nova.compute.manager [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 08 17:13:28 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:13:28 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:13:28 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:13:28 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:13:28 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Took 0.46 seconds to deallocate network for instance.
Nov 08 17:13:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:13:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:13:28 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:13:28 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:13:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:13:28 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Deleted allocations for instance efe10edb-fda0-4a16-8cf4-faf7d6d8c93f
Nov 08 17:13:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8ddb9839-cbbd-4151-815c-72d4917459a7 tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "efe10edb-fda0-4a16-8cf4-faf7d6d8c93f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.652s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:13:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-365b9836-603e-4bf7-85cb-1efe22723ee2 req-34983017-443d-452b-ac40-b409060a0a98 service nova] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Received event network-vif-plugged-f8dc2550-66e7-4d47-9ea3-bd2afe97a056 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:13:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-365b9836-603e-4bf7-85cb-1efe22723ee2 req-34983017-443d-452b-ac40-b409060a0a98 service nova] Acquiring lock "efe10edb-fda0-4a16-8cf4-faf7d6d8c93f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:13:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-365b9836-603e-4bf7-85cb-1efe22723ee2 req-34983017-443d-452b-ac40-b409060a0a98 service nova] Lock "efe10edb-fda0-4a16-8cf4-faf7d6d8c93f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:13:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-365b9836-603e-4bf7-85cb-1efe22723ee2 req-34983017-443d-452b-ac40-b409060a0a98 service nova] Lock "efe10edb-fda0-4a16-8cf4-faf7d6d8c93f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:13:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-365b9836-603e-4bf7-85cb-1efe22723ee2 req-34983017-443d-452b-ac40-b409060a0a98 service nova] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] No waiting events found dispatching network-vif-plugged-f8dc2550-66e7-4d47-9ea3-bd2afe97a056 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:13:29 user nova-compute[74669]: WARNING nova.compute.manager [req-365b9836-603e-4bf7-85cb-1efe22723ee2 req-34983017-443d-452b-ac40-b409060a0a98 service nova] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Received unexpected event network-vif-plugged-f8dc2550-66e7-4d47-9ea3-bd2afe97a056 for instance with vm_state deleted and task_state None.
Nov 08 17:13:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-365b9836-603e-4bf7-85cb-1efe22723ee2 req-34983017-443d-452b-ac40-b409060a0a98 service nova] [instance: efe10edb-fda0-4a16-8cf4-faf7d6d8c93f] Received event network-vif-deleted-f8dc2550-66e7-4d47-9ea3-bd2afe97a056 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:13:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-92da9d73-8cf9-4e68-889d-da71527c7e1e req-71167b7d-409b-425e-b091-2a6b13494ead service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Received event network-changed-47ecb2d0-7388-4a1f-a5c1-a7090c790f36 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:13:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-92da9d73-8cf9-4e68-889d-da71527c7e1e req-71167b7d-409b-425e-b091-2a6b13494ead service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Refreshing instance network info cache due to event network-changed-47ecb2d0-7388-4a1f-a5c1-a7090c790f36. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:13:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-92da9d73-8cf9-4e68-889d-da71527c7e1e req-71167b7d-409b-425e-b091-2a6b13494ead service nova] Acquiring lock "refresh_cache-e33217d2-fd96-49fb-9727-faeb76f0e219" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:13:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-92da9d73-8cf9-4e68-889d-da71527c7e1e req-71167b7d-409b-425e-b091-2a6b13494ead service nova] Acquired lock "refresh_cache-e33217d2-fd96-49fb-9727-faeb76f0e219" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:13:29 user nova-compute[74669]: DEBUG nova.network.neutron [req-92da9d73-8cf9-4e68-889d-da71527c7e1e req-71167b7d-409b-425e-b091-2a6b13494ead service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Refreshing network info cache for port 47ecb2d0-7388-4a1f-a5c1-a7090c790f36 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:13:30 user nova-compute[74669]: DEBUG nova.network.neutron [req-92da9d73-8cf9-4e68-889d-da71527c7e1e req-71167b7d-409b-425e-b091-2a6b13494ead service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Updated VIF entry in instance network info cache for port 47ecb2d0-7388-4a1f-a5c1-a7090c790f36. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:13:30 user nova-compute[74669]: DEBUG nova.network.neutron [req-92da9d73-8cf9-4e68-889d-da71527c7e1e req-71167b7d-409b-425e-b091-2a6b13494ead service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Updating instance_info_cache with network_info: [{"id": "47ecb2d0-7388-4a1f-a5c1-a7090c790f36", "address": "fa:16:3e:68:6f:55", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ecb2d0-73", "ovs_interfaceid": "47ecb2d0-7388-4a1f-a5c1-a7090c790f36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:13:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-92da9d73-8cf9-4e68-889d-da71527c7e1e req-71167b7d-409b-425e-b091-2a6b13494ead service nova] Releasing lock "refresh_cache-e33217d2-fd96-49fb-9727-faeb76f0e219" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "e33217d2-fd96-49fb-9727-faeb76f0e219" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "e33217d2-fd96-49fb-9727-faeb76f0e219" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG nova.objects.instance [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lazy-loading 'flavor' on Instance uuid e33217d2-fd96-49fb-9727-faeb76f0e219 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:13:31 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Ignoring supplied device name: /dev/vdb
Nov 08 17:13:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "e33217d2-fd96-49fb-9727-faeb76f0e219" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "e33217d2-fd96-49fb-9727-faeb76f0e219" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "e33217d2-fd96-49fb-9727-faeb76f0e219" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:13:31 user nova-compute[74669]: INFO nova.compute.manager [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Attaching volume a93e9e3d-0c9f-40e7-b911-e23bf953edc4 to /dev/vdb
Nov 08 17:13:31 user nova-compute[74669]: DEBUG os_brick.utils [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc35cb2-be25-4711-9060-62e6bdf9c536]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1ca84b-155c-4b7c-b6c3-f890561cebc4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c021e5-ab86-4741-8266-360403a2f73d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f52dbf-6192-4e7a-b188-51a416b5b1df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:13:31 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:13:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dc9d94-bcc7-4722-9caa-fe19f108ee8a]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG os_brick.utils [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:13:31 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Updating existing volume attachment record: 5b470fff-4e24-4dcc-89a5-062a6f3c06af {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:13:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b0c3fc3-99a1-4ff9-a371-bf68eb70a287 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "746bdbac-3e36-4a08-989a-c004634890f9" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:13:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b0c3fc3-99a1-4ff9-a371-bf68eb70a287 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "746bdbac-3e36-4a08-989a-c004634890f9" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:13:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5b0c3fc3-99a1-4ff9-a371-bf68eb70a287 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Going to confirm migration 2 {{(pid=74669) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 08 17:13:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b0c3fc3-99a1-4ff9-a371-bf68eb70a287 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "refresh_cache-746bdbac-3e36-4a08-989a-c004634890f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:13:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b0c3fc3-99a1-4ff9-a371-bf68eb70a287 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquired lock "refresh_cache-746bdbac-3e36-4a08-989a-c004634890f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:13:40 user nova-compute[74669]: DEBUG nova.network.neutron [None req-5b0c3fc3-99a1-4ff9-a371-bf68eb70a287 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:13:40 user nova-compute[74669]: DEBUG nova.objects.instance [None req-5b0c3fc3-99a1-4ff9-a371-bf68eb70a287 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lazy-loading 'info_cache' on Instance uuid 746bdbac-3e36-4a08-989a-c004634890f9 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:13:40 user nova-compute[74669]: DEBUG nova.network.neutron [None req-5b0c3fc3-99a1-4ff9-a371-bf68eb70a287 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Updating instance_info_cache with network_info: [{"id": "f33d0612-bda7-41c8-ba61-d965030f2304", "address": "fa:16:3e:55:1b:72", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33d0612-bd", "ovs_interfaceid": "f33d0612-bda7-41c8-ba61-d965030f2304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:13:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b0c3fc3-99a1-4ff9-a371-bf68eb70a287 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Releasing lock "refresh_cache-746bdbac-3e36-4a08-989a-c004634890f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:13:40 user nova-compute[74669]: DEBUG nova.objects.instance [None req-5b0c3fc3-99a1-4ff9-a371-bf68eb70a287 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lazy-loading 'migration_context' on Instance uuid 746bdbac-3e36-4a08-989a-c004634890f9 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:13:40 user nova-compute[74669]: DEBUG nova.objects.base [None req-5b0c3fc3-99a1-4ff9-a371-bf68eb70a287 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Object Instance<746bdbac-3e36-4a08-989a-c004634890f9> lazy-loaded attributes: info_cache,migration_context {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:13:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b0c3fc3-99a1-4ff9-a371-bf68eb70a287 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:13:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b0c3fc3-99a1-4ff9-a371-bf68eb70a287 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:13:41 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-5b0c3fc3-99a1-4ff9-a371-bf68eb70a287 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:13:41 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-5b0c3fc3-99a1-4ff9-a371-bf68eb70a287 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:13:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b0c3fc3-99a1-4ff9-a371-bf68eb70a287 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.505s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:13:41 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-5b0c3fc3-99a1-4ff9-a371-bf68eb70a287 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Deleted allocation for migration 18964ccc-62a7-41dd-ae99-01443023dc5f
Nov 08 17:13:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b0c3fc3-99a1-4ff9-a371-bf68eb70a287 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "746bdbac-3e36-4a08-989a-c004634890f9" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.461s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:13:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "bf46a10b-747a-490c-8e22-a76ec65fafdf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:13:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:13:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:13:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:13:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:13:51 user nova-compute[74669]: INFO nova.compute.manager [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Terminating instance
Nov 08 17:13:51 user nova-compute[74669]: DEBUG nova.compute.manager [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:13:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:52 user nova-compute[74669]: DEBUG nova.compute.manager [req-eb1005a1-3c84-40b5-b8d0-775067116854 req-6444d5ab-fbe2-4695-9db4-2f196bc1f4c3 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Received event network-vif-unplugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:13:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eb1005a1-3c84-40b5-b8d0-775067116854 req-6444d5ab-fbe2-4695-9db4-2f196bc1f4c3 service nova] Acquiring lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:13:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eb1005a1-3c84-40b5-b8d0-775067116854 req-6444d5ab-fbe2-4695-9db4-2f196bc1f4c3 service nova] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:13:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eb1005a1-3c84-40b5-b8d0-775067116854 req-6444d5ab-fbe2-4695-9db4-2f196bc1f4c3 service nova] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:13:52 user nova-compute[74669]: DEBUG nova.compute.manager [req-eb1005a1-3c84-40b5-b8d0-775067116854 req-6444d5ab-fbe2-4695-9db4-2f196bc1f4c3 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] No waiting events found dispatching network-vif-unplugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:13:52 user nova-compute[74669]: DEBUG nova.compute.manager [req-eb1005a1-3c84-40b5-b8d0-775067116854 req-6444d5ab-fbe2-4695-9db4-2f196bc1f4c3 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Received event network-vif-unplugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:13:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:52 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Instance destroyed successfully.
Nov 08 17:13:52 user nova-compute[74669]: DEBUG nova.objects.instance [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lazy-loading 'resources' on Instance uuid bf46a10b-747a-490c-8e22-a76ec65fafdf {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:13:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T17:08:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-906635481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-906635481',id=28,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCctGPvKViiOdXyrKx2lAWsKGEcF4bmf760ubgVvLN8IGOdz+Pa7cVVnJvWEDYvDETcr24w3bBjYR4gpcxGKh61GsWSFIwhCTGo213jwflFd1nP4PIE1jH6lMuTDSsl37Q==',key_name='tempest-keypair-1645684870',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:12:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f1e9778e17a4e0fa1aa1f41d323a88c',ramdisk_id='',reservation_id='r-3gqwmia3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-317302826',owner_user_name='tempest-AttachVolumeShelveTestJSON-317302826-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:12:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8bcb0586bce42a3a1a59b2cbc99f846',uuid=bf46a10b-747a-490c-8e22-a76ec65fafdf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c33fc5-13", "ovs_interfaceid": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:13:52 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converting VIF {"id": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "address": "fa:16:3e:c8:64:e8", "network": {"id": "1dcb6c81-2473-4e3d-876d-0be5d6bac3d8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1534204663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1e9778e17a4e0fa1aa1f41d323a88c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c33fc5-13", "ovs_interfaceid": "48c33fc5-13e1-4b32-b706-55d5f033b4d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:13:52 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:64:e8,bridge_name='br-int',has_traffic_filtering=True,id=48c33fc5-13e1-4b32-b706-55d5f033b4d7,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c33fc5-13') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:13:52 user nova-compute[74669]: DEBUG os_vif [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:64:e8,bridge_name='br-int',has_traffic_filtering=True,id=48c33fc5-13e1-4b32-b706-55d5f033b4d7,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c33fc5-13') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:13:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48c33fc5-13, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:13:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:13:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cc62483-82c4-4ce9-a1d6-ed4724ee069f) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:13:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:13:52 user nova-compute[74669]: INFO os_vif [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:64:e8,bridge_name='br-int',has_traffic_filtering=True,id=48c33fc5-13e1-4b32-b706-55d5f033b4d7,network=Network(1dcb6c81-2473-4e3d-876d-0be5d6bac3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c33fc5-13')
Nov 08 17:13:52 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Deleting instance files /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf_del
Nov 08 17:13:52 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Deletion of /opt/stack/data/nova/instances/bf46a10b-747a-490c-8e22-a76ec65fafdf_del complete
Nov 08 17:13:52 user nova-compute[74669]: INFO nova.compute.manager [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 08 17:13:52 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:13:52 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:13:52 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:13:53 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Took 0.70 seconds to deallocate network for instance.
Nov 08 17:13:53 user nova-compute[74669]: DEBUG nova.compute.manager [req-50868a59-3ac1-402f-a0ed-9fc38ade5a84 req-07dd796a-83d7-44fe-a5a0-9fbaecbad1f7 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Received event network-vif-deleted-48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYHRrTuZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:13:53 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:13:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:13:53 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:13:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:13:53 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:13:53 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5266fe7-af49-40ba-81af-39c70790312d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:13:53 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2a5970-baf9-4c0b-bc1e-3c503f0cf7eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4] added
Nov 08 17:13:53 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[56eceea9-7e15-4143-a903-5fc8a5570f39]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:53 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Deleted allocations for instance bf46a10b-747a-490c-8e22-a76ec65fafdf
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a533d3-2003-42ef-b7f6-b9fe8833e0bf]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYHRrTuZ {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hYHRrTuZ" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6d5690-f613-4d70-b66c-0dad38f712bf]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hYHRrTuZ'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9690bbe-6d5e-45b2-b2d2-7f44e5544a97]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-480ddf6d-d058-4c9d-aaae-acc0fbb9fe1f tempest-AttachVolumeShelveTestJSON-317302826 tempest-AttachVolumeShelveTestJSON-317302826-project-member] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.068s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[88735e7c-05e3-4eb4-9197-66f3aa7ba0bd]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:13:53 user nova-compute[74669]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa (non-flash)
Nov 08 17:13:53 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:13:53 user nova-compute[74669]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa (non-flash)
Nov 08 17:13:53 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:13:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0f508a-3546-443c-b52c-7413fd45d485]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4, portal: 172.16.0.220,3260]
Nov 08 17:13:54 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4, portal: 172.16.0.220,3260] successful.
Nov 08 17:13:54 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c83634f-1f6c-4dd7-b886-0e994c8c588e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[44548538-c951-46fc-a353-fff32c72bd19]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:13:54 user nova-compute[74669]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa (non-flash)
Nov 08 17:13:54 user nova-compute[74669]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 (non-flash)
Nov 08 17:13:54 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:13:54 user nova-compute[74669]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa (non-flash)
Nov 08 17:13:54 user nova-compute[74669]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 (non-flash)
Nov 08 17:13:54 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc69100-0928-4ff0-b231-70cb7afcfe6c]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYHRrTuZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-b538f0b1-b422-47c9-b302-4f1748fa1a34 req-b01d2616-9b58-4993-9125-95439ff23eb5 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Received event network-vif-plugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b538f0b1-b422-47c9-b302-4f1748fa1a34 req-b01d2616-9b58-4993-9125-95439ff23eb5 service nova] Acquiring lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b538f0b1-b422-47c9-b302-4f1748fa1a34 req-b01d2616-9b58-4993-9125-95439ff23eb5 service nova] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b538f0b1-b422-47c9-b302-4f1748fa1a34 req-b01d2616-9b58-4993-9125-95439ff23eb5 service nova] Lock "bf46a10b-747a-490c-8e22-a76ec65fafdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:13:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-b538f0b1-b422-47c9-b302-4f1748fa1a34 req-b01d2616-9b58-4993-9125-95439ff23eb5 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] No waiting events found dispatching network-vif-plugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:13:54 user nova-compute[74669]: WARNING nova.compute.manager [req-b538f0b1-b422-47c9-b302-4f1748fa1a34 req-b01d2616-9b58-4993-9125-95439ff23eb5 service nova] [instance: bf46a10b-747a-490c-8e22-a76ec65fafdf] Received unexpected event network-vif-plugged-48c33fc5-13e1-4b32-b706-55d5f033b4d7 for instance with vm_state deleted and task_state None.
Nov 08 17:13:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:13:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23462306561306261', 'path': '/dev/sdd'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:13:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462306561306261', 'path': '/dev/sdd'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:13:55 user nova-compute[74669]: DEBUG nova.objects.instance [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lazy-loading 'flavor' on Instance uuid e33217d2-fd96-49fb-9727-faeb76f0e219 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:13:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 17:13:55 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:13:55 user nova-compute[74669]:   <source dev="/dev/sdd"/>
Nov 08 17:13:55 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:13:55 user nova-compute[74669]:   <serial>a93e9e3d-0c9f-40e7-b911-e23bf953edc4</serial>
Nov 08 17:13:55 user nova-compute[74669]: </disk>
Nov 08 17:13:55 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 17:13:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:13:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:13:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] No VIF found with MAC fa:16:3e:68:6f:55, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:13:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-acf02f26-6be2-4834-af9e-ff100dc65eeb tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "e33217d2-fd96-49fb-9727-faeb76f0e219" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.581s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:13:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:13:58 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:14:00 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:14:02 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:14:02 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:14:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:14:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:14:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:14:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:14:02 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:14:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:14:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:14:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:14:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:14:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:14:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:14:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:14:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:14:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:14:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:14:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:14:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:14:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:14:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:14:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:14:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:14:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:14:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3559fce-3321-439f-bbed-5e0a8c5dcba0/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:14:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3559fce-3321-439f-bbed-5e0a8c5dcba0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:14:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3559fce-3321-439f-bbed-5e0a8c5dcba0/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:14:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3559fce-3321-439f-bbed-5e0a8c5dcba0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:14:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:14:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:14:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:14:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:14:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:14:05 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:14:05 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:14:05 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:14:05 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8007MB free_disk=25.269657135009766GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:14:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:14:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:14:05 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7b335462-0d93-4899-a223-5c2e36932578 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:14:05 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance af8b58ff-90d5-4a04-844a-ac0534a7e413 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:14:05 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2158a7c2-2f46-4bce-8558-4347a48623d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:14:05 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 3754330e-8b41-4e69-93f9-508ef5adf772 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:14:05 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance e33217d2-fd96-49fb-9727-faeb76f0e219 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:14:05 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 746bdbac-3e36-4a08-989a-c004634890f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:14:05 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance f3559fce-3321-439f-bbed-5e0a8c5dcba0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:14:05 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:14:05 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:14:05 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:14:05 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:14:05 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:14:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:14:06 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:14:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:14:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-af8b58ff-90d5-4a04-844a-ac0534a7e413" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:14:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-af8b58ff-90d5-4a04-844a-ac0534a7e413" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:14:07 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:14:07 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Updating instance_info_cache with network_info: [{"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:14:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-af8b58ff-90d5-4a04-844a-ac0534a7e413" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:14:07 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:14:07 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:14:07 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:14:07 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:14:07 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:14:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:10 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:14:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:14:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:14:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:14:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:14:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:14:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:14:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:14:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:14:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:14:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:14:26 user nova-compute[74669]: INFO nova.compute.manager [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Terminating instance
Nov 08 17:14:26 user nova-compute[74669]: DEBUG nova.compute.manager [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-e765c1b0-2faf-43db-9550-ecb612fcee73 req-1a6b897d-4de9-4fe5-abf5-6b2cd1842d2e service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received event network-vif-unplugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e765c1b0-2faf-43db-9550-ecb612fcee73 req-1a6b897d-4de9-4fe5-abf5-6b2cd1842d2e service nova] Acquiring lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e765c1b0-2faf-43db-9550-ecb612fcee73 req-1a6b897d-4de9-4fe5-abf5-6b2cd1842d2e service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e765c1b0-2faf-43db-9550-ecb612fcee73 req-1a6b897d-4de9-4fe5-abf5-6b2cd1842d2e service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-e765c1b0-2faf-43db-9550-ecb612fcee73 req-1a6b897d-4de9-4fe5-abf5-6b2cd1842d2e service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] No waiting events found dispatching network-vif-unplugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-e765c1b0-2faf-43db-9550-ecb612fcee73 req-1a6b897d-4de9-4fe5-abf5-6b2cd1842d2e service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received event network-vif-unplugged-d0dc10aa-3fca-4242-8895-241190da8780 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:14:27 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Instance destroyed successfully.
Nov 08 17:14:27 user nova-compute[74669]: DEBUG nova.objects.instance [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'resources' on Instance uuid af8b58ff-90d5-4a04-844a-ac0534a7e413 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:03:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-546386835',display_name='tempest-AttachVolumeTestJSON-server-546386835',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-546386835',id=25,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXViWU/BdYxMm5+lemyfZcP7+TCdB2OaD+dWs6IPD7DtEkJGE2tx2z335cOHjRlBjCNb0QrrgNRKB9Cr8JI7YWfGi7dauKEckz8JkFarm7hJu+kJ/zQZH4rAL4xDCaMWg==',key_name='tempest-keypair-1427520299',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:03:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a7febf2b00147cfb989380452aba869',ramdisk_id='',reservation_id='r-l53uvaaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-275457186',owner_user_name='tempest-AttachVolumeTestJSON-275457186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:12:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fd41a7ea7943e6a913c211f6ea2d52',uuid=af8b58ff-90d5-4a04-844a-ac0534a7e413,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converting VIF {"id": "d0dc10aa-3fca-4242-8895-241190da8780", "address": "fa:16:3e:4d:2d:67", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0dc10aa-3f", "ovs_interfaceid": "d0dc10aa-3fca-4242-8895-241190da8780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:2d:67,bridge_name='br-int',has_traffic_filtering=True,id=d0dc10aa-3fca-4242-8895-241190da8780,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dc10aa-3f') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG os_vif [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:2d:67,bridge_name='br-int',has_traffic_filtering=True,id=d0dc10aa-3fca-4242-8895-241190da8780,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dc10aa-3f') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0dc10aa-3f, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cc0b7ac-d097-4c7f-bbe4-2b80c456c748) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:27 user nova-compute[74669]: INFO os_vif [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:2d:67,bridge_name='br-int',has_traffic_filtering=True,id=d0dc10aa-3fca-4242-8895-241190da8780,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0dc10aa-3f')
Nov 08 17:14:27 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Deleting instance files /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413_del
Nov 08 17:14:27 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Deletion of /opt/stack/data/nova/instances/af8b58ff-90d5-4a04-844a-ac0534a7e413_del complete
Nov 08 17:14:27 user nova-compute[74669]: INFO nova.compute.manager [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 08 17:14:27 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:14:27 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:14:28 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:14:28 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Took 0.84 seconds to deallocate network for instance.
Nov 08 17:14:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:14:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:14:28 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:14:28 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:14:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:14:28 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Deleted allocations for instance af8b58ff-90d5-4a04-844a-ac0534a7e413
Nov 08 17:14:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-caebf34e-00d1-43fa-ab9a-264800a774d5 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.071s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:14:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-282094b5-eb28-4ddb-b1d0-ae3846260296 req-a5a66fe1-df7c-4080-96fa-b05ae5cd0a66 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received event network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:14:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-282094b5-eb28-4ddb-b1d0-ae3846260296 req-a5a66fe1-df7c-4080-96fa-b05ae5cd0a66 service nova] Acquiring lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:14:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-282094b5-eb28-4ddb-b1d0-ae3846260296 req-a5a66fe1-df7c-4080-96fa-b05ae5cd0a66 service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:14:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-282094b5-eb28-4ddb-b1d0-ae3846260296 req-a5a66fe1-df7c-4080-96fa-b05ae5cd0a66 service nova] Lock "af8b58ff-90d5-4a04-844a-ac0534a7e413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:14:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-282094b5-eb28-4ddb-b1d0-ae3846260296 req-a5a66fe1-df7c-4080-96fa-b05ae5cd0a66 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] No waiting events found dispatching network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:14:29 user nova-compute[74669]: WARNING nova.compute.manager [req-282094b5-eb28-4ddb-b1d0-ae3846260296 req-a5a66fe1-df7c-4080-96fa-b05ae5cd0a66 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received unexpected event network-vif-plugged-d0dc10aa-3fca-4242-8895-241190da8780 for instance with vm_state deleted and task_state None.
Nov 08 17:14:29 user nova-compute[74669]: DEBUG nova.compute.manager [req-282094b5-eb28-4ddb-b1d0-ae3846260296 req-a5a66fe1-df7c-4080-96fa-b05ae5cd0a66 service nova] [instance: af8b58ff-90d5-4a04-844a-ac0534a7e413] Received event network-vif-deleted-d0dc10aa-3fca-4242-8895-241190da8780 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:14:32 user nova-compute[74669]: DEBUG nova.compute.manager [req-e176957f-1424-48e5-99de-4f31bd0e2167 req-c6bcf794-63df-483f-ae7a-29c2ebe6f1a9 service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Received event network-changed-8ac1e188-89c7-4f6e-8275-6c2211df8158 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:14:32 user nova-compute[74669]: DEBUG nova.compute.manager [req-e176957f-1424-48e5-99de-4f31bd0e2167 req-c6bcf794-63df-483f-ae7a-29c2ebe6f1a9 service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Refreshing instance network info cache due to event network-changed-8ac1e188-89c7-4f6e-8275-6c2211df8158. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:14:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e176957f-1424-48e5-99de-4f31bd0e2167 req-c6bcf794-63df-483f-ae7a-29c2ebe6f1a9 service nova] Acquiring lock "refresh_cache-f3559fce-3321-439f-bbed-5e0a8c5dcba0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:14:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e176957f-1424-48e5-99de-4f31bd0e2167 req-c6bcf794-63df-483f-ae7a-29c2ebe6f1a9 service nova] Acquired lock "refresh_cache-f3559fce-3321-439f-bbed-5e0a8c5dcba0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:14:32 user nova-compute[74669]: DEBUG nova.network.neutron [req-e176957f-1424-48e5-99de-4f31bd0e2167 req-c6bcf794-63df-483f-ae7a-29c2ebe6f1a9 service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Refreshing network info cache for port 8ac1e188-89c7-4f6e-8275-6c2211df8158 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:14:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "f3559fce-3321-439f-bbed-5e0a8c5dcba0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "f3559fce-3321-439f-bbed-5e0a8c5dcba0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "f3559fce-3321-439f-bbed-5e0a8c5dcba0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "f3559fce-3321-439f-bbed-5e0a8c5dcba0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "f3559fce-3321-439f-bbed-5e0a8c5dcba0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG nova.network.neutron [req-e176957f-1424-48e5-99de-4f31bd0e2167 req-c6bcf794-63df-483f-ae7a-29c2ebe6f1a9 service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Updated VIF entry in instance network info cache for port 8ac1e188-89c7-4f6e-8275-6c2211df8158. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG nova.network.neutron [req-e176957f-1424-48e5-99de-4f31bd0e2167 req-c6bcf794-63df-483f-ae7a-29c2ebe6f1a9 service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Updating instance_info_cache with network_info: [{"id": "8ac1e188-89c7-4f6e-8275-6c2211df8158", "address": "fa:16:3e:12:fc:1f", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac1e188-89", "ovs_interfaceid": "8ac1e188-89c7-4f6e-8275-6c2211df8158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:14:33 user nova-compute[74669]: INFO nova.compute.manager [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Terminating instance
Nov 08 17:14:33 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e176957f-1424-48e5-99de-4f31bd0e2167 req-c6bcf794-63df-483f-ae7a-29c2ebe6f1a9 service nova] Releasing lock "refresh_cache-f3559fce-3321-439f-bbed-5e0a8c5dcba0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:33 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Instance destroyed successfully.
Nov 08 17:14:33 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lazy-loading 'resources' on Instance uuid f3559fce-3321-439f-bbed-5e0a8c5dcba0 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:12:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1246546367',display_name='tempest-AttachVolumeNegativeTest-server-1246546367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1246546367',id=34,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3A5E9GrzoXp3mLdbaxzhOaqS+o9VB3b55lSO1/mDRCt4wlAshMSqmt2lc6J5HS1JNpeGEFvoPmrn2uo8kUuwvwg+rfDx6/8h0KAwGvXHxTskCBo99aEgrP0HPqz2eNcw==',key_name='tempest-keypair-1759484736',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:12:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f58f78f65e774cf78ca0c49aa11f9b54',ramdisk_id='',reservation_id='r-1zxc0c36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1846694333',owner_user_name='tempest-AttachVolumeNegativeTest-1846694333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:12:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='565488b722e44809a7cff5e617daae84',uuid=f3559fce-3321-439f-bbed-5e0a8c5dcba0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ac1e188-89c7-4f6e-8275-6c2211df8158", "address": "fa:16:3e:12:fc:1f", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac1e188-89", "ovs_interfaceid": "8ac1e188-89c7-4f6e-8275-6c2211df8158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converting VIF {"id": "8ac1e188-89c7-4f6e-8275-6c2211df8158", "address": "fa:16:3e:12:fc:1f", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac1e188-89", "ovs_interfaceid": "8ac1e188-89c7-4f6e-8275-6c2211df8158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:fc:1f,bridge_name='br-int',has_traffic_filtering=True,id=8ac1e188-89c7-4f6e-8275-6c2211df8158,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac1e188-89') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG os_vif [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:fc:1f,bridge_name='br-int',has_traffic_filtering=True,id=8ac1e188-89c7-4f6e-8275-6c2211df8158,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac1e188-89') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ac1e188-89, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd16333f-e69a-4b71-b0db-1de99cb074d9) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:14:33 user nova-compute[74669]: INFO os_vif [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:fc:1f,bridge_name='br-int',has_traffic_filtering=True,id=8ac1e188-89c7-4f6e-8275-6c2211df8158,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac1e188-89')
Nov 08 17:14:33 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Deleting instance files /opt/stack/data/nova/instances/f3559fce-3321-439f-bbed-5e0a8c5dcba0_del
Nov 08 17:14:33 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Deletion of /opt/stack/data/nova/instances/f3559fce-3321-439f-bbed-5e0a8c5dcba0_del complete
Nov 08 17:14:33 user nova-compute[74669]: INFO nova.compute.manager [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 08 17:14:33 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:14:33 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:14:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:34 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:14:34 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Took 0.61 seconds to deallocate network for instance.
Nov 08 17:14:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-17518bfa-f7c9-4c22-ac59-dcdd3f4eed91 req-0350e5a1-5a6b-43db-b9db-3bc85f5586f9 service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Received event network-vif-deleted-8ac1e188-89c7-4f6e-8275-6c2211df8158 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:14:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:14:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:14:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-1cb78f9a-3d1e-45bf-96df-6129667dc085 req-c588b016-298d-4c3a-8bea-175c88ab4d8c service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Received event network-vif-unplugged-8ac1e188-89c7-4f6e-8275-6c2211df8158 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:14:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1cb78f9a-3d1e-45bf-96df-6129667dc085 req-c588b016-298d-4c3a-8bea-175c88ab4d8c service nova] Acquiring lock "f3559fce-3321-439f-bbed-5e0a8c5dcba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:14:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1cb78f9a-3d1e-45bf-96df-6129667dc085 req-c588b016-298d-4c3a-8bea-175c88ab4d8c service nova] Lock "f3559fce-3321-439f-bbed-5e0a8c5dcba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:14:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1cb78f9a-3d1e-45bf-96df-6129667dc085 req-c588b016-298d-4c3a-8bea-175c88ab4d8c service nova] Lock "f3559fce-3321-439f-bbed-5e0a8c5dcba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:14:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-1cb78f9a-3d1e-45bf-96df-6129667dc085 req-c588b016-298d-4c3a-8bea-175c88ab4d8c service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] No waiting events found dispatching network-vif-unplugged-8ac1e188-89c7-4f6e-8275-6c2211df8158 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:14:34 user nova-compute[74669]: WARNING nova.compute.manager [req-1cb78f9a-3d1e-45bf-96df-6129667dc085 req-c588b016-298d-4c3a-8bea-175c88ab4d8c service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Received unexpected event network-vif-unplugged-8ac1e188-89c7-4f6e-8275-6c2211df8158 for instance with vm_state deleted and task_state None.
Nov 08 17:14:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-1cb78f9a-3d1e-45bf-96df-6129667dc085 req-c588b016-298d-4c3a-8bea-175c88ab4d8c service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Received event network-vif-plugged-8ac1e188-89c7-4f6e-8275-6c2211df8158 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:14:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1cb78f9a-3d1e-45bf-96df-6129667dc085 req-c588b016-298d-4c3a-8bea-175c88ab4d8c service nova] Acquiring lock "f3559fce-3321-439f-bbed-5e0a8c5dcba0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:14:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1cb78f9a-3d1e-45bf-96df-6129667dc085 req-c588b016-298d-4c3a-8bea-175c88ab4d8c service nova] Lock "f3559fce-3321-439f-bbed-5e0a8c5dcba0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:14:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1cb78f9a-3d1e-45bf-96df-6129667dc085 req-c588b016-298d-4c3a-8bea-175c88ab4d8c service nova] Lock "f3559fce-3321-439f-bbed-5e0a8c5dcba0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:14:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-1cb78f9a-3d1e-45bf-96df-6129667dc085 req-c588b016-298d-4c3a-8bea-175c88ab4d8c service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] No waiting events found dispatching network-vif-plugged-8ac1e188-89c7-4f6e-8275-6c2211df8158 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:14:34 user nova-compute[74669]: WARNING nova.compute.manager [req-1cb78f9a-3d1e-45bf-96df-6129667dc085 req-c588b016-298d-4c3a-8bea-175c88ab4d8c service nova] [instance: f3559fce-3321-439f-bbed-5e0a8c5dcba0] Received unexpected event network-vif-plugged-8ac1e188-89c7-4f6e-8275-6c2211df8158 for instance with vm_state deleted and task_state None.
Nov 08 17:14:34 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:14:34 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:14:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.234s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:14:34 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Deleted allocations for instance f3559fce-3321-439f-bbed-5e0a8c5dcba0
Nov 08 17:14:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d58808e8-fad5-4a2a-a114-63ca6f5562e8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "f3559fce-3321-439f-bbed-5e0a8c5dcba0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.873s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:14:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:14:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:00 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:15:02 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:15:02 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:15:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:15:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:15:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:15:02 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:15:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:15:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:15:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:03 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:15:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:15:04 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:15:04 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:15:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8379MB free_disk=25.324077606201172GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:15:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:15:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:15:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7b335462-0d93-4899-a223-5c2e36932578 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:15:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2158a7c2-2f46-4bce-8558-4347a48623d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:15:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 3754330e-8b41-4e69-93f9-508ef5adf772 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:15:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance e33217d2-fd96-49fb-9727-faeb76f0e219 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:15:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 746bdbac-3e36-4a08-989a-c004634890f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:15:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:15:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:15:05 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:15:05 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:15:05 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:15:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.346s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:15:07 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:15:07 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:15:07 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:15:07 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:15:07 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:15:07 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:15:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-2158a7c2-2f46-4bce-8558-4347a48623d5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:15:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-2158a7c2-2f46-4bce-8558-4347a48623d5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:15:07 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:15:08 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Updating instance_info_cache with network_info: [{"id": "ea40d3d9-25df-410d-b2ff-46a980702022", "address": "fa:16:3e:76:cd:a9", "network": {"id": "52bf51f6-cf7e-403b-b601-0660b9c8544f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-17276515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1a781163a345dc8be717e3e7c73788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea40d3d9-25", "ovs_interfaceid": "ea40d3d9-25df-410d-b2ff-46a980702022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:15:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-2158a7c2-2f46-4bce-8558-4347a48623d5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:15:08 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:15:08 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:15:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:15:09 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:15:09 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:15:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:15:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "94098bcd-577b-4bf9-9e62-e21b984eb936" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:15:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:15:21 user nova-compute[74669]: DEBUG nova.compute.manager [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:15:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:15:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:15:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:15:21 user nova-compute[74669]: INFO nova.compute.claims [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Claim successful on node user
Nov 08 17:15:22 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:15:22 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:15:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.320s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:15:22 user nova-compute[74669]: DEBUG nova.compute.manager [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:15:22 user nova-compute[74669]: DEBUG nova.compute.manager [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:15:22 user nova-compute[74669]: DEBUG nova.network.neutron [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:15:22 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:15:22 user nova-compute[74669]: DEBUG nova.compute.manager [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:15:22 user nova-compute[74669]: DEBUG nova.policy [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80fd41a7ea7943e6a913c211f6ea2d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7febf2b00147cfb989380452aba869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:15:22 user nova-compute[74669]: DEBUG nova.compute.manager [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:15:22 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:15:22 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Creating image(s)
Nov 08 17:15:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "/opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:15:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "/opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:15:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "/opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:15:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.192s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:15:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:15:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.192s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk 1073741824" returned: 0 in 0.056s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:15:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:23 user nova-compute[74669]: DEBUG nova.network.neutron [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Successfully created port: 211a12bb-0d17-4746-b1ed-4cc9dee09c05 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:15:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.187s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:23 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:15:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:23 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Cannot resize image /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:15:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:15:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Ensure instance console log exists: /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:15:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:15:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:15:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:15:23 user nova-compute[74669]: DEBUG nova.network.neutron [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Successfully updated port: 211a12bb-0d17-4746-b1ed-4cc9dee09c05 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:15:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "refresh_cache-94098bcd-577b-4bf9-9e62-e21b984eb936" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:15:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquired lock "refresh_cache-94098bcd-577b-4bf9-9e62-e21b984eb936" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:15:23 user nova-compute[74669]: DEBUG nova.network.neutron [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:15:23 user nova-compute[74669]: DEBUG nova.compute.manager [req-57c29203-87b9-453e-87fa-ab12f0191aa3 req-625e7f2a-5c8d-49ec-9073-c1f7aad6d57d service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Received event network-changed-211a12bb-0d17-4746-b1ed-4cc9dee09c05 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:15:23 user nova-compute[74669]: DEBUG nova.compute.manager [req-57c29203-87b9-453e-87fa-ab12f0191aa3 req-625e7f2a-5c8d-49ec-9073-c1f7aad6d57d service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Refreshing instance network info cache due to event network-changed-211a12bb-0d17-4746-b1ed-4cc9dee09c05. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:15:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-57c29203-87b9-453e-87fa-ab12f0191aa3 req-625e7f2a-5c8d-49ec-9073-c1f7aad6d57d service nova] Acquiring lock "refresh_cache-94098bcd-577b-4bf9-9e62-e21b984eb936" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:15:23 user nova-compute[74669]: DEBUG nova.network.neutron [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:15:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.network.neutron [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Updating instance_info_cache with network_info: [{"id": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "address": "fa:16:3e:46:79:c5", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211a12bb-0d", "ovs_interfaceid": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Releasing lock "refresh_cache-94098bcd-577b-4bf9-9e62-e21b984eb936" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.compute.manager [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Instance network_info: |[{"id": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "address": "fa:16:3e:46:79:c5", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211a12bb-0d", "ovs_interfaceid": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-57c29203-87b9-453e-87fa-ab12f0191aa3 req-625e7f2a-5c8d-49ec-9073-c1f7aad6d57d service nova] Acquired lock "refresh_cache-94098bcd-577b-4bf9-9e62-e21b984eb936" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.network.neutron [req-57c29203-87b9-453e-87fa-ab12f0191aa3 req-625e7f2a-5c8d-49ec-9073-c1f7aad6d57d service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Refreshing network info cache for port 211a12bb-0d17-4746-b1ed-4cc9dee09c05 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Start _get_guest_xml network_info=[{"id": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "address": "fa:16:3e:46:79:c5", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211a12bb-0d", "ovs_interfaceid": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:15:24 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:15:24 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:15:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1252247701',display_name='tempest-AttachVolumeTestJSON-server-1252247701',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1252247701',id=35,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFsvcL8Txg+9gT7HEu9JqwqorhLPkkOnNS7knMcd2KthpMHD6U/EgPkyGYbsiyf9sOFAVmonPmNa6ylgSlstRATd7IthcMcUcSc+1W7Sqfv8Vw8dkZ9Ut8mRxVy0gJ+qg==',key_name='tempest-keypair-1378818859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a7febf2b00147cfb989380452aba869',ramdisk_id='',reservation_id='r-2sj5t7pg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-275457186',owner_user_name='tempest-AttachVolumeTestJSON-275457186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:15:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fd41a7ea7943e6a913c211f6ea2d52',uuid=94098bcd-577b-4bf9-9e62-e21b984eb936,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "address": "fa:16:3e:46:79:c5", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211a12bb-0d", "ovs_interfaceid": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converting VIF {"id": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "address": "fa:16:3e:46:79:c5", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211a12bb-0d", "ovs_interfaceid": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:79:c5,bridge_name='br-int',has_traffic_filtering=True,id=211a12bb-0d17-4746-b1ed-4cc9dee09c05,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211a12bb-0d') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.objects.instance [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'pci_devices' on Instance uuid 94098bcd-577b-4bf9-9e62-e21b984eb936 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:15:24 user nova-compute[74669]:   <uuid>94098bcd-577b-4bf9-9e62-e21b984eb936</uuid>
Nov 08 17:15:24 user nova-compute[74669]:   <name>instance-00000023</name>
Nov 08 17:15:24 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:15:24 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:15:24 user nova-compute[74669]:   <metadata>
Nov 08 17:15:24 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:15:24 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:15:24 user nova-compute[74669]:       <nova:name>tempest-AttachVolumeTestJSON-server-1252247701</nova:name>
Nov 08 17:15:24 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:15:24</nova:creationTime>
Nov 08 17:15:24 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:15:24 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:15:24 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:15:24 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:15:24 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:15:24 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:15:24 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:15:24 user nova-compute[74669]:       <nova:owner>
Nov 08 17:15:24 user nova-compute[74669]:         <nova:user uuid="80fd41a7ea7943e6a913c211f6ea2d52">tempest-AttachVolumeTestJSON-275457186-project-member</nova:user>
Nov 08 17:15:24 user nova-compute[74669]:         <nova:project uuid="5a7febf2b00147cfb989380452aba869">tempest-AttachVolumeTestJSON-275457186</nova:project>
Nov 08 17:15:24 user nova-compute[74669]:       </nova:owner>
Nov 08 17:15:24 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:15:24 user nova-compute[74669]:       <nova:ports>
Nov 08 17:15:24 user nova-compute[74669]:         <nova:port uuid="211a12bb-0d17-4746-b1ed-4cc9dee09c05">
Nov 08 17:15:24 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 17:15:24 user nova-compute[74669]:         </nova:port>
Nov 08 17:15:24 user nova-compute[74669]:       </nova:ports>
Nov 08 17:15:24 user nova-compute[74669]:     </nova:instance>
Nov 08 17:15:24 user nova-compute[74669]:   </metadata>
Nov 08 17:15:24 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:15:24 user nova-compute[74669]:     <system>
Nov 08 17:15:24 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:15:24 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:15:24 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:15:24 user nova-compute[74669]:       <entry name="serial">94098bcd-577b-4bf9-9e62-e21b984eb936</entry>
Nov 08 17:15:24 user nova-compute[74669]:       <entry name="uuid">94098bcd-577b-4bf9-9e62-e21b984eb936</entry>
Nov 08 17:15:24 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:15:24 user nova-compute[74669]:     </system>
Nov 08 17:15:24 user nova-compute[74669]:   </sysinfo>
Nov 08 17:15:24 user nova-compute[74669]:   <os>
Nov 08 17:15:24 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:15:24 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:15:24 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:15:24 user nova-compute[74669]:   </os>
Nov 08 17:15:24 user nova-compute[74669]:   <features>
Nov 08 17:15:24 user nova-compute[74669]:     <acpi/>
Nov 08 17:15:24 user nova-compute[74669]:     <apic/>
Nov 08 17:15:24 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:15:24 user nova-compute[74669]:   </features>
Nov 08 17:15:24 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:15:24 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:15:24 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:15:24 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:15:24 user nova-compute[74669]:   </clock>
Nov 08 17:15:24 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:15:24 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:15:24 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:15:24 user nova-compute[74669]:   </cpu>
Nov 08 17:15:24 user nova-compute[74669]:   <devices>
Nov 08 17:15:24 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:15:24 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:15:24 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk"/>
Nov 08 17:15:24 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:15:24 user nova-compute[74669]:     </disk>
Nov 08 17:15:24 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:15:24 user nova-compute[74669]:       <mac address="fa:16:3e:46:79:c5"/>
Nov 08 17:15:24 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:15:24 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:15:24 user nova-compute[74669]:       <target dev="tap211a12bb-0d"/>
Nov 08 17:15:24 user nova-compute[74669]:     </interface>
Nov 08 17:15:24 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:15:24 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/console.log" append="off"/>
Nov 08 17:15:24 user nova-compute[74669]:     </serial>
Nov 08 17:15:24 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:15:24 user nova-compute[74669]:     <video>
Nov 08 17:15:24 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:15:24 user nova-compute[74669]:     </video>
Nov 08 17:15:24 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:15:24 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:15:24 user nova-compute[74669]:     </rng>
Nov 08 17:15:24 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:15:24 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:15:24 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:15:24 user nova-compute[74669]:     </memballoon>
Nov 08 17:15:24 user nova-compute[74669]:   </devices>
Nov 08 17:15:24 user nova-compute[74669]: </domain>
Nov 08 17:15:24 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:15:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1252247701',display_name='tempest-AttachVolumeTestJSON-server-1252247701',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1252247701',id=35,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFsvcL8Txg+9gT7HEu9JqwqorhLPkkOnNS7knMcd2KthpMHD6U/EgPkyGYbsiyf9sOFAVmonPmNa6ylgSlstRATd7IthcMcUcSc+1W7Sqfv8Vw8dkZ9Ut8mRxVy0gJ+qg==',key_name='tempest-keypair-1378818859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a7febf2b00147cfb989380452aba869',ramdisk_id='',reservation_id='r-2sj5t7pg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-275457186',owner_user_name='tempest-AttachVolumeTestJSON-275457186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:15:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fd41a7ea7943e6a913c211f6ea2d52',uuid=94098bcd-577b-4bf9-9e62-e21b984eb936,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "address": "fa:16:3e:46:79:c5", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211a12bb-0d", "ovs_interfaceid": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converting VIF {"id": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "address": "fa:16:3e:46:79:c5", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211a12bb-0d", "ovs_interfaceid": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:79:c5,bridge_name='br-int',has_traffic_filtering=True,id=211a12bb-0d17-4746-b1ed-4cc9dee09c05,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211a12bb-0d') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG os_vif [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:79:c5,bridge_name='br-int',has_traffic_filtering=True,id=211a12bb-0d17-4746-b1ed-4cc9dee09c05,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211a12bb-0d') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59694ecf-d561-5031-8b8c-a2e45b941054', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap211a12bb-0d, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap211a12bb-0d, col_values=(('qos', UUID('fcc2660e-d446-4951-96f5-eb4a17e28e29')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap211a12bb-0d, col_values=(('external_ids', {'iface-id': '211a12bb-0d17-4746-b1ed-4cc9dee09c05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:79:c5', 'vm-uuid': '94098bcd-577b-4bf9-9e62-e21b984eb936'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:24 user nova-compute[74669]: INFO os_vif [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:79:c5,bridge_name='br-int',has_traffic_filtering=True,id=211a12bb-0d17-4746-b1ed-4cc9dee09c05,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211a12bb-0d')
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] No VIF found with MAC fa:16:3e:46:79:c5, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.network.neutron [req-57c29203-87b9-453e-87fa-ab12f0191aa3 req-625e7f2a-5c8d-49ec-9073-c1f7aad6d57d service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Updated VIF entry in instance network info cache for port 211a12bb-0d17-4746-b1ed-4cc9dee09c05. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.network.neutron [req-57c29203-87b9-453e-87fa-ab12f0191aa3 req-625e7f2a-5c8d-49ec-9073-c1f7aad6d57d service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Updating instance_info_cache with network_info: [{"id": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "address": "fa:16:3e:46:79:c5", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211a12bb-0d", "ovs_interfaceid": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "3754330e-8b41-4e69-93f9-508ef5adf772" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "3754330e-8b41-4e69-93f9-508ef5adf772" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-57c29203-87b9-453e-87fa-ab12f0191aa3 req-625e7f2a-5c8d-49ec-9073-c1f7aad6d57d service nova] Releasing lock "refresh_cache-94098bcd-577b-4bf9-9e62-e21b984eb936" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:15:24 user nova-compute[74669]: INFO nova.compute.manager [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Detaching volume 8b98844f-8f0c-44cd-92d2-4650be2efbaa
Nov 08 17:15:24 user nova-compute[74669]: INFO nova.virt.block_device [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Attempting to driver detach volume 8b98844f-8f0c-44cd-92d2-4650be2efbaa from mountpoint /dev/vdb
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Attempting to detach device vdb from instance 3754330e-8b41-4e69-93f9-508ef5adf772 from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:15:24 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:15:24 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 17:15:24 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:15:24 user nova-compute[74669]:   <serial>8b98844f-8f0c-44cd-92d2-4650be2efbaa</serial>
Nov 08 17:15:24 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:15:24 user nova-compute[74669]: </disk>
Nov 08 17:15:24 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:15:24 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Successfully detached device vdb from instance 3754330e-8b41-4e69-93f9-508ef5adf772 from the persistent domain config.
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3754330e-8b41-4e69-93f9-508ef5adf772 from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 17:15:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:15:24 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:15:24 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 17:15:24 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:15:24 user nova-compute[74669]:   <serial>8b98844f-8f0c-44cd-92d2-4650be2efbaa</serial>
Nov 08 17:15:24 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:15:24 user nova-compute[74669]: </disk>
Nov 08 17:15:24 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:15:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3754330e-8b41-4e69-93f9-508ef5adf772 {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 17:15:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "e33217d2-fd96-49fb-9727-faeb76f0e219" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:15:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "e33217d2-fd96-49fb-9727-faeb76f0e219" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:15:25 user nova-compute[74669]: INFO nova.compute.manager [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Detaching volume a93e9e3d-0c9f-40e7-b911-e23bf953edc4
Nov 08 17:15:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:26 user nova-compute[74669]: INFO nova.virt.block_device [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Attempting to driver detach volume a93e9e3d-0c9f-40e7-b911-e23bf953edc4 from mountpoint /dev/vdb
Nov 08 17:15:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Attempting to detach device vdb from instance e33217d2-fd96-49fb-9727-faeb76f0e219 from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 17:15:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:15:26 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:15:26 user nova-compute[74669]:   <source dev="/dev/sdd"/>
Nov 08 17:15:26 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:15:26 user nova-compute[74669]:   <serial>a93e9e3d-0c9f-40e7-b911-e23bf953edc4</serial>
Nov 08 17:15:26 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:15:26 user nova-compute[74669]: </disk>
Nov 08 17:15:26 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:15:26 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Successfully detached device vdb from instance e33217d2-fd96-49fb-9727-faeb76f0e219 from the persistent domain config.
Nov 08 17:15:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e33217d2-fd96-49fb-9727-faeb76f0e219 from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 17:15:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:15:26 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:15:26 user nova-compute[74669]:   <source dev="/dev/sdd"/>
Nov 08 17:15:26 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:15:26 user nova-compute[74669]:   <serial>a93e9e3d-0c9f-40e7-b911-e23bf953edc4</serial>
Nov 08 17:15:26 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:15:26 user nova-compute[74669]: </disk>
Nov 08 17:15:26 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:15:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "e33217d2-fd96-49fb-9727-faeb76f0e219" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:15:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-a61c0fa9-c386-4af3-9655-9ce6f32b99a0 req-11869689-2008-4d7e-9ab4-b199b9d12db1 service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Received event network-vif-plugged-211a12bb-0d17-4746-b1ed-4cc9dee09c05 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:15:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a61c0fa9-c386-4af3-9655-9ce6f32b99a0 req-11869689-2008-4d7e-9ab4-b199b9d12db1 service nova] Acquiring lock "94098bcd-577b-4bf9-9e62-e21b984eb936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:15:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a61c0fa9-c386-4af3-9655-9ce6f32b99a0 req-11869689-2008-4d7e-9ab4-b199b9d12db1 service nova] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:15:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a61c0fa9-c386-4af3-9655-9ce6f32b99a0 req-11869689-2008-4d7e-9ab4-b199b9d12db1 service nova] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:15:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-a61c0fa9-c386-4af3-9655-9ce6f32b99a0 req-11869689-2008-4d7e-9ab4-b199b9d12db1 service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] No waiting events found dispatching network-vif-plugged-211a12bb-0d17-4746-b1ed-4cc9dee09c05 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:15:26 user nova-compute[74669]: WARNING nova.compute.manager [req-a61c0fa9-c386-4af3-9655-9ce6f32b99a0 req-11869689-2008-4d7e-9ab4-b199b9d12db1 service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Received unexpected event network-vif-plugged-211a12bb-0d17-4746-b1ed-4cc9dee09c05 for instance with vm_state building and task_state spawning.
Nov 08 17:15:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e33217d2-fd96-49fb-9727-faeb76f0e219 {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 17:15:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-98c8c57d-efab-48ea-9142-236361e51fc0 req-2630b171-ce9c-4564-9737-1711c03dff8c service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Received event network-vif-plugged-211a12bb-0d17-4746-b1ed-4cc9dee09c05 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:15:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-98c8c57d-efab-48ea-9142-236361e51fc0 req-2630b171-ce9c-4564-9737-1711c03dff8c service nova] Acquiring lock "94098bcd-577b-4bf9-9e62-e21b984eb936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:15:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-98c8c57d-efab-48ea-9142-236361e51fc0 req-2630b171-ce9c-4564-9737-1711c03dff8c service nova] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:15:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-98c8c57d-efab-48ea-9142-236361e51fc0 req-2630b171-ce9c-4564-9737-1711c03dff8c service nova] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:15:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-98c8c57d-efab-48ea-9142-236361e51fc0 req-2630b171-ce9c-4564-9737-1711c03dff8c service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] No waiting events found dispatching network-vif-plugged-211a12bb-0d17-4746-b1ed-4cc9dee09c05 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:15:28 user nova-compute[74669]: WARNING nova.compute.manager [req-98c8c57d-efab-48ea-9142-236361e51fc0 req-2630b171-ce9c-4564-9737-1711c03dff8c service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Received unexpected event network-vif-plugged-211a12bb-0d17-4746-b1ed-4cc9dee09c05 for instance with vm_state building and task_state spawning.
Nov 08 17:15:28 user nova-compute[74669]: DEBUG nova.compute.manager [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:15:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:15:28 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Instance spawned successfully.
Nov 08 17:15:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:15:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:15:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:15:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:15:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:15:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:15:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:15:28 user nova-compute[74669]: INFO nova.compute.manager [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Took 6.20 seconds to spawn the instance on the hypervisor.
Nov 08 17:15:28 user nova-compute[74669]: DEBUG nova.compute.manager [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:15:28 user nova-compute[74669]: INFO nova.compute.manager [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Took 6.99 seconds to build instance.
Nov 08 17:15:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7f27cde6-a661-46b5-b897-716c953d52cf tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.092s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:15:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:31 user nova-compute[74669]: INFO nova.compute.manager [None req-73e31487-d930-4c1c-97a6-9fd2ed7b3031 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Get console output
Nov 08 17:15:31 user nova-compute[74669]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 08 17:15:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:15:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:15:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:15:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:15:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:15:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:45 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3754330e-8b41-4e69-93f9-508ef5adf772 is timed out.
Nov 08 17:15:45 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Successfully detached device vdb from instance 3754330e-8b41-4e69-93f9-508ef5adf772 from the live domain config.
Nov 08 17:15:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URyZvqHI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:15:45 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:15:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5738037-c23e-42ba-b8b2-a6d663e4859b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:15:45 user nova-compute[74669]: No targets found.
Nov 08 17:15:45 user nova-compute[74669]: iSNS:
Nov 08 17:15:45 user nova-compute[74669]: No targets found.
Nov 08 17:15:45 user nova-compute[74669]: STATIC:
Nov 08 17:15:45 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4
Nov 08 17:15:45 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:15:45 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:15:45 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b
Nov 08 17:15:45 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:15:45 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:15:45 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa
Nov 08 17:15:45 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:15:45 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:15:45 user nova-compute[74669]: FIRMWARE:
Nov 08 17:15:45 user nova-compute[74669]: No targets found.
Nov 08 17:15:45 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:15:45 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:15:45 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[455f05b2-69de-49af-ab48-adf7e150f945]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cadc8d-94ae-4380-9ffe-cd8433dbaa0a]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:15:45 user nova-compute[74669]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa (non-flash)
Nov 08 17:15:45 user nova-compute[74669]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 (non-flash)
Nov 08 17:15:45 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:15:45 user nova-compute[74669]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa (non-flash)
Nov 08 17:15:45 user nova-compute[74669]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 (non-flash)
Nov 08 17:15:45 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9846be440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa'): ({'sdc'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Removing single pathed devices sdc {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c091e6d-b07a-40d5-ab59-5d080b31a8f8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc21023-30bc-4839-ad96-26483cfc862b]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Flushing IO for device /dev/sdc {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9492961e-6f20-444b-910a-c2dc8b4a84e7]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e48fd5-d4ec-440d-b717-bc2a777d1294]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d02440-8b2e-4552-b363-afd0689f2c2e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[254b43b5-4022-408c-a334-37035643d914]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa, portal: 172.16.0.220,3260]
Nov 08 17:15:45 user nova-compute[74669]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa, portal: 172.16.0.220,3260] successful.
Nov 08 17:15:45 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b98844f-8f0c-44cd-92d2-4650be2efbaa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f105f7c9-1bc1-4067-8ec9-b8dd85953188]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] <== disconnect_volume: return (294ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:15:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG nova.objects.instance [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lazy-loading 'flavor' on Instance uuid 3754330e-8b41-4e69-93f9-508ef5adf772 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-22035c8f-5e87-435a-bf88-42a51a509d2c tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "3754330e-8b41-4e69-93f9-508ef5adf772" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.140s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:15:46 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e33217d2-fd96-49fb-9727-faeb76f0e219 is timed out.
Nov 08 17:15:46 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Successfully detached device vdb from instance e33217d2-fd96-49fb-9727-faeb76f0e219 from the live domain config.
Nov 08 17:15:46 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYHRrTuZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:15:46 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:15:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6891be3-c065-4f46-a200-959a01a5addf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:15:46 user nova-compute[74669]: No targets found.
Nov 08 17:15:46 user nova-compute[74669]: iSNS:
Nov 08 17:15:46 user nova-compute[74669]: No targets found.
Nov 08 17:15:46 user nova-compute[74669]: STATIC:
Nov 08 17:15:46 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4
Nov 08 17:15:46 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:15:46 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:15:46 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b
Nov 08 17:15:46 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:15:46 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:15:46 user nova-compute[74669]: FIRMWARE:
Nov 08 17:15:46 user nova-compute[74669]: No targets found.
Nov 08 17:15:46 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:15:46 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:15:46 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c711eb-4b95-4ff4-b019-fb322678d0b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2ef199-e203-4410-87e0-ba49ff12ba39]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:15:46 user nova-compute[74669]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 (non-flash)
Nov 08 17:15:46 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:15:46 user nova-compute[74669]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 (non-flash)
Nov 08 17:15:46 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9846bd480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4'): ({'sdd'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Removing single pathed devices sdd {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d924be-0904-4d7f-ba93-07d7c0505bff]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fce44e-a106-4d01-9c9a-3ebb367c26d9]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Flushing IO for device /dev/sdd {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c51949-c04d-41b1-a82b-4cfac8c4c9b3]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dc189f-be01-4f88-902f-1a267d35ec28]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] SCSI volumes sdd have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b53e043-37e9-490c-a20a-f3f124280c37]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:15:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3d8af0-f16b-49e5-848c-00686bfcc2d0]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4, portal: 172.16.0.220,3260]
Nov 08 17:15:47 user nova-compute[74669]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4, portal: 172.16.0.220,3260] successful.
Nov 08 17:15:47 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:15:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd94c8a-cad6-4e6e-8e26-25de23790a5c]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:15:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:15:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] <== disconnect_volume: return (280ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:15:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:15:47 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lazy-loading 'flavor' on Instance uuid e33217d2-fd96-49fb-9727-faeb76f0e219 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d1bd5b4c-c933-4dc1-a91c-44bf7f36a408 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "e33217d2-fd96-49fb-9727-faeb76f0e219" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.036s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "e33217d2-fd96-49fb-9727-faeb76f0e219" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.762s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "e33217d2-fd96-49fb-9727-faeb76f0e219-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "e33217d2-fd96-49fb-9727-faeb76f0e219-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "e33217d2-fd96-49fb-9727-faeb76f0e219-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:15:48 user nova-compute[74669]: INFO nova.compute.manager [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Terminating instance
Nov 08 17:15:48 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-2b7f913a-ef15-4925-b7c1-6d384318aa6e req-f32e324e-0a3a-49be-a964-463bef98cbc8 service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Received event network-vif-unplugged-47ecb2d0-7388-4a1f-a5c1-a7090c790f36 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2b7f913a-ef15-4925-b7c1-6d384318aa6e req-f32e324e-0a3a-49be-a964-463bef98cbc8 service nova] Acquiring lock "e33217d2-fd96-49fb-9727-faeb76f0e219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2b7f913a-ef15-4925-b7c1-6d384318aa6e req-f32e324e-0a3a-49be-a964-463bef98cbc8 service nova] Lock "e33217d2-fd96-49fb-9727-faeb76f0e219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2b7f913a-ef15-4925-b7c1-6d384318aa6e req-f32e324e-0a3a-49be-a964-463bef98cbc8 service nova] Lock "e33217d2-fd96-49fb-9727-faeb76f0e219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-2b7f913a-ef15-4925-b7c1-6d384318aa6e req-f32e324e-0a3a-49be-a964-463bef98cbc8 service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] No waiting events found dispatching network-vif-unplugged-47ecb2d0-7388-4a1f-a5c1-a7090c790f36 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-2b7f913a-ef15-4925-b7c1-6d384318aa6e req-f32e324e-0a3a-49be-a964-463bef98cbc8 service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Received event network-vif-unplugged-47ecb2d0-7388-4a1f-a5c1-a7090c790f36 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:15:48 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Instance destroyed successfully.
Nov 08 17:15:48 user nova-compute[74669]: DEBUG nova.objects.instance [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lazy-loading 'resources' on Instance uuid e33217d2-fd96-49fb-9727-faeb76f0e219 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:11:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-948176804',display_name='tempest-VolumesSnapshotTestJSON-instance-948176804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-948176804',id=33,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyAiUwT66QRj+WXj1Ky7tKVlAzCdxQDPWXzuLhlIS5mu8LTRNEJLbjlE9DOF7TnK7wQ8BPM0EM1785HJo+sD0OUHXdCpZlFAmxzf2we2UxQZ8JOpHd80mUG1MP+fxsSnA==',key_name='tempest-keypair-1720310976',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:11:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f7557a75c804d1da4c2d6fea8364f6d',ramdisk_id='',reservation_id='r-xwldbxrv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-600470725',owner_user_name='tempest-VolumesSnapshotTestJSON-600470725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64378f1b06c14150b824b1c29a5430fd',uuid=e33217d2-fd96-49fb-9727-faeb76f0e219,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47ecb2d0-7388-4a1f-a5c1-a7090c790f36", "address": "fa:16:3e:68:6f:55", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ecb2d0-73", "ovs_interfaceid": "47ecb2d0-7388-4a1f-a5c1-a7090c790f36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Converting VIF {"id": "47ecb2d0-7388-4a1f-a5c1-a7090c790f36", "address": "fa:16:3e:68:6f:55", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47ecb2d0-73", "ovs_interfaceid": "47ecb2d0-7388-4a1f-a5c1-a7090c790f36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:6f:55,bridge_name='br-int',has_traffic_filtering=True,id=47ecb2d0-7388-4a1f-a5c1-a7090c790f36,network=Network(284f544e-dabf-4ae2-b70c-f8ce15736863),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ecb2d0-73') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG os_vif [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:6f:55,bridge_name='br-int',has_traffic_filtering=True,id=47ecb2d0-7388-4a1f-a5c1-a7090c790f36,network=Network(284f544e-dabf-4ae2-b70c-f8ce15736863),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ecb2d0-73') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47ecb2d0-73, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05ec808a-f915-4a26-996d-d97725dc928a) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:48 user nova-compute[74669]: INFO os_vif [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:6f:55,bridge_name='br-int',has_traffic_filtering=True,id=47ecb2d0-7388-4a1f-a5c1-a7090c790f36,network=Network(284f544e-dabf-4ae2-b70c-f8ce15736863),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47ecb2d0-73')
Nov 08 17:15:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hYHRrTuZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:15:48 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:15:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8061a937-b73c-4242-a0c3-5d866acfa65f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:15:48 user nova-compute[74669]: No targets found.
Nov 08 17:15:48 user nova-compute[74669]: iSNS:
Nov 08 17:15:48 user nova-compute[74669]: No targets found.
Nov 08 17:15:48 user nova-compute[74669]: STATIC:
Nov 08 17:15:48 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b
Nov 08 17:15:48 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:15:48 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:15:48 user nova-compute[74669]: FIRMWARE:
Nov 08 17:15:48 user nova-compute[74669]: No targets found.
Nov 08 17:15:48 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:15:48 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:15:48 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a93e9e3d-0c9f-40e7-b911-e23bf953edc4', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb44459e-43d9-4287-b6f0-962b5b47ff8c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9425fa6f-aad1-4321-b02e-6b77227df88f]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:15:48 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:15:48 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd98469c280>, {}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Disconnecting from: [] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.065s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] <== disconnect_volume: return (66ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:15:48 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Deleting instance files /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219_del
Nov 08 17:15:48 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Deletion of /opt/stack/data/nova/instances/e33217d2-fd96-49fb-9727-faeb76f0e219_del complete
Nov 08 17:15:48 user nova-compute[74669]: INFO nova.compute.manager [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 08 17:15:48 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:15:48 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:15:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:49 user nova-compute[74669]: DEBUG nova.compute.manager [req-7403b4cb-fc14-47aa-ab5b-bc13ccc08a19 req-efb1dea6-86df-4651-8506-bfa61e6e5672 service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Received event network-vif-deleted-47ecb2d0-7388-4a1f-a5c1-a7090c790f36 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:15:49 user nova-compute[74669]: INFO nova.compute.manager [req-7403b4cb-fc14-47aa-ab5b-bc13ccc08a19 req-efb1dea6-86df-4651-8506-bfa61e6e5672 service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Neutron deleted interface 47ecb2d0-7388-4a1f-a5c1-a7090c790f36; detaching it from the instance and deleting it from the info cache
Nov 08 17:15:49 user nova-compute[74669]: DEBUG nova.network.neutron [req-7403b4cb-fc14-47aa-ab5b-bc13ccc08a19 req-efb1dea6-86df-4651-8506-bfa61e6e5672 service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:15:49 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:15:49 user nova-compute[74669]: DEBUG nova.compute.manager [req-7403b4cb-fc14-47aa-ab5b-bc13ccc08a19 req-efb1dea6-86df-4651-8506-bfa61e6e5672 service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Detach interface failed, port_id=47ecb2d0-7388-4a1f-a5c1-a7090c790f36, reason: Instance e33217d2-fd96-49fb-9727-faeb76f0e219 could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 17:15:49 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Took 0.70 seconds to deallocate network for instance.
Nov 08 17:15:49 user nova-compute[74669]: WARNING nova.volume.cinder [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Attachment 5b470fff-4e24-4dcc-89a5-062a6f3c06af does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 5b470fff-4e24-4dcc-89a5-062a6f3c06af. (HTTP 404) (Request-ID: req-fd033c51-84d7-45a3-aa6e-8e8d3dd97c42)
Nov 08 17:15:49 user nova-compute[74669]: INFO nova.compute.manager [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Took 0.02 seconds to detach 1 volumes for instance.
Nov 08 17:15:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:15:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:15:49 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:15:49 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:15:49 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:15:50 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Deleted allocations for instance e33217d2-fd96-49fb-9727-faeb76f0e219
Nov 08 17:15:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a53deabf-b4aa-474f-acc1-688a6e35fbc7 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "e33217d2-fd96-49fb-9727-faeb76f0e219" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.133s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:15:50 user nova-compute[74669]: DEBUG nova.compute.manager [req-3ef5c46f-7a21-4074-afb2-2758f5c212a7 req-cfaf0187-a079-475f-a76b-dbf3c016decf service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Received event network-vif-plugged-47ecb2d0-7388-4a1f-a5c1-a7090c790f36 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:15:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3ef5c46f-7a21-4074-afb2-2758f5c212a7 req-cfaf0187-a079-475f-a76b-dbf3c016decf service nova] Acquiring lock "e33217d2-fd96-49fb-9727-faeb76f0e219-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:15:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3ef5c46f-7a21-4074-afb2-2758f5c212a7 req-cfaf0187-a079-475f-a76b-dbf3c016decf service nova] Lock "e33217d2-fd96-49fb-9727-faeb76f0e219-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:15:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3ef5c46f-7a21-4074-afb2-2758f5c212a7 req-cfaf0187-a079-475f-a76b-dbf3c016decf service nova] Lock "e33217d2-fd96-49fb-9727-faeb76f0e219-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:15:50 user nova-compute[74669]: DEBUG nova.compute.manager [req-3ef5c46f-7a21-4074-afb2-2758f5c212a7 req-cfaf0187-a079-475f-a76b-dbf3c016decf service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] No waiting events found dispatching network-vif-plugged-47ecb2d0-7388-4a1f-a5c1-a7090c790f36 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:15:50 user nova-compute[74669]: WARNING nova.compute.manager [req-3ef5c46f-7a21-4074-afb2-2758f5c212a7 req-cfaf0187-a079-475f-a76b-dbf3c016decf service nova] [instance: e33217d2-fd96-49fb-9727-faeb76f0e219] Received unexpected event network-vif-plugged-47ecb2d0-7388-4a1f-a5c1-a7090c790f36 for instance with vm_state deleted and task_state None.
Nov 08 17:15:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:15:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:01 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:16:03 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:16:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:04 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:16:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:16:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:16:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:16:04 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:16:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:16:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:16:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:16:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:16:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:16:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:16:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:16:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:16:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:16:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:16:05 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:16:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:16:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:16:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:16:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:16:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:16:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:16:06 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:16:06 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:16:06 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8283MB free_disk=25.312606811523438GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:16:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:16:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:16:06 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7b335462-0d93-4899-a223-5c2e36932578 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:16:06 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2158a7c2-2f46-4bce-8558-4347a48623d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:16:06 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 3754330e-8b41-4e69-93f9-508ef5adf772 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:16:06 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 746bdbac-3e36-4a08-989a-c004634890f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:16:06 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 94098bcd-577b-4bf9-9e62-e21b984eb936 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:16:06 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:16:06 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:16:07 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:16:07 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:16:07 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:16:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:16:08 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:16:08 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:16:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-746bdbac-3e36-4a08-989a-c004634890f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:16:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-746bdbac-3e36-4a08-989a-c004634890f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:16:08 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:16:08 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Updating instance_info_cache with network_info: [{"id": "f33d0612-bda7-41c8-ba61-d965030f2304", "address": "fa:16:3e:55:1b:72", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33d0612-bd", "ovs_interfaceid": "f33d0612-bda7-41c8-ba61-d965030f2304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:16:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-746bdbac-3e36-4a08-989a-c004634890f9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:16:08 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:16:08 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:16:08 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:16:08 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:16:08 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:16:08 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:16:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:16:11 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:16:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "3754330e-8b41-4e69-93f9-508ef5adf772" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:16:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "3754330e-8b41-4e69-93f9-508ef5adf772" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:16:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "3754330e-8b41-4e69-93f9-508ef5adf772-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:16:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "3754330e-8b41-4e69-93f9-508ef5adf772-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:16:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "3754330e-8b41-4e69-93f9-508ef5adf772-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:16:14 user nova-compute[74669]: INFO nova.compute.manager [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Terminating instance
Nov 08 17:16:14 user nova-compute[74669]: DEBUG nova.compute.manager [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-3722af2a-2915-43c8-a43b-8eb89d08b909 req-4256b621-afdc-448e-8d01-608446c721bb service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Received event network-vif-unplugged-e1e01142-baa0-4410-a147-a0981b4bbd54 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3722af2a-2915-43c8-a43b-8eb89d08b909 req-4256b621-afdc-448e-8d01-608446c721bb service nova] Acquiring lock "3754330e-8b41-4e69-93f9-508ef5adf772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3722af2a-2915-43c8-a43b-8eb89d08b909 req-4256b621-afdc-448e-8d01-608446c721bb service nova] Lock "3754330e-8b41-4e69-93f9-508ef5adf772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3722af2a-2915-43c8-a43b-8eb89d08b909 req-4256b621-afdc-448e-8d01-608446c721bb service nova] Lock "3754330e-8b41-4e69-93f9-508ef5adf772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-3722af2a-2915-43c8-a43b-8eb89d08b909 req-4256b621-afdc-448e-8d01-608446c721bb service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] No waiting events found dispatching network-vif-unplugged-e1e01142-baa0-4410-a147-a0981b4bbd54 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-3722af2a-2915-43c8-a43b-8eb89d08b909 req-4256b621-afdc-448e-8d01-608446c721bb service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Received event network-vif-unplugged-e1e01142-baa0-4410-a147-a0981b4bbd54 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:15 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Instance destroyed successfully.
Nov 08 17:16:15 user nova-compute[74669]: DEBUG nova.objects.instance [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lazy-loading 'resources' on Instance uuid 3754330e-8b41-4e69-93f9-508ef5adf772 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:10:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-590350783',display_name='tempest-AttachVolumeNegativeTest-server-590350783',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-590350783',id=31,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4GgY0bFzCvuFysSfG+ayqqZin61DX+ouTxt65eTuj9s3YTMeT2wjnTaTNUCBoTZJzLpwQUNzZ9JN9LgaGxFGYdn+z5/kAAHocLOG/tYRJcO1QfxbbkjbQnQmxyVZlp6g==',key_name='tempest-keypair-617492706',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:10:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f58f78f65e774cf78ca0c49aa11f9b54',ramdisk_id='',reservation_id='r-epuggkon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1846694333',owner_user_name='tempest-AttachVolumeNegativeTest-1846694333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:10:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='565488b722e44809a7cff5e617daae84',uuid=3754330e-8b41-4e69-93f9-508ef5adf772,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1e01142-baa0-4410-a147-a0981b4bbd54", "address": "fa:16:3e:b6:8f:c8", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e01142-ba", "ovs_interfaceid": "e1e01142-baa0-4410-a147-a0981b4bbd54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converting VIF {"id": "e1e01142-baa0-4410-a147-a0981b4bbd54", "address": "fa:16:3e:b6:8f:c8", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e01142-ba", "ovs_interfaceid": "e1e01142-baa0-4410-a147-a0981b4bbd54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:8f:c8,bridge_name='br-int',has_traffic_filtering=True,id=e1e01142-baa0-4410-a147-a0981b4bbd54,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1e01142-ba') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG os_vif [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:8f:c8,bridge_name='br-int',has_traffic_filtering=True,id=e1e01142-baa0-4410-a147-a0981b4bbd54,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1e01142-ba') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1e01142-ba, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9abb81dc-9ee3-44c5-8c62-799c8d4cf0b3) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:16:15 user nova-compute[74669]: INFO os_vif [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:8f:c8,bridge_name='br-int',has_traffic_filtering=True,id=e1e01142-baa0-4410-a147-a0981b4bbd54,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1e01142-ba')
Nov 08 17:16:15 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Deleting instance files /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772_del
Nov 08 17:16:15 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Deletion of /opt/stack/data/nova/instances/3754330e-8b41-4e69-93f9-508ef5adf772_del complete
Nov 08 17:16:15 user nova-compute[74669]: INFO nova.compute.manager [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 08 17:16:15 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:16:15 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:16:16 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:16:16 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Took 0.76 seconds to deallocate network for instance.
Nov 08 17:16:16 user nova-compute[74669]: DEBUG nova.compute.manager [req-703cf8b8-7cea-4709-bc26-86275be06bdd req-3971cf45-928a-4414-82c7-3649eba9fc98 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Received event network-vif-deleted-e1e01142-baa0-4410-a147-a0981b4bbd54 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:16:16 user nova-compute[74669]: INFO nova.compute.manager [req-703cf8b8-7cea-4709-bc26-86275be06bdd req-3971cf45-928a-4414-82c7-3649eba9fc98 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Neutron deleted interface e1e01142-baa0-4410-a147-a0981b4bbd54; detaching it from the instance and deleting it from the info cache
Nov 08 17:16:16 user nova-compute[74669]: DEBUG nova.network.neutron [req-703cf8b8-7cea-4709-bc26-86275be06bdd req-3971cf45-928a-4414-82c7-3649eba9fc98 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:16:16 user nova-compute[74669]: DEBUG nova.compute.manager [req-703cf8b8-7cea-4709-bc26-86275be06bdd req-3971cf45-928a-4414-82c7-3649eba9fc98 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Detach interface failed, port_id=e1e01142-baa0-4410-a147-a0981b4bbd54, reason: Instance 3754330e-8b41-4e69-93f9-508ef5adf772 could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 17:16:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:16:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:16:16 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:16:16 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:16:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:16:16 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Deleted allocations for instance 3754330e-8b41-4e69-93f9-508ef5adf772
Nov 08 17:16:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-da484712-d27b-4777-8ca3-71a7d76bc423 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "3754330e-8b41-4e69-93f9-508ef5adf772" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.058s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:16:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-8b46f753-b8f1-4043-97a0-349d35289084 req-87a0b36c-efe5-4a62-8abf-7887127d8a25 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Received event network-vif-plugged-e1e01142-baa0-4410-a147-a0981b4bbd54 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:16:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8b46f753-b8f1-4043-97a0-349d35289084 req-87a0b36c-efe5-4a62-8abf-7887127d8a25 service nova] Acquiring lock "3754330e-8b41-4e69-93f9-508ef5adf772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:16:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8b46f753-b8f1-4043-97a0-349d35289084 req-87a0b36c-efe5-4a62-8abf-7887127d8a25 service nova] Lock "3754330e-8b41-4e69-93f9-508ef5adf772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:16:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8b46f753-b8f1-4043-97a0-349d35289084 req-87a0b36c-efe5-4a62-8abf-7887127d8a25 service nova] Lock "3754330e-8b41-4e69-93f9-508ef5adf772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:16:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-8b46f753-b8f1-4043-97a0-349d35289084 req-87a0b36c-efe5-4a62-8abf-7887127d8a25 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] No waiting events found dispatching network-vif-plugged-e1e01142-baa0-4410-a147-a0981b4bbd54 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:16:17 user nova-compute[74669]: WARNING nova.compute.manager [req-8b46f753-b8f1-4043-97a0-349d35289084 req-87a0b36c-efe5-4a62-8abf-7887127d8a25 service nova] [instance: 3754330e-8b41-4e69-93f9-508ef5adf772] Received unexpected event network-vif-plugged-e1e01142-baa0-4410-a147-a0981b4bbd54 for instance with vm_state deleted and task_state None.
Nov 08 17:16:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:16:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:16:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:16:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:16:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "746bdbac-3e36-4a08-989a-c004634890f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "746bdbac-3e36-4a08-989a-c004634890f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "746bdbac-3e36-4a08-989a-c004634890f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "746bdbac-3e36-4a08-989a-c004634890f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "746bdbac-3e36-4a08-989a-c004634890f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:16:32 user nova-compute[74669]: INFO nova.compute.manager [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Terminating instance
Nov 08 17:16:32 user nova-compute[74669]: DEBUG nova.compute.manager [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG nova.compute.manager [req-7eb3f6a7-69a7-417c-b461-dc53e2adba60 req-1fc4ebe5-145a-4ce1-b14c-f07b6768b3dc service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Received event network-vif-unplugged-f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-7eb3f6a7-69a7-417c-b461-dc53e2adba60 req-1fc4ebe5-145a-4ce1-b14c-f07b6768b3dc service nova] Acquiring lock "746bdbac-3e36-4a08-989a-c004634890f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-7eb3f6a7-69a7-417c-b461-dc53e2adba60 req-1fc4ebe5-145a-4ce1-b14c-f07b6768b3dc service nova] Lock "746bdbac-3e36-4a08-989a-c004634890f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-7eb3f6a7-69a7-417c-b461-dc53e2adba60 req-1fc4ebe5-145a-4ce1-b14c-f07b6768b3dc service nova] Lock "746bdbac-3e36-4a08-989a-c004634890f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG nova.compute.manager [req-7eb3f6a7-69a7-417c-b461-dc53e2adba60 req-1fc4ebe5-145a-4ce1-b14c-f07b6768b3dc service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] No waiting events found dispatching network-vif-unplugged-f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG nova.compute.manager [req-7eb3f6a7-69a7-417c-b461-dc53e2adba60 req-1fc4ebe5-145a-4ce1-b14c-f07b6768b3dc service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Received event network-vif-unplugged-f33d0612-bda7-41c8-ba61-d965030f2304 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:32 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Instance destroyed successfully.
Nov 08 17:16:32 user nova-compute[74669]: DEBUG nova.objects.instance [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lazy-loading 'resources' on Instance uuid 746bdbac-3e36-4a08-989a-c004634890f9 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1960764715',display_name='tempest-ServerActionsTestOtherA-server-1960764715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1960764715',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVa16AMO6wxCfNzgZtwDGNOHyvTHwI2kbeRR1JWZMRp/+84NydbzrImNzwJFwUc5Mt6eRV8qh3XhhGBx3qjvshZcC9T6FOe5uxOhgTpdbBqJBGj5+jnhuvk7Bsl6Ed/tQ==',key_name='tempest-keypair-2114035891',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:12:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='766b82c0c2cd480f96d155adf4f6de4c',ramdisk_id='',reservation_id='r-3who8v2k',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-23582724',owner_user_name='tempest-ServerActionsTestOtherA-23582724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:13:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e118c178ece2492bb2d975643c405196',uuid=746bdbac-3e36-4a08-989a-c004634890f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f33d0612-bda7-41c8-ba61-d965030f2304", "address": "fa:16:3e:55:1b:72", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33d0612-bd", "ovs_interfaceid": "f33d0612-bda7-41c8-ba61-d965030f2304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converting VIF {"id": "f33d0612-bda7-41c8-ba61-d965030f2304", "address": "fa:16:3e:55:1b:72", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf33d0612-bd", "ovs_interfaceid": "f33d0612-bda7-41c8-ba61-d965030f2304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:1b:72,bridge_name='br-int',has_traffic_filtering=True,id=f33d0612-bda7-41c8-ba61-d965030f2304,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33d0612-bd') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG os_vif [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:1b:72,bridge_name='br-int',has_traffic_filtering=True,id=f33d0612-bda7-41c8-ba61-d965030f2304,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33d0612-bd') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf33d0612-bd, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f7fc3ab-6af4-4442-810f-11e8c428ceb5) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:32 user nova-compute[74669]: INFO os_vif [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:1b:72,bridge_name='br-int',has_traffic_filtering=True,id=f33d0612-bda7-41c8-ba61-d965030f2304,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf33d0612-bd')
Nov 08 17:16:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHlwFeBI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:16:32 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:16:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7264e380-21a6-4700-b1b6-98645d4b0d2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:16:32 user nova-compute[74669]: No targets found.
Nov 08 17:16:32 user nova-compute[74669]: iSNS:
Nov 08 17:16:32 user nova-compute[74669]: No targets found.
Nov 08 17:16:32 user nova-compute[74669]: STATIC:
Nov 08 17:16:32 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b
Nov 08 17:16:32 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:16:32 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:16:32 user nova-compute[74669]: FIRMWARE:
Nov 08 17:16:32 user nova-compute[74669]: No targets found.
Nov 08 17:16:32 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:16:32 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:16:32 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec991b0-7f0a-4e7d-8326-1086e3818136]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2004ac-5d21-4cd1-a1f0-ba30bbc09409]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:16:32 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b (non-flash)
Nov 08 17:16:32 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9b9f88280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b'): ({'sdb'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Removing single pathed devices sdb {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[757905d1-1ad2-4140-8e8c-a348cc2c08fe]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e437fd6-9981-4cb0-8777-5e28ff17dfcc]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Flushing IO for device /dev/sdb {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9283a5a3-b4f7-49ef-96a0-3c1d6c234dc5]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cb3f47-92b7-436b-9ac0-b86500be3eb7]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_17b1f00b', '/dev/disk/by-id/scsi-1SCST_BIO17b1f00b-732aea598bb34662', '/dev/disk/by-id/scsi-23733326165613539') {{(pid=86107) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[396f3d6b-6fff-4a21-967d-a16cd1bd8ce6]: (4, None) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:16:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:16:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:16:33 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a2729d-6ead-4d51-a33e-905aecbb81bb]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:16:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:16:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:16:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:16:33 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b8efbe-d182-47de-8e3e-26527e90fbbc]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:16:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b, portal: 172.16.0.220,3260]
Nov 08 17:16:33 user nova-compute[74669]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b, portal: 172.16.0.220,3260] successful.
Nov 08 17:16:33 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:16:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:16:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26643eca-01db-4eae-9621-c1371bd1e66b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:16:33 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[744b8018-9c1d-41b7-9786-f5a7fcca85a8]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:16:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:16:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:16:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] <== disconnect_volume: return (307ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:16:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:16:33 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Deleting instance files /opt/stack/data/nova/instances/746bdbac-3e36-4a08-989a-c004634890f9_del
Nov 08 17:16:33 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Deletion of /opt/stack/data/nova/instances/746bdbac-3e36-4a08-989a-c004634890f9_del complete
Nov 08 17:16:33 user nova-compute[74669]: INFO nova.compute.manager [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 08 17:16:33 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:16:33 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:16:33 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:16:33 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:16:33 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Took 0.68 seconds to deallocate network for instance.
Nov 08 17:16:33 user nova-compute[74669]: DEBUG nova.compute.manager [req-9cc24fc1-63d5-452a-9832-6263a75402eb req-4927062d-d7ae-4f59-b3fb-c60a9b63e998 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Received event network-vif-deleted-f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:16:33 user nova-compute[74669]: INFO nova.compute.manager [req-9cc24fc1-63d5-452a-9832-6263a75402eb req-4927062d-d7ae-4f59-b3fb-c60a9b63e998 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Neutron deleted interface f33d0612-bda7-41c8-ba61-d965030f2304; detaching it from the instance and deleting it from the info cache
Nov 08 17:16:33 user nova-compute[74669]: DEBUG nova.network.neutron [req-9cc24fc1-63d5-452a-9832-6263a75402eb req-4927062d-d7ae-4f59-b3fb-c60a9b63e998 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:16:33 user nova-compute[74669]: DEBUG nova.compute.manager [req-9cc24fc1-63d5-452a-9832-6263a75402eb req-4927062d-d7ae-4f59-b3fb-c60a9b63e998 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Detach interface failed, port_id=f33d0612-bda7-41c8-ba61-d965030f2304, reason: Instance 746bdbac-3e36-4a08-989a-c004634890f9 could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 17:16:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-728c6f54-66c7-45e5-bd3c-f0cc77397328 req-22e8339a-6e4c-4723-8f92-523843de10d1 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Received event network-vif-plugged-f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:16:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-728c6f54-66c7-45e5-bd3c-f0cc77397328 req-22e8339a-6e4c-4723-8f92-523843de10d1 service nova] Acquiring lock "746bdbac-3e36-4a08-989a-c004634890f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:16:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-728c6f54-66c7-45e5-bd3c-f0cc77397328 req-22e8339a-6e4c-4723-8f92-523843de10d1 service nova] Lock "746bdbac-3e36-4a08-989a-c004634890f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:16:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-728c6f54-66c7-45e5-bd3c-f0cc77397328 req-22e8339a-6e4c-4723-8f92-523843de10d1 service nova] Lock "746bdbac-3e36-4a08-989a-c004634890f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:16:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-728c6f54-66c7-45e5-bd3c-f0cc77397328 req-22e8339a-6e4c-4723-8f92-523843de10d1 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] No waiting events found dispatching network-vif-plugged-f33d0612-bda7-41c8-ba61-d965030f2304 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:16:34 user nova-compute[74669]: WARNING nova.compute.manager [req-728c6f54-66c7-45e5-bd3c-f0cc77397328 req-22e8339a-6e4c-4723-8f92-523843de10d1 service nova] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Received unexpected event network-vif-plugged-f33d0612-bda7-41c8-ba61-d965030f2304 for instance with vm_state active and task_state deleting.
Nov 08 17:16:34 user nova-compute[74669]: INFO nova.compute.manager [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Took 0.88 seconds to detach 1 volumes for instance.
Nov 08 17:16:34 user nova-compute[74669]: DEBUG nova.compute.manager [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 746bdbac-3e36-4a08-989a-c004634890f9] Deleting volume: 26643eca-01db-4eae-9621-c1371bd1e66b {{(pid=74669) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 17:16:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:16:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:16:34 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:16:34 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:16:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:16:35 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Deleted allocations for instance 746bdbac-3e36-4a08-989a-c004634890f9
Nov 08 17:16:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7730eb1a-7f40-4bb4-8770-7f2fe7969a50 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "746bdbac-3e36-4a08-989a-c004634890f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.148s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:16:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:16:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:16:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:17:01 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:17:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:03 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:17:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:06 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:17:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:06 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:17:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "2980b0f6-162c-47a9-8c10-198a39f7b5db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "2980b0f6-162c-47a9-8c10-198a39f7b5db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:08 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:17:08 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:17:08 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8575MB free_disk=25.337608337402344GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 7b335462-0d93-4899-a223-5c2e36932578 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2158a7c2-2f46-4bce-8558-4347a48623d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 94098bcd-577b-4bf9-9e62-e21b984eb936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2980b0f6-162c-47a9-8c10-198a39f7b5db has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing inventories for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Updating ProviderTree inventory for provider ce26964b-e55b-43d2-801a-7221ff1fe64b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Updating inventory in ProviderTree for provider ce26964b-e55b-43d2-801a-7221ff1fe64b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing aggregate associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, aggregates: None {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing trait associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, traits: HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Updating resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b generation from 46 to 47 during operation: update_traits {{(pid=74669) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "291835fd-2fac-4eab-a205-5b0119cd48d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "291835fd-2fac-4eab-a205-5b0119cd48d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG nova.compute.manager [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:17:08 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.568s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.325s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:17:09 user nova-compute[74669]: INFO nova.compute.claims [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Claim successful on node user
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.283s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:17:09 user nova-compute[74669]: INFO nova.compute.claims [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Claim successful on node user
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.network.neutron [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:17:09 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.policy [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64378f1b06c14150b824b1c29a5430fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7557a75c804d1da4c2d6fea8364f6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:17:09 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Creating image(s)
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "/opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "/opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "/opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.compute.manager [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.170s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.compute.manager [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.network.neutron [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:17:09 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.compute.manager [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Didn't find any instances for network info cache update. {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74669) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.policy [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '565488b722e44809a7cff5e617daae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58f78f65e774cf78ca0c49aa11f9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.179s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.compute.manager [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:17:09 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Creating image(s)
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "/opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "/opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "/opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk 1073741824" returned: 0 in 0.066s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG nova.network.neutron [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Successfully created port: b04b94e3-d7d6-4984-9cd6-9e88bf465c74 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.195s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.269s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.174s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG nova.network.neutron [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Successfully created port: 822d3fcd-483d-49f1-b886-a3c0b50d0c3d {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/disk 1073741824" returned: 0 in 0.087s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Cannot resize image /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Ensure instance console log exists: /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.187s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG nova.network.neutron [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Successfully updated port: b04b94e3-d7d6-4984-9cd6-9e88bf465c74 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "refresh_cache-2980b0f6-162c-47a9-8c10-198a39f7b5db" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquired lock "refresh_cache-2980b0f6-162c-47a9-8c10-198a39f7b5db" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG nova.network.neutron [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Cannot resize image /opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Ensure instance console log exists: /opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG nova.network.neutron [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG nova.compute.manager [req-47fce77b-80c8-4ca9-a295-2c5c947651d6 req-71fde250-ce25-466c-a427-718f796b9182 service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Received event network-changed-b04b94e3-d7d6-4984-9cd6-9e88bf465c74 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG nova.compute.manager [req-47fce77b-80c8-4ca9-a295-2c5c947651d6 req-71fde250-ce25-466c-a427-718f796b9182 service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Refreshing instance network info cache due to event network-changed-b04b94e3-d7d6-4984-9cd6-9e88bf465c74. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:17:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-47fce77b-80c8-4ca9-a295-2c5c947651d6 req-71fde250-ce25-466c-a427-718f796b9182 service nova] Acquiring lock "refresh_cache-2980b0f6-162c-47a9-8c10-198a39f7b5db" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.network.neutron [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Successfully updated port: 822d3fcd-483d-49f1-b886-a3c0b50d0c3d {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "refresh_cache-291835fd-2fac-4eab-a205-5b0119cd48d0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquired lock "refresh_cache-291835fd-2fac-4eab-a205-5b0119cd48d0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.network.neutron [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.compute.manager [req-72a68998-4745-4bbc-abe9-29286a89db3f req-2df17c69-f702-479c-aa69-b13821656a9b service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Received event network-changed-822d3fcd-483d-49f1-b886-a3c0b50d0c3d {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.compute.manager [req-72a68998-4745-4bbc-abe9-29286a89db3f req-2df17c69-f702-479c-aa69-b13821656a9b service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Refreshing instance network info cache due to event network-changed-822d3fcd-483d-49f1-b886-a3c0b50d0c3d. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-72a68998-4745-4bbc-abe9-29286a89db3f req-2df17c69-f702-479c-aa69-b13821656a9b service nova] Acquiring lock "refresh_cache-291835fd-2fac-4eab-a205-5b0119cd48d0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.network.neutron [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.network.neutron [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Updating instance_info_cache with network_info: [{"id": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "address": "fa:16:3e:a4:7b:71", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04b94e3-d7", "ovs_interfaceid": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Releasing lock "refresh_cache-2980b0f6-162c-47a9-8c10-198a39f7b5db" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Instance network_info: |[{"id": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "address": "fa:16:3e:a4:7b:71", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04b94e3-d7", "ovs_interfaceid": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-47fce77b-80c8-4ca9-a295-2c5c947651d6 req-71fde250-ce25-466c-a427-718f796b9182 service nova] Acquired lock "refresh_cache-2980b0f6-162c-47a9-8c10-198a39f7b5db" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.network.neutron [req-47fce77b-80c8-4ca9-a295-2c5c947651d6 req-71fde250-ce25-466c-a427-718f796b9182 service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Refreshing network info cache for port b04b94e3-d7d6-4984-9cd6-9e88bf465c74 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Start _get_guest_xml network_info=[{"id": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "address": "fa:16:3e:a4:7b:71", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04b94e3-d7", "ovs_interfaceid": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:17:11 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:17:11 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1443007992',display_name='tempest-VolumesSnapshotTestJSON-instance-1443007992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1443007992',id=36,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaEJJIZuosVMjTCjfdwyRNCValClguCrnQABHENXLij/AMAKyc3LVFgmsvkfBoJXahcZtnJ3nn25XZ3NJsqnuC8lq/4vHVnMD+cJyT8p3A5ojU6gz4pmmKutOJ47ND0cA==',key_name='tempest-keypair-2080375649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f7557a75c804d1da4c2d6fea8364f6d',ramdisk_id='',reservation_id='r-hvcbrufj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-600470725',owner_user_name='tempest-VolumesSnapshotTestJSON-600470725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:17:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64378f1b06c14150b824b1c29a5430fd',uuid=2980b0f6-162c-47a9-8c10-198a39f7b5db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "address": "fa:16:3e:a4:7b:71", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04b94e3-d7", "ovs_interfaceid": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Converting VIF {"id": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "address": "fa:16:3e:a4:7b:71", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04b94e3-d7", "ovs_interfaceid": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:71,bridge_name='br-int',has_traffic_filtering=True,id=b04b94e3-d7d6-4984-9cd6-9e88bf465c74,network=Network(284f544e-dabf-4ae2-b70c-f8ce15736863),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb04b94e3-d7') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.objects.instance [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lazy-loading 'pci_devices' on Instance uuid 2980b0f6-162c-47a9-8c10-198a39f7b5db {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:17:11 user nova-compute[74669]:   <uuid>2980b0f6-162c-47a9-8c10-198a39f7b5db</uuid>
Nov 08 17:17:11 user nova-compute[74669]:   <name>instance-00000024</name>
Nov 08 17:17:11 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:17:11 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:17:11 user nova-compute[74669]:   <metadata>
Nov 08 17:17:11 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:17:11 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:17:11 user nova-compute[74669]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1443007992</nova:name>
Nov 08 17:17:11 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:17:11</nova:creationTime>
Nov 08 17:17:11 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:17:11 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:17:11 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:17:11 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:17:11 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:17:11 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:17:11 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:17:11 user nova-compute[74669]:       <nova:owner>
Nov 08 17:17:11 user nova-compute[74669]:         <nova:user uuid="64378f1b06c14150b824b1c29a5430fd">tempest-VolumesSnapshotTestJSON-600470725-project-member</nova:user>
Nov 08 17:17:11 user nova-compute[74669]:         <nova:project uuid="3f7557a75c804d1da4c2d6fea8364f6d">tempest-VolumesSnapshotTestJSON-600470725</nova:project>
Nov 08 17:17:11 user nova-compute[74669]:       </nova:owner>
Nov 08 17:17:11 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:17:11 user nova-compute[74669]:       <nova:ports>
Nov 08 17:17:11 user nova-compute[74669]:         <nova:port uuid="b04b94e3-d7d6-4984-9cd6-9e88bf465c74">
Nov 08 17:17:11 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 17:17:11 user nova-compute[74669]:         </nova:port>
Nov 08 17:17:11 user nova-compute[74669]:       </nova:ports>
Nov 08 17:17:11 user nova-compute[74669]:     </nova:instance>
Nov 08 17:17:11 user nova-compute[74669]:   </metadata>
Nov 08 17:17:11 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:17:11 user nova-compute[74669]:     <system>
Nov 08 17:17:11 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:17:11 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:17:11 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:17:11 user nova-compute[74669]:       <entry name="serial">2980b0f6-162c-47a9-8c10-198a39f7b5db</entry>
Nov 08 17:17:11 user nova-compute[74669]:       <entry name="uuid">2980b0f6-162c-47a9-8c10-198a39f7b5db</entry>
Nov 08 17:17:11 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:17:11 user nova-compute[74669]:     </system>
Nov 08 17:17:11 user nova-compute[74669]:   </sysinfo>
Nov 08 17:17:11 user nova-compute[74669]:   <os>
Nov 08 17:17:11 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:17:11 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:17:11 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:17:11 user nova-compute[74669]:   </os>
Nov 08 17:17:11 user nova-compute[74669]:   <features>
Nov 08 17:17:11 user nova-compute[74669]:     <acpi/>
Nov 08 17:17:11 user nova-compute[74669]:     <apic/>
Nov 08 17:17:11 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:17:11 user nova-compute[74669]:   </features>
Nov 08 17:17:11 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:17:11 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:17:11 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:17:11 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:17:11 user nova-compute[74669]:   </clock>
Nov 08 17:17:11 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:17:11 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:17:11 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:17:11 user nova-compute[74669]:   </cpu>
Nov 08 17:17:11 user nova-compute[74669]:   <devices>
Nov 08 17:17:11 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:17:11 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:17:11 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk"/>
Nov 08 17:17:11 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:17:11 user nova-compute[74669]:     </disk>
Nov 08 17:17:11 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:17:11 user nova-compute[74669]:       <mac address="fa:16:3e:a4:7b:71"/>
Nov 08 17:17:11 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:17:11 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:17:11 user nova-compute[74669]:       <target dev="tapb04b94e3-d7"/>
Nov 08 17:17:11 user nova-compute[74669]:     </interface>
Nov 08 17:17:11 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:17:11 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/console.log" append="off"/>
Nov 08 17:17:11 user nova-compute[74669]:     </serial>
Nov 08 17:17:11 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:17:11 user nova-compute[74669]:     <video>
Nov 08 17:17:11 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:17:11 user nova-compute[74669]:     </video>
Nov 08 17:17:11 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:17:11 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:17:11 user nova-compute[74669]:     </rng>
Nov 08 17:17:11 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:17:11 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:17:11 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:17:11 user nova-compute[74669]:     </memballoon>
Nov 08 17:17:11 user nova-compute[74669]:   </devices>
Nov 08 17:17:11 user nova-compute[74669]: </domain>
Nov 08 17:17:11 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1443007992',display_name='tempest-VolumesSnapshotTestJSON-instance-1443007992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1443007992',id=36,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaEJJIZuosVMjTCjfdwyRNCValClguCrnQABHENXLij/AMAKyc3LVFgmsvkfBoJXahcZtnJ3nn25XZ3NJsqnuC8lq/4vHVnMD+cJyT8p3A5ojU6gz4pmmKutOJ47ND0cA==',key_name='tempest-keypair-2080375649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f7557a75c804d1da4c2d6fea8364f6d',ramdisk_id='',reservation_id='r-hvcbrufj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-600470725',owner_user_name='tempest-VolumesSnapshotTestJSON-600470725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:17:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64378f1b06c14150b824b1c29a5430fd',uuid=2980b0f6-162c-47a9-8c10-198a39f7b5db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "address": "fa:16:3e:a4:7b:71", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04b94e3-d7", "ovs_interfaceid": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Converting VIF {"id": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "address": "fa:16:3e:a4:7b:71", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04b94e3-d7", "ovs_interfaceid": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:71,bridge_name='br-int',has_traffic_filtering=True,id=b04b94e3-d7d6-4984-9cd6-9e88bf465c74,network=Network(284f544e-dabf-4ae2-b70c-f8ce15736863),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb04b94e3-d7') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG os_vif [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:71,bridge_name='br-int',has_traffic_filtering=True,id=b04b94e3-d7d6-4984-9cd6-9e88bf465c74,network=Network(284f544e-dabf-4ae2-b70c-f8ce15736863),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb04b94e3-d7') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99ba420e-fe6e-5442-ade0-8f22905b7570', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb04b94e3-d7, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb04b94e3-d7, col_values=(('qos', UUID('cf74d412-6d6a-4333-a5d4-81b2ac9bffae')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb04b94e3-d7, col_values=(('external_ids', {'iface-id': 'b04b94e3-d7d6-4984-9cd6-9e88bf465c74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:7b:71', 'vm-uuid': '2980b0f6-162c-47a9-8c10-198a39f7b5db'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:11 user nova-compute[74669]: INFO os_vif [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:71,bridge_name='br-int',has_traffic_filtering=True,id=b04b94e3-d7d6-4984-9cd6-9e88bf465c74,network=Network(284f544e-dabf-4ae2-b70c-f8ce15736863),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb04b94e3-d7')
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] No VIF found with MAC fa:16:3e:a4:7b:71, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.network.neutron [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Updating instance_info_cache with network_info: [{"id": "822d3fcd-483d-49f1-b886-a3c0b50d0c3d", "address": "fa:16:3e:10:9d:d5", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap822d3fcd-48", "ovs_interfaceid": "822d3fcd-483d-49f1-b886-a3c0b50d0c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Releasing lock "refresh_cache-291835fd-2fac-4eab-a205-5b0119cd48d0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.compute.manager [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Instance network_info: |[{"id": "822d3fcd-483d-49f1-b886-a3c0b50d0c3d", "address": "fa:16:3e:10:9d:d5", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap822d3fcd-48", "ovs_interfaceid": "822d3fcd-483d-49f1-b886-a3c0b50d0c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-72a68998-4745-4bbc-abe9-29286a89db3f req-2df17c69-f702-479c-aa69-b13821656a9b service nova] Acquired lock "refresh_cache-291835fd-2fac-4eab-a205-5b0119cd48d0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.network.neutron [req-72a68998-4745-4bbc-abe9-29286a89db3f req-2df17c69-f702-479c-aa69-b13821656a9b service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Refreshing network info cache for port 822d3fcd-483d-49f1-b886-a3c0b50d0c3d {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Start _get_guest_xml network_info=[{"id": "822d3fcd-483d-49f1-b886-a3c0b50d0c3d", "address": "fa:16:3e:10:9d:d5", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap822d3fcd-48", "ovs_interfaceid": "822d3fcd-483d-49f1-b886-a3c0b50d0c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:17:11 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:17:11 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-897754386',display_name='tempest-AttachVolumeNegativeTest-server-897754386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-897754386',id=37,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6uLZ6EB+61i2x3YdHMBDjcsuJ/zV3DKd2g1BK+AzgEY+/x6jHHsYMPO4oTZDODKf24aCSkzfy0vj1xjch7SYCmAHnU5I9vPG2TxWp0AnaAx8FoHn5J4gO0NVl3n2KwLQ==',key_name='tempest-keypair-886342158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f58f78f65e774cf78ca0c49aa11f9b54',ramdisk_id='',reservation_id='r-40plr4ii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1846694333',owner_user_name='tempest-AttachVolumeNegativeTest-1846694333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:17:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='565488b722e44809a7cff5e617daae84',uuid=291835fd-2fac-4eab-a205-5b0119cd48d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "822d3fcd-483d-49f1-b886-a3c0b50d0c3d", "address": "fa:16:3e:10:9d:d5", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap822d3fcd-48", "ovs_interfaceid": "822d3fcd-483d-49f1-b886-a3c0b50d0c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converting VIF {"id": "822d3fcd-483d-49f1-b886-a3c0b50d0c3d", "address": "fa:16:3e:10:9d:d5", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap822d3fcd-48", "ovs_interfaceid": "822d3fcd-483d-49f1-b886-a3c0b50d0c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:9d:d5,bridge_name='br-int',has_traffic_filtering=True,id=822d3fcd-483d-49f1-b886-a3c0b50d0c3d,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap822d3fcd-48') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.objects.instance [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lazy-loading 'pci_devices' on Instance uuid 291835fd-2fac-4eab-a205-5b0119cd48d0 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:17:11 user nova-compute[74669]:   <uuid>291835fd-2fac-4eab-a205-5b0119cd48d0</uuid>
Nov 08 17:17:11 user nova-compute[74669]:   <name>instance-00000025</name>
Nov 08 17:17:11 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:17:11 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:17:11 user nova-compute[74669]:   <metadata>
Nov 08 17:17:11 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:17:11 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:17:11 user nova-compute[74669]:       <nova:name>tempest-AttachVolumeNegativeTest-server-897754386</nova:name>
Nov 08 17:17:11 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:17:11</nova:creationTime>
Nov 08 17:17:11 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:17:11 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:17:11 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:17:11 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:17:11 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:17:11 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:17:11 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:17:11 user nova-compute[74669]:       <nova:owner>
Nov 08 17:17:11 user nova-compute[74669]:         <nova:user uuid="565488b722e44809a7cff5e617daae84">tempest-AttachVolumeNegativeTest-1846694333-project-member</nova:user>
Nov 08 17:17:11 user nova-compute[74669]:         <nova:project uuid="f58f78f65e774cf78ca0c49aa11f9b54">tempest-AttachVolumeNegativeTest-1846694333</nova:project>
Nov 08 17:17:11 user nova-compute[74669]:       </nova:owner>
Nov 08 17:17:11 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:17:11 user nova-compute[74669]:       <nova:ports>
Nov 08 17:17:11 user nova-compute[74669]:         <nova:port uuid="822d3fcd-483d-49f1-b886-a3c0b50d0c3d">
Nov 08 17:17:11 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 17:17:11 user nova-compute[74669]:         </nova:port>
Nov 08 17:17:11 user nova-compute[74669]:       </nova:ports>
Nov 08 17:17:11 user nova-compute[74669]:     </nova:instance>
Nov 08 17:17:11 user nova-compute[74669]:   </metadata>
Nov 08 17:17:11 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:17:11 user nova-compute[74669]:     <system>
Nov 08 17:17:11 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:17:11 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:17:11 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:17:11 user nova-compute[74669]:       <entry name="serial">291835fd-2fac-4eab-a205-5b0119cd48d0</entry>
Nov 08 17:17:11 user nova-compute[74669]:       <entry name="uuid">291835fd-2fac-4eab-a205-5b0119cd48d0</entry>
Nov 08 17:17:11 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:17:11 user nova-compute[74669]:     </system>
Nov 08 17:17:11 user nova-compute[74669]:   </sysinfo>
Nov 08 17:17:11 user nova-compute[74669]:   <os>
Nov 08 17:17:11 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:17:11 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:17:11 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:17:11 user nova-compute[74669]:   </os>
Nov 08 17:17:11 user nova-compute[74669]:   <features>
Nov 08 17:17:11 user nova-compute[74669]:     <acpi/>
Nov 08 17:17:11 user nova-compute[74669]:     <apic/>
Nov 08 17:17:11 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:17:11 user nova-compute[74669]:   </features>
Nov 08 17:17:11 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:17:11 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:17:11 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:17:11 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:17:11 user nova-compute[74669]:   </clock>
Nov 08 17:17:11 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:17:11 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:17:11 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:17:11 user nova-compute[74669]:   </cpu>
Nov 08 17:17:11 user nova-compute[74669]:   <devices>
Nov 08 17:17:11 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:17:11 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:17:11 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/disk"/>
Nov 08 17:17:11 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:17:11 user nova-compute[74669]:     </disk>
Nov 08 17:17:11 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:17:11 user nova-compute[74669]:       <mac address="fa:16:3e:10:9d:d5"/>
Nov 08 17:17:11 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:17:11 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:17:11 user nova-compute[74669]:       <target dev="tap822d3fcd-48"/>
Nov 08 17:17:11 user nova-compute[74669]:     </interface>
Nov 08 17:17:11 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:17:11 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/console.log" append="off"/>
Nov 08 17:17:11 user nova-compute[74669]:     </serial>
Nov 08 17:17:11 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:17:11 user nova-compute[74669]:     <video>
Nov 08 17:17:11 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:17:11 user nova-compute[74669]:     </video>
Nov 08 17:17:11 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:17:11 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:17:11 user nova-compute[74669]:     </rng>
Nov 08 17:17:11 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:17:11 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:17:11 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:17:11 user nova-compute[74669]:     </memballoon>
Nov 08 17:17:11 user nova-compute[74669]:   </devices>
Nov 08 17:17:11 user nova-compute[74669]: </domain>
Nov 08 17:17:11 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-897754386',display_name='tempest-AttachVolumeNegativeTest-server-897754386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-897754386',id=37,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6uLZ6EB+61i2x3YdHMBDjcsuJ/zV3DKd2g1BK+AzgEY+/x6jHHsYMPO4oTZDODKf24aCSkzfy0vj1xjch7SYCmAHnU5I9vPG2TxWp0AnaAx8FoHn5J4gO0NVl3n2KwLQ==',key_name='tempest-keypair-886342158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f58f78f65e774cf78ca0c49aa11f9b54',ramdisk_id='',reservation_id='r-40plr4ii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1846694333',owner_user_name='tempest-AttachVolumeNegativeTest-1846694333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:17:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='565488b722e44809a7cff5e617daae84',uuid=291835fd-2fac-4eab-a205-5b0119cd48d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "822d3fcd-483d-49f1-b886-a3c0b50d0c3d", "address": "fa:16:3e:10:9d:d5", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap822d3fcd-48", "ovs_interfaceid": "822d3fcd-483d-49f1-b886-a3c0b50d0c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converting VIF {"id": "822d3fcd-483d-49f1-b886-a3c0b50d0c3d", "address": "fa:16:3e:10:9d:d5", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap822d3fcd-48", "ovs_interfaceid": "822d3fcd-483d-49f1-b886-a3c0b50d0c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:9d:d5,bridge_name='br-int',has_traffic_filtering=True,id=822d3fcd-483d-49f1-b886-a3c0b50d0c3d,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap822d3fcd-48') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG os_vif [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:9d:d5,bridge_name='br-int',has_traffic_filtering=True,id=822d3fcd-483d-49f1-b886-a3c0b50d0c3d,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap822d3fcd-48') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '443669c2-d993-5555-b5e2-223c5fe843b4', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap822d3fcd-48, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap822d3fcd-48, col_values=(('qos', UUID('c4c01e36-6538-443b-8fae-936c914ee975')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap822d3fcd-48, col_values=(('external_ids', {'iface-id': '822d3fcd-483d-49f1-b886-a3c0b50d0c3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:9d:d5', 'vm-uuid': '291835fd-2fac-4eab-a205-5b0119cd48d0'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:11 user nova-compute[74669]: INFO os_vif [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:9d:d5,bridge_name='br-int',has_traffic_filtering=True,id=822d3fcd-483d-49f1-b886-a3c0b50d0c3d,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap822d3fcd-48')
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.network.neutron [req-47fce77b-80c8-4ca9-a295-2c5c947651d6 req-71fde250-ce25-466c-a427-718f796b9182 service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Updated VIF entry in instance network info cache for port b04b94e3-d7d6-4984-9cd6-9e88bf465c74. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.network.neutron [req-47fce77b-80c8-4ca9-a295-2c5c947651d6 req-71fde250-ce25-466c-a427-718f796b9182 service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Updating instance_info_cache with network_info: [{"id": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "address": "fa:16:3e:a4:7b:71", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04b94e3-d7", "ovs_interfaceid": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-47fce77b-80c8-4ca9-a295-2c5c947651d6 req-71fde250-ce25-466c-a427-718f796b9182 service nova] Releasing lock "refresh_cache-2980b0f6-162c-47a9-8c10-198a39f7b5db" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] No VIF found with MAC fa:16:3e:10:9d:d5, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.network.neutron [req-72a68998-4745-4bbc-abe9-29286a89db3f req-2df17c69-f702-479c-aa69-b13821656a9b service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Updated VIF entry in instance network info cache for port 822d3fcd-483d-49f1-b886-a3c0b50d0c3d. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG nova.network.neutron [req-72a68998-4745-4bbc-abe9-29286a89db3f req-2df17c69-f702-479c-aa69-b13821656a9b service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Updating instance_info_cache with network_info: [{"id": "822d3fcd-483d-49f1-b886-a3c0b50d0c3d", "address": "fa:16:3e:10:9d:d5", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap822d3fcd-48", "ovs_interfaceid": "822d3fcd-483d-49f1-b886-a3c0b50d0c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:17:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-72a68998-4745-4bbc-abe9-29286a89db3f req-2df17c69-f702-479c-aa69-b13821656a9b service nova] Releasing lock "refresh_cache-291835fd-2fac-4eab-a205-5b0119cd48d0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:17:12 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:17:13 user nova-compute[74669]: DEBUG nova.compute.manager [req-2f331027-5128-4c4d-9e85-1c04c36405b0 req-ea8059ab-0b60-4270-8c51-753fe73cb589 service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Received event network-changed-211a12bb-0d17-4746-b1ed-4cc9dee09c05 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:17:13 user nova-compute[74669]: DEBUG nova.compute.manager [req-2f331027-5128-4c4d-9e85-1c04c36405b0 req-ea8059ab-0b60-4270-8c51-753fe73cb589 service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Refreshing instance network info cache due to event network-changed-211a12bb-0d17-4746-b1ed-4cc9dee09c05. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:17:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2f331027-5128-4c4d-9e85-1c04c36405b0 req-ea8059ab-0b60-4270-8c51-753fe73cb589 service nova] Acquiring lock "refresh_cache-94098bcd-577b-4bf9-9e62-e21b984eb936" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:17:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2f331027-5128-4c4d-9e85-1c04c36405b0 req-ea8059ab-0b60-4270-8c51-753fe73cb589 service nova] Acquired lock "refresh_cache-94098bcd-577b-4bf9-9e62-e21b984eb936" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:17:13 user nova-compute[74669]: DEBUG nova.network.neutron [req-2f331027-5128-4c4d-9e85-1c04c36405b0 req-ea8059ab-0b60-4270-8c51-753fe73cb589 service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Refreshing network info cache for port 211a12bb-0d17-4746-b1ed-4cc9dee09c05 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:17:13 user nova-compute[74669]: DEBUG nova.network.neutron [req-2f331027-5128-4c4d-9e85-1c04c36405b0 req-ea8059ab-0b60-4270-8c51-753fe73cb589 service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Updated VIF entry in instance network info cache for port 211a12bb-0d17-4746-b1ed-4cc9dee09c05. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:17:13 user nova-compute[74669]: DEBUG nova.network.neutron [req-2f331027-5128-4c4d-9e85-1c04c36405b0 req-ea8059ab-0b60-4270-8c51-753fe73cb589 service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Updating instance_info_cache with network_info: [{"id": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "address": "fa:16:3e:46:79:c5", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211a12bb-0d", "ovs_interfaceid": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:17:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2f331027-5128-4c4d-9e85-1c04c36405b0 req-ea8059ab-0b60-4270-8c51-753fe73cb589 service nova] Releasing lock "refresh_cache-94098bcd-577b-4bf9-9e62-e21b984eb936" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:17:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:13 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:17:13 user nova-compute[74669]: DEBUG nova.compute.manager [req-4429a468-02c1-4398-a57a-639f756ad849 req-f0278e54-6e9e-4245-b846-e70d15f5099d service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Received event network-vif-plugged-b04b94e3-d7d6-4984-9cd6-9e88bf465c74 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:17:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4429a468-02c1-4398-a57a-639f756ad849 req-f0278e54-6e9e-4245-b846-e70d15f5099d service nova] Acquiring lock "2980b0f6-162c-47a9-8c10-198a39f7b5db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4429a468-02c1-4398-a57a-639f756ad849 req-f0278e54-6e9e-4245-b846-e70d15f5099d service nova] Lock "2980b0f6-162c-47a9-8c10-198a39f7b5db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4429a468-02c1-4398-a57a-639f756ad849 req-f0278e54-6e9e-4245-b846-e70d15f5099d service nova] Lock "2980b0f6-162c-47a9-8c10-198a39f7b5db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:13 user nova-compute[74669]: DEBUG nova.compute.manager [req-4429a468-02c1-4398-a57a-639f756ad849 req-f0278e54-6e9e-4245-b846-e70d15f5099d service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] No waiting events found dispatching network-vif-plugged-b04b94e3-d7d6-4984-9cd6-9e88bf465c74 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:17:13 user nova-compute[74669]: WARNING nova.compute.manager [req-4429a468-02c1-4398-a57a-639f756ad849 req-f0278e54-6e9e-4245-b846-e70d15f5099d service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Received unexpected event network-vif-plugged-b04b94e3-d7d6-4984-9cd6-9e88bf465c74 for instance with vm_state building and task_state spawning.
Nov 08 17:17:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-b9993e17-fa24-4141-8483-3c8fc764137b req-ff847436-06ef-47f8-a3c9-ee1ba9f38cdf service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Received event network-vif-plugged-b04b94e3-d7d6-4984-9cd6-9e88bf465c74 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:17:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b9993e17-fa24-4141-8483-3c8fc764137b req-ff847436-06ef-47f8-a3c9-ee1ba9f38cdf service nova] Acquiring lock "2980b0f6-162c-47a9-8c10-198a39f7b5db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b9993e17-fa24-4141-8483-3c8fc764137b req-ff847436-06ef-47f8-a3c9-ee1ba9f38cdf service nova] Lock "2980b0f6-162c-47a9-8c10-198a39f7b5db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b9993e17-fa24-4141-8483-3c8fc764137b req-ff847436-06ef-47f8-a3c9-ee1ba9f38cdf service nova] Lock "2980b0f6-162c-47a9-8c10-198a39f7b5db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-b9993e17-fa24-4141-8483-3c8fc764137b req-ff847436-06ef-47f8-a3c9-ee1ba9f38cdf service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] No waiting events found dispatching network-vif-plugged-b04b94e3-d7d6-4984-9cd6-9e88bf465c74 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:17:15 user nova-compute[74669]: WARNING nova.compute.manager [req-b9993e17-fa24-4141-8483-3c8fc764137b req-ff847436-06ef-47f8-a3c9-ee1ba9f38cdf service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Received unexpected event network-vif-plugged-b04b94e3-d7d6-4984-9cd6-9e88bf465c74 for instance with vm_state building and task_state spawning.
Nov 08 17:17:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-b9993e17-fa24-4141-8483-3c8fc764137b req-ff847436-06ef-47f8-a3c9-ee1ba9f38cdf service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Received event network-vif-plugged-822d3fcd-483d-49f1-b886-a3c0b50d0c3d {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:17:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b9993e17-fa24-4141-8483-3c8fc764137b req-ff847436-06ef-47f8-a3c9-ee1ba9f38cdf service nova] Acquiring lock "291835fd-2fac-4eab-a205-5b0119cd48d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b9993e17-fa24-4141-8483-3c8fc764137b req-ff847436-06ef-47f8-a3c9-ee1ba9f38cdf service nova] Lock "291835fd-2fac-4eab-a205-5b0119cd48d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b9993e17-fa24-4141-8483-3c8fc764137b req-ff847436-06ef-47f8-a3c9-ee1ba9f38cdf service nova] Lock "291835fd-2fac-4eab-a205-5b0119cd48d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-b9993e17-fa24-4141-8483-3c8fc764137b req-ff847436-06ef-47f8-a3c9-ee1ba9f38cdf service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] No waiting events found dispatching network-vif-plugged-822d3fcd-483d-49f1-b886-a3c0b50d0c3d {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:17:15 user nova-compute[74669]: WARNING nova.compute.manager [req-b9993e17-fa24-4141-8483-3c8fc764137b req-ff847436-06ef-47f8-a3c9-ee1ba9f38cdf service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Received unexpected event network-vif-plugged-822d3fcd-483d-49f1-b886-a3c0b50d0c3d for instance with vm_state building and task_state spawning.
Nov 08 17:17:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-b9993e17-fa24-4141-8483-3c8fc764137b req-ff847436-06ef-47f8-a3c9-ee1ba9f38cdf service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Received event network-vif-plugged-822d3fcd-483d-49f1-b886-a3c0b50d0c3d {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:17:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b9993e17-fa24-4141-8483-3c8fc764137b req-ff847436-06ef-47f8-a3c9-ee1ba9f38cdf service nova] Acquiring lock "291835fd-2fac-4eab-a205-5b0119cd48d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b9993e17-fa24-4141-8483-3c8fc764137b req-ff847436-06ef-47f8-a3c9-ee1ba9f38cdf service nova] Lock "291835fd-2fac-4eab-a205-5b0119cd48d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b9993e17-fa24-4141-8483-3c8fc764137b req-ff847436-06ef-47f8-a3c9-ee1ba9f38cdf service nova] Lock "291835fd-2fac-4eab-a205-5b0119cd48d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-b9993e17-fa24-4141-8483-3c8fc764137b req-ff847436-06ef-47f8-a3c9-ee1ba9f38cdf service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] No waiting events found dispatching network-vif-plugged-822d3fcd-483d-49f1-b886-a3c0b50d0c3d {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:17:15 user nova-compute[74669]: WARNING nova.compute.manager [req-b9993e17-fa24-4141-8483-3c8fc764137b req-ff847436-06ef-47f8-a3c9-ee1ba9f38cdf service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Received unexpected event network-vif-plugged-822d3fcd-483d-49f1-b886-a3c0b50d0c3d for instance with vm_state building and task_state spawning.
Nov 08 17:17:16 user nova-compute[74669]: DEBUG nova.compute.manager [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:17:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:17:16 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Instance spawned successfully.
Nov 08 17:17:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:17:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:17:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:17:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:17:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:17:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:17:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:17:16 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:17:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:17:16 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Instance spawned successfully.
Nov 08 17:17:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:17:16 user nova-compute[74669]: INFO nova.compute.manager [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Took 6.52 seconds to spawn the instance on the hypervisor.
Nov 08 17:17:16 user nova-compute[74669]: DEBUG nova.compute.manager [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:17:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:17:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:17:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:17:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:17:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:17:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:17:16 user nova-compute[74669]: INFO nova.compute.manager [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Took 7.53 seconds to build instance.
Nov 08 17:17:16 user nova-compute[74669]: INFO nova.compute.manager [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Took 7.04 seconds to spawn the instance on the hypervisor.
Nov 08 17:17:16 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:17:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-6d4d6675-1ba6-428d-8ceb-308009a56946 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "291835fd-2fac-4eab-a205-5b0119cd48d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.651s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:16 user nova-compute[74669]: INFO nova.compute.manager [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Took 8.05 seconds to build instance.
Nov 08 17:17:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e68b0bbe-cef0-4c77-a47b-6c6abb6f38a8 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "2980b0f6-162c-47a9-8c10-198a39f7b5db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.268s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:17 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:17:17 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 17:17:17 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] There are 0 instances to clean {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 17:17:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "94098bcd-577b-4bf9-9e62-e21b984eb936" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG nova.objects.instance [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'flavor' on Instance uuid 94098bcd-577b-4bf9-9e62-e21b984eb936 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "94098bcd-577b-4bf9-9e62-e21b984eb936" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:26 user nova-compute[74669]: INFO nova.compute.manager [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Attaching volume d7ba4f3d-b017-49e5-9f5c-aac86ffd906c to /dev/vdb
Nov 08 17:17:26 user nova-compute[74669]: DEBUG os_brick.utils [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e1f16f-0d67-4438-8bb0-d469a993d5b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92d23b8-b042-42ce-9c97-177cb9dad4d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bfc012-d811-450f-91a0-cd3c93da3bc8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[97be9992-7c4a-4d75-9678-3b3aff74712c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:17:26 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:17:26 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[093c8901-b95e-40c3-953c-d62f6995a21b]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG os_brick.utils [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:17:26 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Updating existing volume attachment record: bdc1c44b-b305-4a56-a71e-27c268291767 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:17:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:31 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "7b335462-0d93-4899-a223-5c2e36932578" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "7b335462-0d93-4899-a223-5c2e36932578" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "7b335462-0d93-4899-a223-5c2e36932578-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "7b335462-0d93-4899-a223-5c2e36932578-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "7b335462-0d93-4899-a223-5c2e36932578-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:34 user nova-compute[74669]: INFO nova.compute.manager [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Terminating instance
Nov 08 17:17:34 user nova-compute[74669]: DEBUG nova.compute.manager [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:17:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-7eb2dff5-56b4-456c-b5b1-ed9df124c3a5 req-7e42654b-baf7-4ff0-9b52-675c5823ddb4 service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Received event network-vif-unplugged-9bfc353f-1fb9-412e-80c7-64b5a2ecc32c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:17:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-7eb2dff5-56b4-456c-b5b1-ed9df124c3a5 req-7e42654b-baf7-4ff0-9b52-675c5823ddb4 service nova] Acquiring lock "7b335462-0d93-4899-a223-5c2e36932578-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-7eb2dff5-56b4-456c-b5b1-ed9df124c3a5 req-7e42654b-baf7-4ff0-9b52-675c5823ddb4 service nova] Lock "7b335462-0d93-4899-a223-5c2e36932578-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-7eb2dff5-56b4-456c-b5b1-ed9df124c3a5 req-7e42654b-baf7-4ff0-9b52-675c5823ddb4 service nova] Lock "7b335462-0d93-4899-a223-5c2e36932578-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-7eb2dff5-56b4-456c-b5b1-ed9df124c3a5 req-7e42654b-baf7-4ff0-9b52-675c5823ddb4 service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] No waiting events found dispatching network-vif-unplugged-9bfc353f-1fb9-412e-80c7-64b5a2ecc32c {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:17:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-7eb2dff5-56b4-456c-b5b1-ed9df124c3a5 req-7e42654b-baf7-4ff0-9b52-675c5823ddb4 service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Received event network-vif-unplugged-9bfc353f-1fb9-412e-80c7-64b5a2ecc32c for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:17:35 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Instance destroyed successfully.
Nov 08 17:17:35 user nova-compute[74669]: DEBUG nova.objects.instance [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lazy-loading 'resources' on Instance uuid 7b335462-0d93-4899-a223-5c2e36932578 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:17:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T16:58:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1362223684',display_name='tempest-ServerActionsTestOtherA-server-1362223684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1362223684',id=15,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVa16AMO6wxCfNzgZtwDGNOHyvTHwI2kbeRR1JWZMRp/+84NydbzrImNzwJFwUc5Mt6eRV8qh3XhhGBx3qjvshZcC9T6FOe5uxOhgTpdbBqJBGj5+jnhuvk7Bsl6Ed/tQ==',key_name='tempest-keypair-2114035891',keypairs=<?>,launch_index=0,launched_at=2023-11-08T16:58:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='766b82c0c2cd480f96d155adf4f6de4c',ramdisk_id='',reservation_id='r-chwzzwj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-23582724',owner_user_name='tempest-ServerActionsTestOtherA-23582724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T16:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e118c178ece2492bb2d975643c405196',uuid=7b335462-0d93-4899-a223-5c2e36932578,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "address": "fa:16:3e:e6:99:99", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bfc353f-1f", "ovs_interfaceid": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:17:35 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converting VIF {"id": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "address": "fa:16:3e:e6:99:99", "network": {"id": "38ecdd6c-08e5-458b-8a3c-227636594b68", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2050130925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766b82c0c2cd480f96d155adf4f6de4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9bfc353f-1f", "ovs_interfaceid": "9bfc353f-1fb9-412e-80c7-64b5a2ecc32c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:17:35 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:99:99,bridge_name='br-int',has_traffic_filtering=True,id=9bfc353f-1fb9-412e-80c7-64b5a2ecc32c,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bfc353f-1f') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:17:35 user nova-compute[74669]: DEBUG os_vif [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:99:99,bridge_name='br-int',has_traffic_filtering=True,id=9bfc353f-1fb9-412e-80c7-64b5a2ecc32c,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bfc353f-1f') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:17:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9bfc353f-1f, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:17:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:17:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0ac1d51-ec39-4cd4-9a5d-a26a652764af) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:17:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:35 user nova-compute[74669]: INFO os_vif [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:99:99,bridge_name='br-int',has_traffic_filtering=True,id=9bfc353f-1fb9-412e-80c7-64b5a2ecc32c,network=Network(38ecdd6c-08e5-458b-8a3c-227636594b68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9bfc353f-1f')
Nov 08 17:17:35 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Deleting instance files /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578_del
Nov 08 17:17:35 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Deletion of /opt/stack/data/nova/instances/7b335462-0d93-4899-a223-5c2e36932578_del complete
Nov 08 17:17:35 user nova-compute[74669]: INFO nova.compute.manager [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 08 17:17:35 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:17:35 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:17:35 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 7b335462-0d93-4899-a223-5c2e36932578] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:17:36 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:17:36 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Took 0.79 seconds to deallocate network for instance.
Nov 08 17:17:36 user nova-compute[74669]: DEBUG nova.compute.manager [req-7f469bd1-cf5f-4240-aa3d-25a174604422 req-72540a01-600b-4670-919d-dab57731a928 service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Received event network-vif-deleted-9bfc353f-1fb9-412e-80c7-64b5a2ecc32c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:17:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:36 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:17:36 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:17:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:17:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:36 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Deleted allocations for instance 7b335462-0d93-4899-a223-5c2e36932578
Nov 08 17:17:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-32cbbb26-e55e-4c43-9531-a9b00e8ba344 tempest-ServerActionsTestOtherA-23582724 tempest-ServerActionsTestOtherA-23582724-project-member] Lock "7b335462-0d93-4899-a223-5c2e36932578" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.257s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:36 user nova-compute[74669]: DEBUG nova.compute.manager [req-2c4e1281-efbb-4fb5-9388-4cde2a1bd8de req-54ac842a-387e-4772-a21e-b334e93c9291 service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Received event network-vif-plugged-9bfc353f-1fb9-412e-80c7-64b5a2ecc32c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:17:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2c4e1281-efbb-4fb5-9388-4cde2a1bd8de req-54ac842a-387e-4772-a21e-b334e93c9291 service nova] Acquiring lock "7b335462-0d93-4899-a223-5c2e36932578-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2c4e1281-efbb-4fb5-9388-4cde2a1bd8de req-54ac842a-387e-4772-a21e-b334e93c9291 service nova] Lock "7b335462-0d93-4899-a223-5c2e36932578-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2c4e1281-efbb-4fb5-9388-4cde2a1bd8de req-54ac842a-387e-4772-a21e-b334e93c9291 service nova] Lock "7b335462-0d93-4899-a223-5c2e36932578-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:36 user nova-compute[74669]: DEBUG nova.compute.manager [req-2c4e1281-efbb-4fb5-9388-4cde2a1bd8de req-54ac842a-387e-4772-a21e-b334e93c9291 service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] No waiting events found dispatching network-vif-plugged-9bfc353f-1fb9-412e-80c7-64b5a2ecc32c {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:17:36 user nova-compute[74669]: WARNING nova.compute.manager [req-2c4e1281-efbb-4fb5-9388-4cde2a1bd8de req-54ac842a-387e-4772-a21e-b334e93c9291 service nova] [instance: 7b335462-0d93-4899-a223-5c2e36932578] Received unexpected event network-vif-plugged-9bfc353f-1fb9-412e-80c7-64b5a2ecc32c for instance with vm_state deleted and task_state None.
Nov 08 17:17:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:17:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:17:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:17:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:17:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:17:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid 2158a7c2-2f46-4bce-8558-4347a48623d5 {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid 94098bcd-577b-4bf9-9e62-e21b984eb936 {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid 2980b0f6-162c-47a9-8c10-198a39f7b5db {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid 291835fd-2fac-4eab-a205-5b0119cd48d0 {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "2158a7c2-2f46-4bce-8558-4347a48623d5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "2158a7c2-2f46-4bce-8558-4347a48623d5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "94098bcd-577b-4bf9-9e62-e21b984eb936" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "2980b0f6-162c-47a9-8c10-198a39f7b5db" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "2980b0f6-162c-47a9-8c10-198a39f7b5db" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "291835fd-2fac-4eab-a205-5b0119cd48d0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "291835fd-2fac-4eab-a205-5b0119cd48d0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "2980b0f6-162c-47a9-8c10-198a39f7b5db" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "291835fd-2fac-4eab-a205-5b0119cd48d0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "2158a7c2-2f46-4bce-8558-4347a48623d5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXShmubQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:17:58 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:17:58 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:17:58 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc11c00e-dc83-4bc0-8b60-ee585342fb5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:17:58 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[64969559-1950-4199-91d1-e1506ee7b638]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c] added
Nov 08 17:17:58 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4582d959-9475-4781-80f3-d5a743bd1387]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29d3d66-6947-4ceb-86ba-f813a1129bc5]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WXShmubQ {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WXShmubQ" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[137d5746-2bee-4b13-a91b-ab6da1695876]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WXShmubQ'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3de435-cf4b-4e7c-ba86-033a696edffe]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc284708-8d94-4f11-99c5-d8f2a91ea530]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 17:17:58 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 17:17:58 user nova-compute[74669]:  {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:17:58 user nova-compute[74669]: WARNING os_brick.initiator.connectors.iscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 17:17:58 user nova-compute[74669]: 
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e191ba-36c9-4389-b886-0d6b2cf0a267]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c, portal: 172.16.0.220,3260]
Nov 08 17:17:58 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c, portal: 172.16.0.220,3260] successful.
Nov 08 17:17:58 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f32f22a-88fa-4964-94eb-9604c4fd5c69]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[306dbc4d-ff31-4ec5-91e4-e270710f88a6]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c (non-flash)
Nov 08 17:17:58 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c (non-flash)
Nov 08 17:17:58 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd006cad-1ac9-4eaa-a4e2-2fcedce59536]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:17:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXShmubQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:17:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:17:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26135323132343838', 'path': '/dev/sdb'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:17:59 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135323132343838', 'path': '/dev/sdb'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:18:00 user nova-compute[74669]: DEBUG nova.objects.instance [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'flavor' on Instance uuid 94098bcd-577b-4bf9-9e62-e21b984eb936 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:18:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 17:18:00 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:18:00 user nova-compute[74669]:   <source dev="/dev/sdb"/>
Nov 08 17:18:00 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:18:00 user nova-compute[74669]:   <serial>d7ba4f3d-b017-49e5-9f5c-aac86ffd906c</serial>
Nov 08 17:18:00 user nova-compute[74669]: </disk>
Nov 08 17:18:00 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 17:18:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:18:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:18:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] No VIF found with MAC fa:16:3e:46:79:c5, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:18:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5358ae4b-139f-46ac-8de9-8e2df242411c tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.264s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:18:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.616s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:18:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:18:01 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:18:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:05 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:18:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "94098bcd-577b-4bf9-9e62-e21b984eb936" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:18:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:18:06 user nova-compute[74669]: DEBUG nova.objects.instance [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'flavor' on Instance uuid 94098bcd-577b-4bf9-9e62-e21b984eb936 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:18:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:18:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "94098bcd-577b-4bf9-9e62-e21b984eb936" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:18:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:18:06 user nova-compute[74669]: INFO nova.compute.manager [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Attaching volume bfd017fd-0833-47f9-ae48-3c60718de161 to /dev/vdc
Nov 08 17:18:06 user nova-compute[74669]: DEBUG os_brick.utils [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:18:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:06 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb367de-f9eb-4069-a3d4-adf298479b2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:06 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ced5e1-ae21-49db-81d6-7d57025d266f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:06 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a27973-fc3d-4cb4-b268-69948cd77b4b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:06 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afd29f5-45b7-4fe8-9288-b950f63d747e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:18:07 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:18:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:18:07 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:18:07 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[924a254f-e9cd-4d4b-9296-4f515e439b78]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:07 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:18:07 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:18:07 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:18:07 user nova-compute[74669]: DEBUG os_brick.utils [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:18:07 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Updating existing volume attachment record: 0504a5c3-456c-484a-9a5b-e2033548dff4 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:18:07 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:18:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:18:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:18:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:18:07 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:18:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:18:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:09 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:18:09 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:18:09 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8381MB free_disk=25.305042266845703GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:18:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:18:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:18:09 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2158a7c2-2f46-4bce-8558-4347a48623d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:18:09 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 94098bcd-577b-4bf9-9e62-e21b984eb936 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:18:09 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2980b0f6-162c-47a9-8c10-198a39f7b5db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:18:09 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 291835fd-2fac-4eab-a205-5b0119cd48d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:18:09 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:18:09 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:18:10 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:18:10 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:18:10 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:18:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:18:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:11 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:18:11 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:18:11 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 17:18:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-2158a7c2-2f46-4bce-8558-4347a48623d5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:18:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-2158a7c2-2f46-4bce-8558-4347a48623d5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:18:11 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:18:11 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lazy-loading 'info_cache' on Instance uuid 2158a7c2-2f46-4bce-8558-4347a48623d5 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:18:11 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Updating instance_info_cache with network_info: [{"id": "ea40d3d9-25df-410d-b2ff-46a980702022", "address": "fa:16:3e:76:cd:a9", "network": {"id": "52bf51f6-cf7e-403b-b601-0660b9c8544f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-17276515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1a781163a345dc8be717e3e7c73788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea40d3d9-25", "ovs_interfaceid": "ea40d3d9-25df-410d-b2ff-46a980702022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:18:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-2158a7c2-2f46-4bce-8558-4347a48623d5" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:18:11 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:18:11 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:18:11 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:18:11 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:18:11 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:18:11 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:18:14 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:18:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:18:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:18:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:18:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cLKeishJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:18:29 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:18:29 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:18:29 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8ab14c-fcf3-4dd5-b535-ab4e72334de0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:18:29 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af437a1-4154-4a64-9393-b30fcd43b2e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161] added
Nov 08 17:18:29 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d6d361-77db-4efc-80f6-f6575301b82e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b36d26-5d4c-4acc-98a3-9478dd425fe4]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cLKeishJ {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cLKeishJ" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0b88e5-1cc2-4068-a7dc-960b1fe853b2]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cLKeishJ'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[87364099-58aa-43e8-b2f1-9559cdc25b9e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf75c125-e147-4861-8c27-d286e48cc809]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c (non-flash)
Nov 08 17:18:29 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c (non-flash)
Nov 08 17:18:29 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eafcd7e-ac4a-44c8-9b22-093f9c579e11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161, portal: 172.16.0.220,3260]
Nov 08 17:18:29 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161, portal: 172.16.0.220,3260] successful.
Nov 08 17:18:29 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[262f642c-17ec-4df1-b4b7-2f58764b5a18]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce0ad1e-933e-4906-be55-a0663441f636]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c (non-flash)
Nov 08 17:18:29 user nova-compute[74669]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 (non-flash)
Nov 08 17:18:29 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c (non-flash)
Nov 08 17:18:29 user nova-compute[74669]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 (non-flash)
Nov 08 17:18:29 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e736ae46-527a-4837-897e-37354a50664b]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:18:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cLKeishJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:18:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:18:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26139343861313863', 'path': '/dev/sdc'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:18:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139343861313863', 'path': '/dev/sdc'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:18:30 user nova-compute[74669]: DEBUG nova.objects.instance [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'flavor' on Instance uuid 94098bcd-577b-4bf9-9e62-e21b984eb936 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:18:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 17:18:30 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:18:30 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 17:18:30 user nova-compute[74669]:   <target dev="vdc" bus="virtio"/>
Nov 08 17:18:30 user nova-compute[74669]:   <serial>bfd017fd-0833-47f9-ae48-3c60718de161</serial>
Nov 08 17:18:30 user nova-compute[74669]: </disk>
Nov 08 17:18:30 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 17:18:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:18:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:18:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:18:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] No VIF found with MAC fa:16:3e:46:79:c5, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:18:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-bb101d91-7ff4-4759-ad7e-8f98091af6e7 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.067s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:18:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "94098bcd-577b-4bf9-9e62-e21b984eb936" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:18:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:18:32 user nova-compute[74669]: INFO nova.compute.manager [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Detaching volume d7ba4f3d-b017-49e5-9f5c-aac86ffd906c
Nov 08 17:18:32 user nova-compute[74669]: INFO nova.virt.block_device [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Attempting to driver detach volume d7ba4f3d-b017-49e5-9f5c-aac86ffd906c from mountpoint /dev/vdb
Nov 08 17:18:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Attempting to detach device vdb from instance 94098bcd-577b-4bf9-9e62-e21b984eb936 from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 17:18:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:18:32 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:18:32 user nova-compute[74669]:   <source dev="/dev/sdb"/>
Nov 08 17:18:32 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:18:32 user nova-compute[74669]:   <serial>d7ba4f3d-b017-49e5-9f5c-aac86ffd906c</serial>
Nov 08 17:18:32 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:18:32 user nova-compute[74669]: </disk>
Nov 08 17:18:32 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:18:32 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Successfully detached device vdb from instance 94098bcd-577b-4bf9-9e62-e21b984eb936 from the persistent domain config.
Nov 08 17:18:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 94098bcd-577b-4bf9-9e62-e21b984eb936 from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 17:18:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:18:32 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:18:32 user nova-compute[74669]:   <source dev="/dev/sdb"/>
Nov 08 17:18:32 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:18:32 user nova-compute[74669]:   <serial>d7ba4f3d-b017-49e5-9f5c-aac86ffd906c</serial>
Nov 08 17:18:32 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:18:32 user nova-compute[74669]: </disk>
Nov 08 17:18:32 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:18:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 94098bcd-577b-4bf9-9e62-e21b984eb936 {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 17:18:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "0796133c-71d6-4d64-94af-49028a6603ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:18:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "0796133c-71d6-4d64-94af-49028a6603ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:18:36 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:18:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:18:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:18:36 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:18:36 user nova-compute[74669]: INFO nova.compute.claims [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Claim successful on node user
Nov 08 17:18:36 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:18:36 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:18:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:18:36 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:18:36 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:18:36 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:18:36 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:18:36 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:18:36 user nova-compute[74669]: DEBUG nova.policy [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1fcd1d4cf714f62aa8648b27a04c04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08551815597744d89e3a61d190a9b8a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:18:36 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:18:36 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:18:36 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Creating image(s)
Nov 08 17:18:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "/opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:18:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "/opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:18:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "/opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:18:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.188s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:18:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:18:36 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.183s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Successfully created port: 1fa691c0-3473-4f34-a504-3778913558ab {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk 1073741824" returned: 0 in 0.071s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.179s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Cannot resize image /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Ensure instance console log exists: /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Successfully updated port: 1fa691c0-3473-4f34-a504-3778913558ab {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG nova.compute.manager [req-656e944d-75e0-4c7a-b70e-23d00798bc09 req-99796efe-b13a-461b-ae05-f6841869bb96 service nova] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Received event network-changed-1fa691c0-3473-4f34-a504-3778913558ab {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG nova.compute.manager [req-656e944d-75e0-4c7a-b70e-23d00798bc09 req-99796efe-b13a-461b-ae05-f6841869bb96 service nova] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Refreshing instance network info cache due to event network-changed-1fa691c0-3473-4f34-a504-3778913558ab. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-656e944d-75e0-4c7a-b70e-23d00798bc09 req-99796efe-b13a-461b-ae05-f6841869bb96 service nova] Acquiring lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-656e944d-75e0-4c7a-b70e-23d00798bc09 req-99796efe-b13a-461b-ae05-f6841869bb96 service nova] Acquired lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG nova.network.neutron [req-656e944d-75e0-4c7a-b70e-23d00798bc09 req-99796efe-b13a-461b-ae05-f6841869bb96 service nova] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Refreshing network info cache for port 1fa691c0-3473-4f34-a504-3778913558ab {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:18:37 user nova-compute[74669]: DEBUG nova.network.neutron [req-656e944d-75e0-4c7a-b70e-23d00798bc09 req-99796efe-b13a-461b-ae05-f6841869bb96 service nova] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.network.neutron [req-656e944d-75e0-4c7a-b70e-23d00798bc09 req-99796efe-b13a-461b-ae05-f6841869bb96 service nova] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-656e944d-75e0-4c7a-b70e-23d00798bc09 req-99796efe-b13a-461b-ae05-f6841869bb96 service nova] Releasing lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquired lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Updating instance_info_cache with network_info: [{"id": "1fa691c0-3473-4f34-a504-3778913558ab", "address": "fa:16:3e:2f:15:d7", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa691c0-34", "ovs_interfaceid": "1fa691c0-3473-4f34-a504-3778913558ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Releasing lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Instance network_info: |[{"id": "1fa691c0-3473-4f34-a504-3778913558ab", "address": "fa:16:3e:2f:15:d7", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa691c0-34", "ovs_interfaceid": "1fa691c0-3473-4f34-a504-3778913558ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Start _get_guest_xml network_info=[{"id": "1fa691c0-3473-4f34-a504-3778913558ab", "address": "fa:16:3e:2f:15:d7", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa691c0-34", "ovs_interfaceid": "1fa691c0-3473-4f34-a504-3778913558ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:18:38 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:18:38 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:18:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-191094582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-191094582',id=38,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08551815597744d89e3a61d190a9b8a7',ramdisk_id='',reservation_id='r-tjh2dw3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293450045',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:18:37Z,user_data=None,user_id='b1fcd1d4cf714f62aa8648b27a04c04e',uuid=0796133c-71d6-4d64-94af-49028a6603ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fa691c0-3473-4f34-a504-3778913558ab", "address": "fa:16:3e:2f:15:d7", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa691c0-34", "ovs_interfaceid": "1fa691c0-3473-4f34-a504-3778913558ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converting VIF {"id": "1fa691c0-3473-4f34-a504-3778913558ab", "address": "fa:16:3e:2f:15:d7", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa691c0-34", "ovs_interfaceid": "1fa691c0-3473-4f34-a504-3778913558ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:15:d7,bridge_name='br-int',has_traffic_filtering=True,id=1fa691c0-3473-4f34-a504-3778913558ab,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fa691c0-34') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.objects.instance [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lazy-loading 'pci_devices' on Instance uuid 0796133c-71d6-4d64-94af-49028a6603ea {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:18:38 user nova-compute[74669]:   <uuid>0796133c-71d6-4d64-94af-49028a6603ea</uuid>
Nov 08 17:18:38 user nova-compute[74669]:   <name>instance-00000026</name>
Nov 08 17:18:38 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:18:38 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:18:38 user nova-compute[74669]:   <metadata>
Nov 08 17:18:38 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:18:38 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:18:38 user nova-compute[74669]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-191094582</nova:name>
Nov 08 17:18:38 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:18:38</nova:creationTime>
Nov 08 17:18:38 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:18:38 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:18:38 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:18:38 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:18:38 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:18:38 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:18:38 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:18:38 user nova-compute[74669]:       <nova:owner>
Nov 08 17:18:38 user nova-compute[74669]:         <nova:user uuid="b1fcd1d4cf714f62aa8648b27a04c04e">tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member</nova:user>
Nov 08 17:18:38 user nova-compute[74669]:         <nova:project uuid="08551815597744d89e3a61d190a9b8a7">tempest-ServerBootFromVolumeStableRescueTest-293450045</nova:project>
Nov 08 17:18:38 user nova-compute[74669]:       </nova:owner>
Nov 08 17:18:38 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:18:38 user nova-compute[74669]:       <nova:ports>
Nov 08 17:18:38 user nova-compute[74669]:         <nova:port uuid="1fa691c0-3473-4f34-a504-3778913558ab">
Nov 08 17:18:38 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 17:18:38 user nova-compute[74669]:         </nova:port>
Nov 08 17:18:38 user nova-compute[74669]:       </nova:ports>
Nov 08 17:18:38 user nova-compute[74669]:     </nova:instance>
Nov 08 17:18:38 user nova-compute[74669]:   </metadata>
Nov 08 17:18:38 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:18:38 user nova-compute[74669]:     <system>
Nov 08 17:18:38 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:18:38 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:18:38 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:18:38 user nova-compute[74669]:       <entry name="serial">0796133c-71d6-4d64-94af-49028a6603ea</entry>
Nov 08 17:18:38 user nova-compute[74669]:       <entry name="uuid">0796133c-71d6-4d64-94af-49028a6603ea</entry>
Nov 08 17:18:38 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:18:38 user nova-compute[74669]:     </system>
Nov 08 17:18:38 user nova-compute[74669]:   </sysinfo>
Nov 08 17:18:38 user nova-compute[74669]:   <os>
Nov 08 17:18:38 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:18:38 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:18:38 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:18:38 user nova-compute[74669]:   </os>
Nov 08 17:18:38 user nova-compute[74669]:   <features>
Nov 08 17:18:38 user nova-compute[74669]:     <acpi/>
Nov 08 17:18:38 user nova-compute[74669]:     <apic/>
Nov 08 17:18:38 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:18:38 user nova-compute[74669]:   </features>
Nov 08 17:18:38 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:18:38 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:18:38 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:18:38 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:18:38 user nova-compute[74669]:   </clock>
Nov 08 17:18:38 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:18:38 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:18:38 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:18:38 user nova-compute[74669]:   </cpu>
Nov 08 17:18:38 user nova-compute[74669]:   <devices>
Nov 08 17:18:38 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:18:38 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:18:38 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk"/>
Nov 08 17:18:38 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:18:38 user nova-compute[74669]:     </disk>
Nov 08 17:18:38 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:18:38 user nova-compute[74669]:       <mac address="fa:16:3e:2f:15:d7"/>
Nov 08 17:18:38 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:18:38 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:18:38 user nova-compute[74669]:       <target dev="tap1fa691c0-34"/>
Nov 08 17:18:38 user nova-compute[74669]:     </interface>
Nov 08 17:18:38 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:18:38 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/console.log" append="off"/>
Nov 08 17:18:38 user nova-compute[74669]:     </serial>
Nov 08 17:18:38 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:18:38 user nova-compute[74669]:     <video>
Nov 08 17:18:38 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:18:38 user nova-compute[74669]:     </video>
Nov 08 17:18:38 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:18:38 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:18:38 user nova-compute[74669]:     </rng>
Nov 08 17:18:38 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:18:38 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:18:38 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:18:38 user nova-compute[74669]:     </memballoon>
Nov 08 17:18:38 user nova-compute[74669]:   </devices>
Nov 08 17:18:38 user nova-compute[74669]: </domain>
Nov 08 17:18:38 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:18:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-191094582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-191094582',id=38,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08551815597744d89e3a61d190a9b8a7',ramdisk_id='',reservation_id='r-tjh2dw3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293450045',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:18:37Z,user_data=None,user_id='b1fcd1d4cf714f62aa8648b27a04c04e',uuid=0796133c-71d6-4d64-94af-49028a6603ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fa691c0-3473-4f34-a504-3778913558ab", "address": "fa:16:3e:2f:15:d7", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa691c0-34", "ovs_interfaceid": "1fa691c0-3473-4f34-a504-3778913558ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converting VIF {"id": "1fa691c0-3473-4f34-a504-3778913558ab", "address": "fa:16:3e:2f:15:d7", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa691c0-34", "ovs_interfaceid": "1fa691c0-3473-4f34-a504-3778913558ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:15:d7,bridge_name='br-int',has_traffic_filtering=True,id=1fa691c0-3473-4f34-a504-3778913558ab,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fa691c0-34') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG os_vif [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:15:d7,bridge_name='br-int',has_traffic_filtering=True,id=1fa691c0-3473-4f34-a504-3778913558ab,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fa691c0-34') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1e9d0aa-dd6b-5903-992c-d47f0729fd60', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1fa691c0-34, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1fa691c0-34, col_values=(('qos', UUID('197b515e-3848-4774-b1a1-efc85721f353')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1fa691c0-34, col_values=(('external_ids', {'iface-id': '1fa691c0-3473-4f34-a504-3778913558ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:15:d7', 'vm-uuid': '0796133c-71d6-4d64-94af-49028a6603ea'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:38 user nova-compute[74669]: INFO os_vif [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:15:d7,bridge_name='br-int',has_traffic_filtering=True,id=1fa691c0-3473-4f34-a504-3778913558ab,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fa691c0-34')
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:18:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] No VIF found with MAC fa:16:3e:2f:15:d7, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:18:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-3ed6857f-f88e-4b42-a0c9-6a631ec4e45c req-2052ec45-7d99-4b7a-8b8b-9f261a231841 service nova] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Received event network-vif-plugged-1fa691c0-3473-4f34-a504-3778913558ab {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:18:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3ed6857f-f88e-4b42-a0c9-6a631ec4e45c req-2052ec45-7d99-4b7a-8b8b-9f261a231841 service nova] Acquiring lock "0796133c-71d6-4d64-94af-49028a6603ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:18:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3ed6857f-f88e-4b42-a0c9-6a631ec4e45c req-2052ec45-7d99-4b7a-8b8b-9f261a231841 service nova] Lock "0796133c-71d6-4d64-94af-49028a6603ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:18:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3ed6857f-f88e-4b42-a0c9-6a631ec4e45c req-2052ec45-7d99-4b7a-8b8b-9f261a231841 service nova] Lock "0796133c-71d6-4d64-94af-49028a6603ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:18:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-3ed6857f-f88e-4b42-a0c9-6a631ec4e45c req-2052ec45-7d99-4b7a-8b8b-9f261a231841 service nova] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] No waiting events found dispatching network-vif-plugged-1fa691c0-3473-4f34-a504-3778913558ab {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:18:40 user nova-compute[74669]: WARNING nova.compute.manager [req-3ed6857f-f88e-4b42-a0c9-6a631ec4e45c req-2052ec45-7d99-4b7a-8b8b-9f261a231841 service nova] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Received unexpected event network-vif-plugged-1fa691c0-3473-4f34-a504-3778913558ab for instance with vm_state building and task_state spawning.
Nov 08 17:18:42 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:18:42 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:18:42 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Instance spawned successfully.
Nov 08 17:18:42 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:18:42 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:18:42 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:18:42 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:18:42 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:18:42 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:18:42 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:18:42 user nova-compute[74669]: INFO nova.compute.manager [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 08 17:18:42 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:18:42 user nova-compute[74669]: INFO nova.compute.manager [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Took 5.99 seconds to build instance.
Nov 08 17:18:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a42998ed-d21c-4ee0-bfdf-2194b0a64591 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "0796133c-71d6-4d64-94af-49028a6603ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.129s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:18:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-c62c1b64-bb09-4dbf-a429-ee02ce97ae82 req-149f08bf-fc30-452b-8aa6-be02de8bed5e service nova] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Received event network-vif-plugged-1fa691c0-3473-4f34-a504-3778913558ab {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:18:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c62c1b64-bb09-4dbf-a429-ee02ce97ae82 req-149f08bf-fc30-452b-8aa6-be02de8bed5e service nova] Acquiring lock "0796133c-71d6-4d64-94af-49028a6603ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:18:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c62c1b64-bb09-4dbf-a429-ee02ce97ae82 req-149f08bf-fc30-452b-8aa6-be02de8bed5e service nova] Lock "0796133c-71d6-4d64-94af-49028a6603ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:18:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c62c1b64-bb09-4dbf-a429-ee02ce97ae82 req-149f08bf-fc30-452b-8aa6-be02de8bed5e service nova] Lock "0796133c-71d6-4d64-94af-49028a6603ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:18:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-c62c1b64-bb09-4dbf-a429-ee02ce97ae82 req-149f08bf-fc30-452b-8aa6-be02de8bed5e service nova] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] No waiting events found dispatching network-vif-plugged-1fa691c0-3473-4f34-a504-3778913558ab {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:18:42 user nova-compute[74669]: WARNING nova.compute.manager [req-c62c1b64-bb09-4dbf-a429-ee02ce97ae82 req-149f08bf-fc30-452b-8aa6-be02de8bed5e service nova] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Received unexpected event network-vif-plugged-1fa691c0-3473-4f34-a504-3778913558ab for instance with vm_state active and task_state None.
Nov 08 17:18:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:52 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 94098bcd-577b-4bf9-9e62-e21b984eb936 is timed out.
Nov 08 17:18:52 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Successfully detached device vdb from instance 94098bcd-577b-4bf9-9e62-e21b984eb936 from the live domain config.
Nov 08 17:18:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXShmubQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:18:52 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:18:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91926b1-20f5-4a74-926c-24aebfd630f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:18:52 user nova-compute[74669]: No targets found.
Nov 08 17:18:52 user nova-compute[74669]: iSNS:
Nov 08 17:18:52 user nova-compute[74669]: No targets found.
Nov 08 17:18:52 user nova-compute[74669]: STATIC:
Nov 08 17:18:52 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c
Nov 08 17:18:52 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:18:52 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:18:52 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161
Nov 08 17:18:52 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:18:52 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:18:52 user nova-compute[74669]: FIRMWARE:
Nov 08 17:18:52 user nova-compute[74669]: No targets found.
Nov 08 17:18:52 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:18:52 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:18:52 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cf2005-c6cb-4e7b-a4fd-b99c96981125]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[34db91b2-67e6-468f-9a07-1e601d7b9b1a]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c (non-flash)
Nov 08 17:18:52 user nova-compute[74669]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 (non-flash)
Nov 08 17:18:52 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c (non-flash)
Nov 08 17:18:52 user nova-compute[74669]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 (non-flash)
Nov 08 17:18:52 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9846bfac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c'): ({'sdb'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Removing single pathed devices sdb {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ecac63-0e6b-4a70-80b8-1a689f6cefe5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d311d0-52fc-484f-a73b-d1831c4d6323]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Flushing IO for device /dev/sdb {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60d76a1-b889-40e0-b21d-e04355262eae]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6b377f-4dde-47cc-8b57-7f98d5bcfb53]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[254eab2c-15b5-4d23-8a66-0035b41ef26f]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c955ac4e-6fa0-4cf3-99d2-ac9c9ba1857d]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c, portal: 172.16.0.220,3260]
Nov 08 17:18:52 user nova-compute[74669]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c, portal: 172.16.0.220,3260] successful.
Nov 08 17:18:52 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ba4f3d-b017-49e5-9f5c-aac86ffd906c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a8354f-4d60-4c5a-9a64-d7f536dd0a79]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] <== disconnect_volume: return (288ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:18:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:18:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:53 user nova-compute[74669]: DEBUG nova.objects.instance [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'flavor' on Instance uuid 94098bcd-577b-4bf9-9e62-e21b984eb936 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:18:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9d88f4b5-b20b-42da-9cef-9d219b4dee75 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.764s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:18:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "94098bcd-577b-4bf9-9e62-e21b984eb936" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:18:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:18:54 user nova-compute[74669]: INFO nova.compute.manager [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Detaching volume bfd017fd-0833-47f9-ae48-3c60718de161
Nov 08 17:18:54 user nova-compute[74669]: INFO nova.virt.block_device [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Attempting to driver detach volume bfd017fd-0833-47f9-ae48-3c60718de161 from mountpoint /dev/vdc
Nov 08 17:18:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Attempting to detach device vdc from instance 94098bcd-577b-4bf9-9e62-e21b984eb936 from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 17:18:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:18:54 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:18:54 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 17:18:54 user nova-compute[74669]:   <target dev="vdc" bus="virtio"/>
Nov 08 17:18:54 user nova-compute[74669]:   <serial>bfd017fd-0833-47f9-ae48-3c60718de161</serial>
Nov 08 17:18:54 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 17:18:54 user nova-compute[74669]: </disk>
Nov 08 17:18:54 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:18:54 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Successfully detached device vdc from instance 94098bcd-577b-4bf9-9e62-e21b984eb936 from the persistent domain config.
Nov 08 17:18:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 94098bcd-577b-4bf9-9e62-e21b984eb936 from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 17:18:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:18:54 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:18:54 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 17:18:54 user nova-compute[74669]:   <target dev="vdc" bus="virtio"/>
Nov 08 17:18:54 user nova-compute[74669]:   <serial>bfd017fd-0833-47f9-ae48-3c60718de161</serial>
Nov 08 17:18:54 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 17:18:54 user nova-compute[74669]: </disk>
Nov 08 17:18:54 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:18:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 94098bcd-577b-4bf9-9e62-e21b984eb936 {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 17:18:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:18:58 user nova-compute[74669]: DEBUG nova.compute.manager [req-12dcc4ed-311f-4c6f-bca8-7c9882ca2799 req-d3dc82a4-028f-4dd8-9f40-a59a3be7b3a7 service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Received event network-changed-b04b94e3-d7d6-4984-9cd6-9e88bf465c74 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:18:58 user nova-compute[74669]: DEBUG nova.compute.manager [req-12dcc4ed-311f-4c6f-bca8-7c9882ca2799 req-d3dc82a4-028f-4dd8-9f40-a59a3be7b3a7 service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Refreshing instance network info cache due to event network-changed-b04b94e3-d7d6-4984-9cd6-9e88bf465c74. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:18:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-12dcc4ed-311f-4c6f-bca8-7c9882ca2799 req-d3dc82a4-028f-4dd8-9f40-a59a3be7b3a7 service nova] Acquiring lock "refresh_cache-2980b0f6-162c-47a9-8c10-198a39f7b5db" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:18:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-12dcc4ed-311f-4c6f-bca8-7c9882ca2799 req-d3dc82a4-028f-4dd8-9f40-a59a3be7b3a7 service nova] Acquired lock "refresh_cache-2980b0f6-162c-47a9-8c10-198a39f7b5db" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:18:58 user nova-compute[74669]: DEBUG nova.network.neutron [req-12dcc4ed-311f-4c6f-bca8-7c9882ca2799 req-d3dc82a4-028f-4dd8-9f40-a59a3be7b3a7 service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Refreshing network info cache for port b04b94e3-d7d6-4984-9cd6-9e88bf465c74 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b1cc9b41-be7b-432b-a834-0fa1b1754c33 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "2980b0f6-162c-47a9-8c10-198a39f7b5db" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b1cc9b41-be7b-432b-a834-0fa1b1754c33 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "2980b0f6-162c-47a9-8c10-198a39f7b5db" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG nova.objects.instance [None req-b1cc9b41-be7b-432b-a834-0fa1b1754c33 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lazy-loading 'flavor' on Instance uuid 2980b0f6-162c-47a9-8c10-198a39f7b5db {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:18:59 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-b1cc9b41-be7b-432b-a834-0fa1b1754c33 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Ignoring supplied device name: /dev/vdb
Nov 08 17:18:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b1cc9b41-be7b-432b-a834-0fa1b1754c33 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "2980b0f6-162c-47a9-8c10-198a39f7b5db" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG nova.network.neutron [req-12dcc4ed-311f-4c6f-bca8-7c9882ca2799 req-d3dc82a4-028f-4dd8-9f40-a59a3be7b3a7 service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Updated VIF entry in instance network info cache for port b04b94e3-d7d6-4984-9cd6-9e88bf465c74. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG nova.network.neutron [req-12dcc4ed-311f-4c6f-bca8-7c9882ca2799 req-d3dc82a4-028f-4dd8-9f40-a59a3be7b3a7 service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Updating instance_info_cache with network_info: [{"id": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "address": "fa:16:3e:a4:7b:71", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04b94e3-d7", "ovs_interfaceid": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b1cc9b41-be7b-432b-a834-0fa1b1754c33 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "2980b0f6-162c-47a9-8c10-198a39f7b5db" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b1cc9b41-be7b-432b-a834-0fa1b1754c33 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "2980b0f6-162c-47a9-8c10-198a39f7b5db" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:18:59 user nova-compute[74669]: INFO nova.compute.manager [None req-b1cc9b41-be7b-432b-a834-0fa1b1754c33 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Attaching volume 4005dc0a-3b8f-4dca-b511-9d797225437d to /dev/vdb
Nov 08 17:18:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-12dcc4ed-311f-4c6f-bca8-7c9882ca2799 req-d3dc82a4-028f-4dd8-9f40-a59a3be7b3a7 service nova] Releasing lock "refresh_cache-2980b0f6-162c-47a9-8c10-198a39f7b5db" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG os_brick.utils [None req-b1cc9b41-be7b-432b-a834-0fa1b1754c33 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff76777-ae41-4842-85ec-5ad5f3a42c95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76e9277-067f-4d36-bebb-d209ed52f54c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2722ebc-9220-4de4-ac3a-3898c5a21332]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5921453e-56f1-44f3-abc7-9f5fedcdd7fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-b1cc9b41-be7b-432b-a834-0fa1b1754c33 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-b1cc9b41-be7b-432b-a834-0fa1b1754c33 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1cc9b41-be7b-432b-a834-0fa1b1754c33 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:18:59 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:18:59 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9cce52-b202-4cf4-9c37-db49bd9a004a]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-b1cc9b41-be7b-432b-a834-0fa1b1754c33 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-b1cc9b41-be7b-432b-a834-0fa1b1754c33 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-b1cc9b41-be7b-432b-a834-0fa1b1754c33 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG os_brick.utils [None req-b1cc9b41-be7b-432b-a834-0fa1b1754c33 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:18:59 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-b1cc9b41-be7b-432b-a834-0fa1b1754c33 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Updating existing volume attachment record: ce8c891f-ff91-4117-bdfc-910ab30669cd {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-611cc362-cf8d-4ca1-92ef-623d967e8ab2 req-318ac522-01fa-4a41-a2cb-e2974fb4fe26 service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Received event network-changed-822d3fcd-483d-49f1-b886-a3c0b50d0c3d {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-611cc362-cf8d-4ca1-92ef-623d967e8ab2 req-318ac522-01fa-4a41-a2cb-e2974fb4fe26 service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Refreshing instance network info cache due to event network-changed-822d3fcd-483d-49f1-b886-a3c0b50d0c3d. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-611cc362-cf8d-4ca1-92ef-623d967e8ab2 req-318ac522-01fa-4a41-a2cb-e2974fb4fe26 service nova] Acquiring lock "refresh_cache-291835fd-2fac-4eab-a205-5b0119cd48d0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-611cc362-cf8d-4ca1-92ef-623d967e8ab2 req-318ac522-01fa-4a41-a2cb-e2974fb4fe26 service nova] Acquired lock "refresh_cache-291835fd-2fac-4eab-a205-5b0119cd48d0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG nova.network.neutron [req-611cc362-cf8d-4ca1-92ef-623d967e8ab2 req-318ac522-01fa-4a41-a2cb-e2974fb4fe26 service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Refreshing network info cache for port 822d3fcd-483d-49f1-b886-a3c0b50d0c3d {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Acquiring lock "2158a7c2-2f46-4bce-8558-4347a48623d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "2158a7c2-2f46-4bce-8558-4347a48623d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Acquiring lock "2158a7c2-2f46-4bce-8558-4347a48623d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "2158a7c2-2f46-4bce-8558-4347a48623d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "2158a7c2-2f46-4bce-8558-4347a48623d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:19:01 user nova-compute[74669]: INFO nova.compute.manager [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Terminating instance
Nov 08 17:19:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG nova.network.neutron [req-611cc362-cf8d-4ca1-92ef-623d967e8ab2 req-318ac522-01fa-4a41-a2cb-e2974fb4fe26 service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Updated VIF entry in instance network info cache for port 822d3fcd-483d-49f1-b886-a3c0b50d0c3d. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG nova.network.neutron [req-611cc362-cf8d-4ca1-92ef-623d967e8ab2 req-318ac522-01fa-4a41-a2cb-e2974fb4fe26 service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Updating instance_info_cache with network_info: [{"id": "822d3fcd-483d-49f1-b886-a3c0b50d0c3d", "address": "fa:16:3e:10:9d:d5", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap822d3fcd-48", "ovs_interfaceid": "822d3fcd-483d-49f1-b886-a3c0b50d0c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-611cc362-cf8d-4ca1-92ef-623d967e8ab2 req-318ac522-01fa-4a41-a2cb-e2974fb4fe26 service nova] Releasing lock "refresh_cache-291835fd-2fac-4eab-a205-5b0119cd48d0" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-f670b750-21bb-412a-8678-ef6dfc1d456f req-b22ff609-1a86-4c8e-a04b-cc43ea14ff38 service nova] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Received event network-vif-unplugged-ea40d3d9-25df-410d-b2ff-46a980702022 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f670b750-21bb-412a-8678-ef6dfc1d456f req-b22ff609-1a86-4c8e-a04b-cc43ea14ff38 service nova] Acquiring lock "2158a7c2-2f46-4bce-8558-4347a48623d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f670b750-21bb-412a-8678-ef6dfc1d456f req-b22ff609-1a86-4c8e-a04b-cc43ea14ff38 service nova] Lock "2158a7c2-2f46-4bce-8558-4347a48623d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f670b750-21bb-412a-8678-ef6dfc1d456f req-b22ff609-1a86-4c8e-a04b-cc43ea14ff38 service nova] Lock "2158a7c2-2f46-4bce-8558-4347a48623d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-f670b750-21bb-412a-8678-ef6dfc1d456f req-b22ff609-1a86-4c8e-a04b-cc43ea14ff38 service nova] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] No waiting events found dispatching network-vif-unplugged-ea40d3d9-25df-410d-b2ff-46a980702022 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-f670b750-21bb-412a-8678-ef6dfc1d456f req-b22ff609-1a86-4c8e-a04b-cc43ea14ff38 service nova] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Received event network-vif-unplugged-ea40d3d9-25df-410d-b2ff-46a980702022 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:19:01 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:19:02 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Instance destroyed successfully.
Nov 08 17:19:02 user nova-compute[74669]: DEBUG nova.objects.instance [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lazy-loading 'resources' on Instance uuid 2158a7c2-2f46-4bce-8558-4347a48623d5 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:19:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:09:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-614850635',display_name='tempest-ServersNegativeTestJSON-server-614850635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-614850635',id=29,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:09:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae1a781163a345dc8be717e3e7c73788',ramdisk_id='',reservation_id='r-i1y84hf5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1017043905',owner_user_name='tempest-ServersNegativeTestJSON-1017043905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:09:52Z,user_data=None,user_id='a3b60e9d47ab49f8bd3614621e2bd890',uuid=2158a7c2-2f46-4bce-8558-4347a48623d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea40d3d9-25df-410d-b2ff-46a980702022", "address": "fa:16:3e:76:cd:a9", "network": {"id": "52bf51f6-cf7e-403b-b601-0660b9c8544f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-17276515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1a781163a345dc8be717e3e7c73788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea40d3d9-25", "ovs_interfaceid": "ea40d3d9-25df-410d-b2ff-46a980702022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:19:02 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Converting VIF {"id": "ea40d3d9-25df-410d-b2ff-46a980702022", "address": "fa:16:3e:76:cd:a9", "network": {"id": "52bf51f6-cf7e-403b-b601-0660b9c8544f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-17276515-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae1a781163a345dc8be717e3e7c73788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea40d3d9-25", "ovs_interfaceid": "ea40d3d9-25df-410d-b2ff-46a980702022", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:19:02 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:cd:a9,bridge_name='br-int',has_traffic_filtering=True,id=ea40d3d9-25df-410d-b2ff-46a980702022,network=Network(52bf51f6-cf7e-403b-b601-0660b9c8544f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea40d3d9-25') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:19:02 user nova-compute[74669]: DEBUG os_vif [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:cd:a9,bridge_name='br-int',has_traffic_filtering=True,id=ea40d3d9-25df-410d-b2ff-46a980702022,network=Network(52bf51f6-cf7e-403b-b601-0660b9c8544f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea40d3d9-25') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:19:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea40d3d9-25, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:19:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:19:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5d79f9a-13c6-4f4d-aa01-23978ddfa685) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:19:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:19:02 user nova-compute[74669]: INFO os_vif [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:cd:a9,bridge_name='br-int',has_traffic_filtering=True,id=ea40d3d9-25df-410d-b2ff-46a980702022,network=Network(52bf51f6-cf7e-403b-b601-0660b9c8544f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea40d3d9-25')
Nov 08 17:19:02 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Deleting instance files /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5_del
Nov 08 17:19:02 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Deletion of /opt/stack/data/nova/instances/2158a7c2-2f46-4bce-8558-4347a48623d5_del complete
Nov 08 17:19:02 user nova-compute[74669]: INFO nova.compute.manager [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 08 17:19:02 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:19:02 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:19:02 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:19:02 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:19:02 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Took 0.50 seconds to deallocate network for instance.
Nov 08 17:19:02 user nova-compute[74669]: DEBUG nova.compute.manager [req-3817e0bd-aac6-4e2c-a1d4-4ceb4f0a2428 req-3ac81ba0-c1a5-4d9a-a9b2-d51cf6b13935 service nova] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Received event network-vif-deleted-ea40d3d9-25df-410d-b2ff-46a980702022 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:19:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:19:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:19:03 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:19:03 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:19:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:19:03 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Deleted allocations for instance 2158a7c2-2f46-4bce-8558-4347a48623d5
Nov 08 17:19:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b2aa1783-698e-4a28-8854-3708b763debe tempest-ServersNegativeTestJSON-1017043905 tempest-ServersNegativeTestJSON-1017043905-project-member] Lock "2158a7c2-2f46-4bce-8558-4347a48623d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.965s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:19:03 user nova-compute[74669]: DEBUG nova.compute.manager [req-a11ebf41-57a7-44d4-b884-059e0e481649 req-c8f4d866-7a95-490f-8e4e-c19af7d17316 service nova] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Received event network-vif-plugged-ea40d3d9-25df-410d-b2ff-46a980702022 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:19:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a11ebf41-57a7-44d4-b884-059e0e481649 req-c8f4d866-7a95-490f-8e4e-c19af7d17316 service nova] Acquiring lock "2158a7c2-2f46-4bce-8558-4347a48623d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:19:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a11ebf41-57a7-44d4-b884-059e0e481649 req-c8f4d866-7a95-490f-8e4e-c19af7d17316 service nova] Lock "2158a7c2-2f46-4bce-8558-4347a48623d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:19:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a11ebf41-57a7-44d4-b884-059e0e481649 req-c8f4d866-7a95-490f-8e4e-c19af7d17316 service nova] Lock "2158a7c2-2f46-4bce-8558-4347a48623d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:19:03 user nova-compute[74669]: DEBUG nova.compute.manager [req-a11ebf41-57a7-44d4-b884-059e0e481649 req-c8f4d866-7a95-490f-8e4e-c19af7d17316 service nova] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] No waiting events found dispatching network-vif-plugged-ea40d3d9-25df-410d-b2ff-46a980702022 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:19:03 user nova-compute[74669]: WARNING nova.compute.manager [req-a11ebf41-57a7-44d4-b884-059e0e481649 req-c8f4d866-7a95-490f-8e4e-c19af7d17316 service nova] [instance: 2158a7c2-2f46-4bce-8558-4347a48623d5] Received unexpected event network-vif-plugged-ea40d3d9-25df-410d-b2ff-46a980702022 for instance with vm_state deleted and task_state None.
Nov 08 17:19:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:06 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:19:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "291835fd-2fac-4eab-a205-5b0119cd48d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "291835fd-2fac-4eab-a205-5b0119cd48d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG nova.objects.instance [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lazy-loading 'flavor' on Instance uuid 291835fd-2fac-4eab-a205-5b0119cd48d0 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "291835fd-2fac-4eab-a205-5b0119cd48d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "291835fd-2fac-4eab-a205-5b0119cd48d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "291835fd-2fac-4eab-a205-5b0119cd48d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:19:08 user nova-compute[74669]: INFO nova.compute.manager [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Attaching volume b178a09a-1943-46ad-993d-545c256bc560 to /dev/vdb
Nov 08 17:19:08 user nova-compute[74669]: DEBUG os_brick.utils [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c3a165-2900-4d17-955c-e69cdd18c992]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35e37ea-fe7e-4c87-9ec4-ef86d688d878]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aee6ce3-2b6c-4a76-9fc2-c82e919855e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d45f089-d97a-4463-9517-0b1f06868237]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:19:08 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b80ec82-994e-400c-a30b-c06b23cb54bd]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG os_brick.utils [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Updating existing volume attachment record: d4c093b1-a6fa-43a5-8d56-d1547a909050 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-94098bcd-577b-4bf9-9e62-e21b984eb936" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-94098bcd-577b-4bf9-9e62-e21b984eb936" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:19:08 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:19:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:09 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Updating instance_info_cache with network_info: [{"id": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "address": "fa:16:3e:46:79:c5", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211a12bb-0d", "ovs_interfaceid": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:19:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-94098bcd-577b-4bf9-9e62-e21b984eb936" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:19:09 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:19:09 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:19:09 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:19:09 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:19:09 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:19:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:19:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:19:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:19:09 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:19:09 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:11 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:19:11 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:19:11 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8358MB free_disk=25.276744842529297GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:19:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:19:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:19:11 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 94098bcd-577b-4bf9-9e62-e21b984eb936 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:19:11 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2980b0f6-162c-47a9-8c10-198a39f7b5db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:19:11 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 291835fd-2fac-4eab-a205-5b0119cd48d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:19:11 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0796133c-71d6-4d64-94af-49028a6603ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:19:11 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:19:11 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:19:12 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:19:12 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:19:12 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:19:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.339s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:19:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:13 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:19:13 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:19:13 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:19:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:14 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:19:15 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 94098bcd-577b-4bf9-9e62-e21b984eb936 is timed out.
Nov 08 17:19:15 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Successfully detached device vdc from instance 94098bcd-577b-4bf9-9e62-e21b984eb936 from the live domain config.
Nov 08 17:19:15 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cLKeishJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:19:15 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:19:15 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11875e8-ea0e-4d2f-80b1-af9e1142cc17]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:19:15 user nova-compute[74669]: No targets found.
Nov 08 17:19:15 user nova-compute[74669]: iSNS:
Nov 08 17:19:15 user nova-compute[74669]: No targets found.
Nov 08 17:19:15 user nova-compute[74669]: STATIC:
Nov 08 17:19:15 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161
Nov 08 17:19:15 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:19:15 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:19:15 user nova-compute[74669]: FIRMWARE:
Nov 08 17:19:15 user nova-compute[74669]: No targets found.
Nov 08 17:19:15 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:19:15 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:19:15 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad1206d-dfba-4f1a-9092-d9c56ecfc912]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[430bdbff-8514-4345-955d-6dc69d285a5c]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 (non-flash)
Nov 08 17:19:15 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 (non-flash)
Nov 08 17:19:15 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd984503640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161'): ({'sdc'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Removing single pathed devices sdc {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dbc0ca-7e70-46ed-83c7-25d509e40cec]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e601977-a16c-4fb5-a6d9-a4cc5f2d1066]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Flushing IO for device /dev/sdc {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[17515816-ca15-4d68-88dd-5d16c6617844]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a469ae43-c08e-4923-ad7a-5d7c05a57732]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a671bfad-11ae-4556-93e0-6eeb51c0bead]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bac9b5b-242f-460b-b7bf-f4e9e5e6bd30]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161, portal: 172.16.0.220,3260]
Nov 08 17:19:15 user nova-compute[74669]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161, portal: 172.16.0.220,3260] successful.
Nov 08 17:19:15 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfd017fd-0833-47f9-ae48-3c60718de161 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7590a0-1252-489a-a8ed-13efc00e3790]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] <== disconnect_volume: return (273ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:19:15 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:19:16 user nova-compute[74669]: DEBUG nova.objects.instance [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'flavor' on Instance uuid 94098bcd-577b-4bf9-9e62-e21b984eb936 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:19:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2d4dce58-a2d3-464b-8e07-bbccd3ac99d6 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.138s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:19:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.volume.cinder [None req-b1cc9b41-be7b-432b-a834-0fa1b1754c33 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Update attachment failed for attachment ce8c891f-ff91-4117-bdfc-910ab30669cd. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-86e84daf-1cf5-4809-a226-0445222a043c) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-86e84daf-1cf5-4809-a226-0445222a043c)
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [None req-b1cc9b41-be7b-432b-a834-0fa1b1754c33 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Failed to attach 4005dc0a-3b8f-4dca-b511-9d797225437d at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-86e84daf-1cf5-4809-a226-0445222a043c)
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Traceback (most recent call last):
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]     self._do_attach(context, instance, volume, volume_api,
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]     self._volume_attach(context, volume, connector, instance,
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]     connection_info = volume_api.attachment_update(
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]     res = method(self, ctx, *args, **kwargs)
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]     with excutils.save_and_reraise_exception():
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]     self.force_reraise()
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]     raise self.value
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]     return method.func(obj, *args, **kwargs)
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]     resp = self._update('/attachments/%s' % id, body)
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]     return self.request(url, method, **kwargs)
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db]     raise exceptions.from_response(resp, body)
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-86e84daf-1cf5-4809-a226-0445222a043c)
Nov 08 17:19:17 user nova-compute[74669]: ERROR nova.compute.manager [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] 
Nov 08 17:19:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b1cc9b41-be7b-432b-a834-0fa1b1754c33 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "2980b0f6-162c-47a9-8c10-198a39f7b5db" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.993s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server [None req-b1cc9b41-be7b-432b-a834-0fa1b1754c33 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-86e84daf-1cf5-4809-a226-0445222a043c)
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-86e84daf-1cf5-4809-a226-0445222a043c)
Nov 08 17:19:17 user nova-compute[74669]: ERROR oslo_messaging.rpc.server 
Nov 08 17:19:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "94098bcd-577b-4bf9-9e62-e21b984eb936" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:19:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:19:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "94098bcd-577b-4bf9-9e62-e21b984eb936-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:19:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:19:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:19:17 user nova-compute[74669]: INFO nova.compute.manager [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Terminating instance
Nov 08 17:19:17 user nova-compute[74669]: DEBUG nova.compute.manager [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:19:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:18 user nova-compute[74669]: DEBUG nova.compute.manager [req-793a8aae-a8d8-4930-ab74-4dcec6c47045 req-8f5f6255-a324-4fde-ae24-4e9399b19b08 service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Received event network-vif-unplugged-211a12bb-0d17-4746-b1ed-4cc9dee09c05 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:19:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-793a8aae-a8d8-4930-ab74-4dcec6c47045 req-8f5f6255-a324-4fde-ae24-4e9399b19b08 service nova] Acquiring lock "94098bcd-577b-4bf9-9e62-e21b984eb936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:19:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-793a8aae-a8d8-4930-ab74-4dcec6c47045 req-8f5f6255-a324-4fde-ae24-4e9399b19b08 service nova] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:19:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-793a8aae-a8d8-4930-ab74-4dcec6c47045 req-8f5f6255-a324-4fde-ae24-4e9399b19b08 service nova] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:19:18 user nova-compute[74669]: DEBUG nova.compute.manager [req-793a8aae-a8d8-4930-ab74-4dcec6c47045 req-8f5f6255-a324-4fde-ae24-4e9399b19b08 service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] No waiting events found dispatching network-vif-unplugged-211a12bb-0d17-4746-b1ed-4cc9dee09c05 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:19:18 user nova-compute[74669]: DEBUG nova.compute.manager [req-793a8aae-a8d8-4930-ab74-4dcec6c47045 req-8f5f6255-a324-4fde-ae24-4e9399b19b08 service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Received event network-vif-unplugged-211a12bb-0d17-4746-b1ed-4cc9dee09c05 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:19:18 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Instance destroyed successfully.
Nov 08 17:19:18 user nova-compute[74669]: DEBUG nova.objects.instance [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lazy-loading 'resources' on Instance uuid 94098bcd-577b-4bf9-9e62-e21b984eb936 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:19:18 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:15:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1252247701',display_name='tempest-AttachVolumeTestJSON-server-1252247701',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1252247701',id=35,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFsvcL8Txg+9gT7HEu9JqwqorhLPkkOnNS7knMcd2KthpMHD6U/EgPkyGYbsiyf9sOFAVmonPmNa6ylgSlstRATd7IthcMcUcSc+1W7Sqfv8Vw8dkZ9Ut8mRxVy0gJ+qg==',key_name='tempest-keypair-1378818859',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:15:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a7febf2b00147cfb989380452aba869',ramdisk_id='',reservation_id='r-2sj5t7pg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-275457186',owner_user_name='tempest-AttachVolumeTestJSON-275457186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:15:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80fd41a7ea7943e6a913c211f6ea2d52',uuid=94098bcd-577b-4bf9-9e62-e21b984eb936,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "address": "fa:16:3e:46:79:c5", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211a12bb-0d", "ovs_interfaceid": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:19:18 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converting VIF {"id": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "address": "fa:16:3e:46:79:c5", "network": {"id": "61491f39-cb2d-4857-9db0-0a1f154331e9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802415353-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7febf2b00147cfb989380452aba869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211a12bb-0d", "ovs_interfaceid": "211a12bb-0d17-4746-b1ed-4cc9dee09c05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:19:18 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:79:c5,bridge_name='br-int',has_traffic_filtering=True,id=211a12bb-0d17-4746-b1ed-4cc9dee09c05,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211a12bb-0d') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:19:18 user nova-compute[74669]: DEBUG os_vif [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:79:c5,bridge_name='br-int',has_traffic_filtering=True,id=211a12bb-0d17-4746-b1ed-4cc9dee09c05,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211a12bb-0d') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:19:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap211a12bb-0d, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:19:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fcc2660e-d446-4951-96f5-eb4a17e28e29) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:19:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:18 user nova-compute[74669]: INFO os_vif [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:79:c5,bridge_name='br-int',has_traffic_filtering=True,id=211a12bb-0d17-4746-b1ed-4cc9dee09c05,network=Network(61491f39-cb2d-4857-9db0-0a1f154331e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211a12bb-0d')
Nov 08 17:19:18 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Deleting instance files /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936_del
Nov 08 17:19:18 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Deletion of /opt/stack/data/nova/instances/94098bcd-577b-4bf9-9e62-e21b984eb936_del complete
Nov 08 17:19:18 user nova-compute[74669]: INFO nova.compute.manager [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 08 17:19:18 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:19:18 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:19:18 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:19:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:19 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:19:19 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Took 0.79 seconds to deallocate network for instance.
Nov 08 17:19:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:19:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:19:19 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:19:19 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:19:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:19:19 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Deleted allocations for instance 94098bcd-577b-4bf9-9e62-e21b984eb936
Nov 08 17:19:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b65c4eec-b8d1-430d-a160-e431417d8045 tempest-AttachVolumeTestJSON-275457186 tempest-AttachVolumeTestJSON-275457186-project-member] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.238s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:19:20 user nova-compute[74669]: DEBUG nova.compute.manager [req-c74f4ed0-ad33-41d3-b8b5-d565813d77dc req-f519bcf1-e88f-41d7-83d6-9f17888e18cd service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Received event network-vif-plugged-211a12bb-0d17-4746-b1ed-4cc9dee09c05 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:19:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c74f4ed0-ad33-41d3-b8b5-d565813d77dc req-f519bcf1-e88f-41d7-83d6-9f17888e18cd service nova] Acquiring lock "94098bcd-577b-4bf9-9e62-e21b984eb936-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:19:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c74f4ed0-ad33-41d3-b8b5-d565813d77dc req-f519bcf1-e88f-41d7-83d6-9f17888e18cd service nova] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:19:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c74f4ed0-ad33-41d3-b8b5-d565813d77dc req-f519bcf1-e88f-41d7-83d6-9f17888e18cd service nova] Lock "94098bcd-577b-4bf9-9e62-e21b984eb936-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:19:20 user nova-compute[74669]: DEBUG nova.compute.manager [req-c74f4ed0-ad33-41d3-b8b5-d565813d77dc req-f519bcf1-e88f-41d7-83d6-9f17888e18cd service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] No waiting events found dispatching network-vif-plugged-211a12bb-0d17-4746-b1ed-4cc9dee09c05 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:19:20 user nova-compute[74669]: WARNING nova.compute.manager [req-c74f4ed0-ad33-41d3-b8b5-d565813d77dc req-f519bcf1-e88f-41d7-83d6-9f17888e18cd service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Received unexpected event network-vif-plugged-211a12bb-0d17-4746-b1ed-4cc9dee09c05 for instance with vm_state deleted and task_state None.
Nov 08 17:19:20 user nova-compute[74669]: DEBUG nova.compute.manager [req-c74f4ed0-ad33-41d3-b8b5-d565813d77dc req-f519bcf1-e88f-41d7-83d6-9f17888e18cd service nova] [instance: 94098bcd-577b-4bf9-9e62-e21b984eb936] Received event network-vif-deleted-211a12bb-0d17-4746-b1ed-4cc9dee09c05 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:19:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:19:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:19:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:19:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:19:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHNWEtOz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:19:31 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:19:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:19:31 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:19:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:19:31 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd01aa5-ca4c-4b53-a12f-3c344d94a415]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:19:31 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbccd990-0361-4630-9773-9b924043702c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560] added
Nov 08 17:19:31 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.103s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a33b886-f42c-4cc5-afcd-9efd1bc9cc4c]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa10bd5-838b-45be-8200-a5dc80313f72]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yHNWEtOz {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yHNWEtOz" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[41004d70-b53a-4886-b4a5-9958eede8fb9]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yHNWEtOz'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[20659cb8-c39a-4438-81b1-1b77e8d89b32]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c47ee4-93b6-4e2d-8509-dd020eb3950c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 17:19:31 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 17:19:31 user nova-compute[74669]:  {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:19:31 user nova-compute[74669]: WARNING os_brick.initiator.connectors.iscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 17:19:31 user nova-compute[74669]: 
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2f9b46-8404-482b-8fa5-abb6d4c88f24]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560, portal: 172.16.0.220,3260]
Nov 08 17:19:31 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560, portal: 172.16.0.220,3260] successful.
Nov 08 17:19:31 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3032feb9-e929-4ce7-9841-96908994cea8]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e0a0a0-b76a-4541-a63a-05784ec5fb5a]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 (non-flash)
Nov 08 17:19:31 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 (non-flash)
Nov 08 17:19:31 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[172b8c87-92f6-4337-be71-6957db5e9b65]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:31 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:19:32 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:19:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHNWEtOz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:19:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:19:32 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26265363932303030', 'path': '/dev/sdb'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:19:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265363932303030', 'path': '/dev/sdb'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:19:32 user nova-compute[74669]: DEBUG nova.objects.instance [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lazy-loading 'flavor' on Instance uuid 291835fd-2fac-4eab-a205-5b0119cd48d0 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:19:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 17:19:32 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:19:32 user nova-compute[74669]:   <source dev="/dev/sdb"/>
Nov 08 17:19:32 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:19:32 user nova-compute[74669]:   <serial>b178a09a-1943-46ad-993d-545c256bc560</serial>
Nov 08 17:19:32 user nova-compute[74669]: </disk>
Nov 08 17:19:32 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 17:19:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:19:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:19:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] No VIF found with MAC fa:16:3e:10:9d:d5, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:19:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0e28d73f-1736-48f7-b05d-085037b1b613 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "291835fd-2fac-4eab-a205-5b0119cd48d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.711s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:19:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "291835fd-2fac-4eab-a205-5b0119cd48d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:19:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "291835fd-2fac-4eab-a205-5b0119cd48d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:19:34 user nova-compute[74669]: INFO nova.compute.manager [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Detaching volume b178a09a-1943-46ad-993d-545c256bc560
Nov 08 17:19:34 user nova-compute[74669]: INFO nova.virt.block_device [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Attempting to driver detach volume b178a09a-1943-46ad-993d-545c256bc560 from mountpoint /dev/vdb
Nov 08 17:19:34 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Attempting to detach device vdb from instance 291835fd-2fac-4eab-a205-5b0119cd48d0 from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 17:19:34 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:19:34 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:19:34 user nova-compute[74669]:   <source dev="/dev/sdb"/>
Nov 08 17:19:34 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:19:34 user nova-compute[74669]:   <serial>b178a09a-1943-46ad-993d-545c256bc560</serial>
Nov 08 17:19:34 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:19:34 user nova-compute[74669]: </disk>
Nov 08 17:19:34 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:19:34 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Successfully detached device vdb from instance 291835fd-2fac-4eab-a205-5b0119cd48d0 from the persistent domain config.
Nov 08 17:19:34 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 291835fd-2fac-4eab-a205-5b0119cd48d0 from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 17:19:34 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:19:34 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:19:34 user nova-compute[74669]:   <source dev="/dev/sdb"/>
Nov 08 17:19:34 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:19:34 user nova-compute[74669]:   <serial>b178a09a-1943-46ad-993d-545c256bc560</serial>
Nov 08 17:19:34 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:19:34 user nova-compute[74669]: </disk>
Nov 08 17:19:34 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:19:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 291835fd-2fac-4eab-a205-5b0119cd48d0 {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 17:19:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:19:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:19:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:19:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:19:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:19:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:19:55 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 291835fd-2fac-4eab-a205-5b0119cd48d0 is timed out.
Nov 08 17:19:55 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Successfully detached device vdb from instance 291835fd-2fac-4eab-a205-5b0119cd48d0 from the live domain config.
Nov 08 17:19:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yHNWEtOz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:19:55 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:19:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da1e811-aa61-440f-b41c-8f84439dfbf8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:19:55 user nova-compute[74669]: No targets found.
Nov 08 17:19:55 user nova-compute[74669]: iSNS:
Nov 08 17:19:55 user nova-compute[74669]: No targets found.
Nov 08 17:19:55 user nova-compute[74669]: STATIC:
Nov 08 17:19:55 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560
Nov 08 17:19:55 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:19:55 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:19:55 user nova-compute[74669]: FIRMWARE:
Nov 08 17:19:55 user nova-compute[74669]: No targets found.
Nov 08 17:19:55 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:19:55 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:19:55 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a1361f-967f-4bd4-9bb1-d1f50687e748]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e8a1eb-805c-420d-a1ee-27ff82d3c818]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 (non-flash)
Nov 08 17:19:55 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 (non-flash)
Nov 08 17:19:55 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9846bf5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560'): ({'sdb'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Removing single pathed devices sdb {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[73488cbf-736e-43f4-941a-a5d35edf9aac]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9161f15-3926-49cc-bac0-d331c25c1db7]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Flushing IO for device /dev/sdb {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47dee9e-7101-4c97-afb3-74579b85a8a0]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[779f4800-2334-4130-b4cf-17be28e51d7a]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f54f5d7-c446-4d75-a017-32fde38cd0fd]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[da569bcf-19d3-4c00-94cf-736ecf9c2a36]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560, portal: 172.16.0.220,3260]
Nov 08 17:19:55 user nova-compute[74669]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560, portal: 172.16.0.220,3260] successful.
Nov 08 17:19:55 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b178a09a-1943-46ad-993d-545c256bc560 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1167d7bf-e829-4f59-8a03-f4534b1287b2]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] <== disconnect_volume: return (295ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:19:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:19:56 user nova-compute[74669]: DEBUG nova.objects.instance [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lazy-loading 'flavor' on Instance uuid 291835fd-2fac-4eab-a205-5b0119cd48d0 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:19:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-4ac538b4-7055-4b71-8247-adb53e388371 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "291835fd-2fac-4eab-a205-5b0119cd48d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.961s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:19:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:02 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:20:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:20:07 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:20:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:20:08 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:20:08 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:20:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-2980b0f6-162c-47a9-8c10-198a39f7b5db" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:20:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-2980b0f6-162c-47a9-8c10-198a39f7b5db" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:20:08 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:20:09 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Updating instance_info_cache with network_info: [{"id": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "address": "fa:16:3e:a4:7b:71", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04b94e3-d7", "ovs_interfaceid": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:20:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-2980b0f6-162c-47a9-8c10-198a39f7b5db" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:20:09 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:20:09 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:20:09 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:20:10 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:20:10 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:20:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:20:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:20:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:20:10 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:20:10 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:20:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:20:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:20:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:20:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:20:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:20:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:20:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:20:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:20:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:20:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:20:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:20:12 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:20:12 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:20:12 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8605MB free_disk=25.301197052001953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:20:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:20:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:20:12 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2980b0f6-162c-47a9-8c10-198a39f7b5db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:20:12 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 291835fd-2fac-4eab-a205-5b0119cd48d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:20:12 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0796133c-71d6-4d64-94af-49028a6603ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:20:12 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:20:12 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:20:12 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:20:12 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:20:12 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:20:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:20:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:13 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:20:13 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:20:14 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:20:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:20:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:20:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:20:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:20:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:20:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "291835fd-2fac-4eab-a205-5b0119cd48d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "291835fd-2fac-4eab-a205-5b0119cd48d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "291835fd-2fac-4eab-a205-5b0119cd48d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "291835fd-2fac-4eab-a205-5b0119cd48d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "291835fd-2fac-4eab-a205-5b0119cd48d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:20:25 user nova-compute[74669]: INFO nova.compute.manager [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Terminating instance
Nov 08 17:20:25 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG nova.compute.manager [req-860ad9ab-d5cc-4bb6-ad49-edfa33695486 req-c71c1b69-0aa9-4dc2-880a-a930da3da09f service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Received event network-vif-unplugged-822d3fcd-483d-49f1-b886-a3c0b50d0c3d {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-860ad9ab-d5cc-4bb6-ad49-edfa33695486 req-c71c1b69-0aa9-4dc2-880a-a930da3da09f service nova] Acquiring lock "291835fd-2fac-4eab-a205-5b0119cd48d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-860ad9ab-d5cc-4bb6-ad49-edfa33695486 req-c71c1b69-0aa9-4dc2-880a-a930da3da09f service nova] Lock "291835fd-2fac-4eab-a205-5b0119cd48d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-860ad9ab-d5cc-4bb6-ad49-edfa33695486 req-c71c1b69-0aa9-4dc2-880a-a930da3da09f service nova] Lock "291835fd-2fac-4eab-a205-5b0119cd48d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG nova.compute.manager [req-860ad9ab-d5cc-4bb6-ad49-edfa33695486 req-c71c1b69-0aa9-4dc2-880a-a930da3da09f service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] No waiting events found dispatching network-vif-unplugged-822d3fcd-483d-49f1-b886-a3c0b50d0c3d {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG nova.compute.manager [req-860ad9ab-d5cc-4bb6-ad49-edfa33695486 req-c71c1b69-0aa9-4dc2-880a-a930da3da09f service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Received event network-vif-unplugged-822d3fcd-483d-49f1-b886-a3c0b50d0c3d for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:20:25 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Instance destroyed successfully.
Nov 08 17:20:25 user nova-compute[74669]: DEBUG nova.objects.instance [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lazy-loading 'resources' on Instance uuid 291835fd-2fac-4eab-a205-5b0119cd48d0 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-897754386',display_name='tempest-AttachVolumeNegativeTest-server-897754386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-897754386',id=37,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6uLZ6EB+61i2x3YdHMBDjcsuJ/zV3DKd2g1BK+AzgEY+/x6jHHsYMPO4oTZDODKf24aCSkzfy0vj1xjch7SYCmAHnU5I9vPG2TxWp0AnaAx8FoHn5J4gO0NVl3n2KwLQ==',key_name='tempest-keypair-886342158',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:17:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f58f78f65e774cf78ca0c49aa11f9b54',ramdisk_id='',reservation_id='r-40plr4ii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1846694333',owner_user_name='tempest-AttachVolumeNegativeTest-1846694333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:17:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='565488b722e44809a7cff5e617daae84',uuid=291835fd-2fac-4eab-a205-5b0119cd48d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "822d3fcd-483d-49f1-b886-a3c0b50d0c3d", "address": "fa:16:3e:10:9d:d5", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap822d3fcd-48", "ovs_interfaceid": "822d3fcd-483d-49f1-b886-a3c0b50d0c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converting VIF {"id": "822d3fcd-483d-49f1-b886-a3c0b50d0c3d", "address": "fa:16:3e:10:9d:d5", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap822d3fcd-48", "ovs_interfaceid": "822d3fcd-483d-49f1-b886-a3c0b50d0c3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:9d:d5,bridge_name='br-int',has_traffic_filtering=True,id=822d3fcd-483d-49f1-b886-a3c0b50d0c3d,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap822d3fcd-48') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG os_vif [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:9d:d5,bridge_name='br-int',has_traffic_filtering=True,id=822d3fcd-483d-49f1-b886-a3c0b50d0c3d,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap822d3fcd-48') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap822d3fcd-48, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4c01e36-6538-443b-8fae-936c914ee975) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:26 user nova-compute[74669]: INFO os_vif [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:9d:d5,bridge_name='br-int',has_traffic_filtering=True,id=822d3fcd-483d-49f1-b886-a3c0b50d0c3d,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap822d3fcd-48')
Nov 08 17:20:26 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Deleting instance files /opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0_del
Nov 08 17:20:26 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Deletion of /opt/stack/data/nova/instances/291835fd-2fac-4eab-a205-5b0119cd48d0_del complete
Nov 08 17:20:26 user nova-compute[74669]: INFO nova.compute.manager [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 08 17:20:26 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:20:26 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:20:26 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:20:26 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:20:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-b4b8d09a-8975-4bd1-85ac-1f2546110dd5 req-6e9834f5-30dd-45dc-ad1a-8fa1896353cf service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Received event network-vif-deleted-822d3fcd-483d-49f1-b886-a3c0b50d0c3d {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:20:26 user nova-compute[74669]: INFO nova.compute.manager [req-b4b8d09a-8975-4bd1-85ac-1f2546110dd5 req-6e9834f5-30dd-45dc-ad1a-8fa1896353cf service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Neutron deleted interface 822d3fcd-483d-49f1-b886-a3c0b50d0c3d; detaching it from the instance and deleting it from the info cache
Nov 08 17:20:26 user nova-compute[74669]: DEBUG nova.network.neutron [req-b4b8d09a-8975-4bd1-85ac-1f2546110dd5 req-6e9834f5-30dd-45dc-ad1a-8fa1896353cf service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:20:26 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Took 0.66 seconds to deallocate network for instance.
Nov 08 17:20:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-b4b8d09a-8975-4bd1-85ac-1f2546110dd5 req-6e9834f5-30dd-45dc-ad1a-8fa1896353cf service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Detach interface failed, port_id=822d3fcd-483d-49f1-b886-a3c0b50d0c3d, reason: Instance 291835fd-2fac-4eab-a205-5b0119cd48d0 could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 17:20:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:20:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:20:26 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:20:26 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:20:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:20:27 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Deleted allocations for instance 291835fd-2fac-4eab-a205-5b0119cd48d0
Nov 08 17:20:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a78c70df-4356-46ef-934a-b06b750ce8db tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "291835fd-2fac-4eab-a205-5b0119cd48d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.087s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:20:27 user nova-compute[74669]: DEBUG nova.compute.manager [None req-f48a9e9e-d87d-4415-834d-953ff4c81226 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:20:27 user nova-compute[74669]: INFO nova.compute.manager [None req-f48a9e9e-d87d-4415-834d-953ff4c81226 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] instance snapshotting
Nov 08 17:20:27 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-f48a9e9e-d87d-4415-834d-953ff4c81226 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Beginning live snapshot process
Nov 08 17:20:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-07be5cb6-a2fb-49b6-a23a-dd3f635d8845 req-8cb3d702-f221-42c6-af3a-e0d71a757166 service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Received event network-vif-plugged-822d3fcd-483d-49f1-b886-a3c0b50d0c3d {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:20:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-07be5cb6-a2fb-49b6-a23a-dd3f635d8845 req-8cb3d702-f221-42c6-af3a-e0d71a757166 service nova] Acquiring lock "291835fd-2fac-4eab-a205-5b0119cd48d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:20:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-07be5cb6-a2fb-49b6-a23a-dd3f635d8845 req-8cb3d702-f221-42c6-af3a-e0d71a757166 service nova] Lock "291835fd-2fac-4eab-a205-5b0119cd48d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:20:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-07be5cb6-a2fb-49b6-a23a-dd3f635d8845 req-8cb3d702-f221-42c6-af3a-e0d71a757166 service nova] Lock "291835fd-2fac-4eab-a205-5b0119cd48d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:20:27 user nova-compute[74669]: DEBUG nova.compute.manager [req-07be5cb6-a2fb-49b6-a23a-dd3f635d8845 req-8cb3d702-f221-42c6-af3a-e0d71a757166 service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] No waiting events found dispatching network-vif-plugged-822d3fcd-483d-49f1-b886-a3c0b50d0c3d {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:20:27 user nova-compute[74669]: WARNING nova.compute.manager [req-07be5cb6-a2fb-49b6-a23a-dd3f635d8845 req-8cb3d702-f221-42c6-af3a-e0d71a757166 service nova] [instance: 291835fd-2fac-4eab-a205-5b0119cd48d0] Received unexpected event network-vif-plugged-822d3fcd-483d-49f1-b886-a3c0b50d0c3d for instance with vm_state deleted and task_state None.
Nov 08 17:20:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f48a9e9e-d87d-4415-834d-953ff4c81226 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json -f qcow2 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:20:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f48a9e9e-d87d-4415-834d-953ff4c81226 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:20:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f48a9e9e-d87d-4415-834d-953ff4c81226 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json -f qcow2 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:20:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f48a9e9e-d87d-4415-834d-953ff4c81226 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json -f qcow2" returned: 0 in 0.250s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:20:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f48a9e9e-d87d-4415-834d-953ff4c81226 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:20:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f48a9e9e-d87d-4415-834d-953ff4c81226 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.168s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:20:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f48a9e9e-d87d-4415-834d-953ff4c81226 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmps5yij1vb/477f3da1db6b4f9bbad7fe21df33ac04.delta 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:20:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f48a9e9e-d87d-4415-834d-953ff4c81226 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmps5yij1vb/477f3da1db6b4f9bbad7fe21df33ac04.delta 1073741824" returned: 0 in 0.053s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:20:28 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-f48a9e9e-d87d-4415-834d-953ff4c81226 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 17:20:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-f48a9e9e-d87d-4415-834d-953ff4c81226 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74669) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 17:20:29 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-f48a9e9e-d87d-4415-834d-953ff4c81226 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] COPY block job progress, current cursor: 47316992 final cursor: 75497472 {{(pid=74669) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 17:20:29 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-f48a9e9e-d87d-4415-834d-953ff4c81226 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74669) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 17:20:29 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-f48a9e9e-d87d-4415-834d-953ff4c81226 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 17:20:29 user nova-compute[74669]: DEBUG nova.privsep.utils [None req-f48a9e9e-d87d-4415-834d-953ff4c81226 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74669) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 17:20:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f48a9e9e-d87d-4415-834d-953ff4c81226 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmps5yij1vb/477f3da1db6b4f9bbad7fe21df33ac04.delta /opt/stack/data/nova/instances/snapshots/tmps5yij1vb/477f3da1db6b4f9bbad7fe21df33ac04 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:20:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f48a9e9e-d87d-4415-834d-953ff4c81226 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmps5yij1vb/477f3da1db6b4f9bbad7fe21df33ac04.delta /opt/stack/data/nova/instances/snapshots/tmps5yij1vb/477f3da1db6b4f9bbad7fe21df33ac04" returned: 0 in 0.789s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:20:30 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-f48a9e9e-d87d-4415-834d-953ff4c81226 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Snapshot extracted, beginning image upload
Nov 08 17:20:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:33 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-f48a9e9e-d87d-4415-834d-953ff4c81226 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Snapshot image upload complete
Nov 08 17:20:33 user nova-compute[74669]: INFO nova.compute.manager [None req-f48a9e9e-d87d-4415-834d-953ff4c81226 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Took 6.17 seconds to snapshot the instance on the hypervisor.
Nov 08 17:20:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:20:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:20:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:20:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Acquiring lock "afd473af-fc47-4f57-a5c4-7d15e69853c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:21:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "afd473af-fc47-4f57-a5c4-7d15e69853c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:21:00 user nova-compute[74669]: DEBUG nova.compute.manager [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:21:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:21:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:21:00 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:21:00 user nova-compute[74669]: INFO nova.compute.claims [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Claim successful on node user
Nov 08 17:21:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:01 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:21:01 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:21:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:21:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:21:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:21:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:21:01 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:21:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:21:01 user nova-compute[74669]: DEBUG nova.policy [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26fd2f7b974d4124b4cea209564f74f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d5ac18a2e9447e8dda89acddd7a7d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:21:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:21:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:21:01 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Creating image(s)
Nov 08 17:21:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Acquiring lock "/opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:21:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "/opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:21:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "/opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:21:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:21:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.175s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:21:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:21:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:21:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:21:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.177s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:21:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:21:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk 1073741824" returned: 0 in 0.052s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:21:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:21:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:21:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Successfully created port: a86f59d3-672e-46b9-8787-8a1be203a52c {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:21:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.170s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:21:02 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Checking if we can resize image /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:21:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:21:02 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:21:02 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Cannot resize image /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:21:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:21:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Ensure instance console log exists: /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:21:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:21:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:21:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:21:02 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Successfully updated port: a86f59d3-672e-46b9-8787-8a1be203a52c {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:21:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Acquiring lock "refresh_cache-afd473af-fc47-4f57-a5c4-7d15e69853c9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:21:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Acquired lock "refresh_cache-afd473af-fc47-4f57-a5c4-7d15e69853c9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:21:02 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:21:02 user nova-compute[74669]: DEBUG nova.compute.manager [req-991c53bc-8170-4f02-a232-4bd387334f52 req-44c599b5-ba2d-4349-8cb0-6b571d86b461 service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Received event network-changed-a86f59d3-672e-46b9-8787-8a1be203a52c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:21:02 user nova-compute[74669]: DEBUG nova.compute.manager [req-991c53bc-8170-4f02-a232-4bd387334f52 req-44c599b5-ba2d-4349-8cb0-6b571d86b461 service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Refreshing instance network info cache due to event network-changed-a86f59d3-672e-46b9-8787-8a1be203a52c. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:21:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-991c53bc-8170-4f02-a232-4bd387334f52 req-44c599b5-ba2d-4349-8cb0-6b571d86b461 service nova] Acquiring lock "refresh_cache-afd473af-fc47-4f57-a5c4-7d15e69853c9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:21:02 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:21:02 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.network.neutron [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Updating instance_info_cache with network_info: [{"id": "a86f59d3-672e-46b9-8787-8a1be203a52c", "address": "fa:16:3e:6d:94:eb", "network": {"id": "f81ae412-3eca-4d8e-ada6-ce522168ff50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-127420871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d5ac18a2e9447e8dda89acddd7a7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa86f59d3-67", "ovs_interfaceid": "a86f59d3-672e-46b9-8787-8a1be203a52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Releasing lock "refresh_cache-afd473af-fc47-4f57-a5c4-7d15e69853c9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.compute.manager [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Instance network_info: |[{"id": "a86f59d3-672e-46b9-8787-8a1be203a52c", "address": "fa:16:3e:6d:94:eb", "network": {"id": "f81ae412-3eca-4d8e-ada6-ce522168ff50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-127420871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d5ac18a2e9447e8dda89acddd7a7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa86f59d3-67", "ovs_interfaceid": "a86f59d3-672e-46b9-8787-8a1be203a52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-991c53bc-8170-4f02-a232-4bd387334f52 req-44c599b5-ba2d-4349-8cb0-6b571d86b461 service nova] Acquired lock "refresh_cache-afd473af-fc47-4f57-a5c4-7d15e69853c9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.network.neutron [req-991c53bc-8170-4f02-a232-4bd387334f52 req-44c599b5-ba2d-4349-8cb0-6b571d86b461 service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Refreshing network info cache for port a86f59d3-672e-46b9-8787-8a1be203a52c {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Start _get_guest_xml network_info=[{"id": "a86f59d3-672e-46b9-8787-8a1be203a52c", "address": "fa:16:3e:6d:94:eb", "network": {"id": "f81ae412-3eca-4d8e-ada6-ce522168ff50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-127420871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d5ac18a2e9447e8dda89acddd7a7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa86f59d3-67", "ovs_interfaceid": "a86f59d3-672e-46b9-8787-8a1be203a52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:21:03 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:21:03 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:21:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1326124448',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1326124448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1326124',id=39,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvuaJsffeP6U4PyVJA2ZkbH5Bi10qsHbJWO1xBjKQe1FklxmgG7v1gZRX9r5gJ1+EK6wrONlXhI2dmQ361JFJGejywxzdkPnoPxXIifFaBAh8gqw0Wk9eiq6ddF+oxwQQ==',key_name='tempest-keypair-1158367944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36d5ac18a2e9447e8dda89acddd7a7d3',ramdisk_id='',reservation_id='r-uv0fhxtk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-881785813',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:21:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26fd2f7b974d4124b4cea209564f74f2',uuid=afd473af-fc47-4f57-a5c4-7d15e69853c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a86f59d3-672e-46b9-8787-8a1be203a52c", "address": "fa:16:3e:6d:94:eb", "network": {"id": "f81ae412-3eca-4d8e-ada6-ce522168ff50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-127420871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d5ac18a2e9447e8dda89acddd7a7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa86f59d3-67", "ovs_interfaceid": "a86f59d3-672e-46b9-8787-8a1be203a52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Converting VIF {"id": "a86f59d3-672e-46b9-8787-8a1be203a52c", "address": "fa:16:3e:6d:94:eb", "network": {"id": "f81ae412-3eca-4d8e-ada6-ce522168ff50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-127420871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d5ac18a2e9447e8dda89acddd7a7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa86f59d3-67", "ovs_interfaceid": "a86f59d3-672e-46b9-8787-8a1be203a52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:94:eb,bridge_name='br-int',has_traffic_filtering=True,id=a86f59d3-672e-46b9-8787-8a1be203a52c,network=Network(f81ae412-3eca-4d8e-ada6-ce522168ff50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa86f59d3-67') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.objects.instance [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lazy-loading 'pci_devices' on Instance uuid afd473af-fc47-4f57-a5c4-7d15e69853c9 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:21:03 user nova-compute[74669]:   <uuid>afd473af-fc47-4f57-a5c4-7d15e69853c9</uuid>
Nov 08 17:21:03 user nova-compute[74669]:   <name>instance-00000027</name>
Nov 08 17:21:03 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:21:03 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:21:03 user nova-compute[74669]:   <metadata>
Nov 08 17:21:03 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:21:03 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:21:03 user nova-compute[74669]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1326124448</nova:name>
Nov 08 17:21:03 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:21:03</nova:creationTime>
Nov 08 17:21:03 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:21:03 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:21:03 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:21:03 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:21:03 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:21:03 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:21:03 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:21:03 user nova-compute[74669]:       <nova:owner>
Nov 08 17:21:03 user nova-compute[74669]:         <nova:user uuid="26fd2f7b974d4124b4cea209564f74f2">tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member</nova:user>
Nov 08 17:21:03 user nova-compute[74669]:         <nova:project uuid="36d5ac18a2e9447e8dda89acddd7a7d3">tempest-TestServerVolumeAttachScenarioOldVersion-881785813</nova:project>
Nov 08 17:21:03 user nova-compute[74669]:       </nova:owner>
Nov 08 17:21:03 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:21:03 user nova-compute[74669]:       <nova:ports>
Nov 08 17:21:03 user nova-compute[74669]:         <nova:port uuid="a86f59d3-672e-46b9-8787-8a1be203a52c">
Nov 08 17:21:03 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 17:21:03 user nova-compute[74669]:         </nova:port>
Nov 08 17:21:03 user nova-compute[74669]:       </nova:ports>
Nov 08 17:21:03 user nova-compute[74669]:     </nova:instance>
Nov 08 17:21:03 user nova-compute[74669]:   </metadata>
Nov 08 17:21:03 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:21:03 user nova-compute[74669]:     <system>
Nov 08 17:21:03 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:21:03 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:21:03 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:21:03 user nova-compute[74669]:       <entry name="serial">afd473af-fc47-4f57-a5c4-7d15e69853c9</entry>
Nov 08 17:21:03 user nova-compute[74669]:       <entry name="uuid">afd473af-fc47-4f57-a5c4-7d15e69853c9</entry>
Nov 08 17:21:03 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:21:03 user nova-compute[74669]:     </system>
Nov 08 17:21:03 user nova-compute[74669]:   </sysinfo>
Nov 08 17:21:03 user nova-compute[74669]:   <os>
Nov 08 17:21:03 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:21:03 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:21:03 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:21:03 user nova-compute[74669]:   </os>
Nov 08 17:21:03 user nova-compute[74669]:   <features>
Nov 08 17:21:03 user nova-compute[74669]:     <acpi/>
Nov 08 17:21:03 user nova-compute[74669]:     <apic/>
Nov 08 17:21:03 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:21:03 user nova-compute[74669]:   </features>
Nov 08 17:21:03 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:21:03 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:21:03 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:21:03 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:21:03 user nova-compute[74669]:   </clock>
Nov 08 17:21:03 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:21:03 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:21:03 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:21:03 user nova-compute[74669]:   </cpu>
Nov 08 17:21:03 user nova-compute[74669]:   <devices>
Nov 08 17:21:03 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:21:03 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:21:03 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk"/>
Nov 08 17:21:03 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:21:03 user nova-compute[74669]:     </disk>
Nov 08 17:21:03 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:21:03 user nova-compute[74669]:       <mac address="fa:16:3e:6d:94:eb"/>
Nov 08 17:21:03 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:21:03 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:21:03 user nova-compute[74669]:       <target dev="tapa86f59d3-67"/>
Nov 08 17:21:03 user nova-compute[74669]:     </interface>
Nov 08 17:21:03 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:21:03 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/console.log" append="off"/>
Nov 08 17:21:03 user nova-compute[74669]:     </serial>
Nov 08 17:21:03 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:21:03 user nova-compute[74669]:     <video>
Nov 08 17:21:03 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:21:03 user nova-compute[74669]:     </video>
Nov 08 17:21:03 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:21:03 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:21:03 user nova-compute[74669]:     </rng>
Nov 08 17:21:03 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:21:03 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:21:03 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:21:03 user nova-compute[74669]:     </memballoon>
Nov 08 17:21:03 user nova-compute[74669]:   </devices>
Nov 08 17:21:03 user nova-compute[74669]: </domain>
Nov 08 17:21:03 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:21:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1326124448',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1326124448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1326124',id=39,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvuaJsffeP6U4PyVJA2ZkbH5Bi10qsHbJWO1xBjKQe1FklxmgG7v1gZRX9r5gJ1+EK6wrONlXhI2dmQ361JFJGejywxzdkPnoPxXIifFaBAh8gqw0Wk9eiq6ddF+oxwQQ==',key_name='tempest-keypair-1158367944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36d5ac18a2e9447e8dda89acddd7a7d3',ramdisk_id='',reservation_id='r-uv0fhxtk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-881785813',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:21:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26fd2f7b974d4124b4cea209564f74f2',uuid=afd473af-fc47-4f57-a5c4-7d15e69853c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a86f59d3-672e-46b9-8787-8a1be203a52c", "address": "fa:16:3e:6d:94:eb", "network": {"id": "f81ae412-3eca-4d8e-ada6-ce522168ff50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-127420871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d5ac18a2e9447e8dda89acddd7a7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa86f59d3-67", "ovs_interfaceid": "a86f59d3-672e-46b9-8787-8a1be203a52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Converting VIF {"id": "a86f59d3-672e-46b9-8787-8a1be203a52c", "address": "fa:16:3e:6d:94:eb", "network": {"id": "f81ae412-3eca-4d8e-ada6-ce522168ff50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-127420871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d5ac18a2e9447e8dda89acddd7a7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa86f59d3-67", "ovs_interfaceid": "a86f59d3-672e-46b9-8787-8a1be203a52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:94:eb,bridge_name='br-int',has_traffic_filtering=True,id=a86f59d3-672e-46b9-8787-8a1be203a52c,network=Network(f81ae412-3eca-4d8e-ada6-ce522168ff50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa86f59d3-67') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG os_vif [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:94:eb,bridge_name='br-int',has_traffic_filtering=True,id=a86f59d3-672e-46b9-8787-8a1be203a52c,network=Network(f81ae412-3eca-4d8e-ada6-ce522168ff50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa86f59d3-67') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'adb3fb6f-7572-5baf-bea4-e0056bec508e', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa86f59d3-67, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa86f59d3-67, col_values=(('qos', UUID('f53afb6e-25ab-4d11-9910-9663c44f2be0')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa86f59d3-67, col_values=(('external_ids', {'iface-id': 'a86f59d3-672e-46b9-8787-8a1be203a52c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:94:eb', 'vm-uuid': 'afd473af-fc47-4f57-a5c4-7d15e69853c9'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:03 user nova-compute[74669]: INFO os_vif [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:94:eb,bridge_name='br-int',has_traffic_filtering=True,id=a86f59d3-672e-46b9-8787-8a1be203a52c,network=Network(f81ae412-3eca-4d8e-ada6-ce522168ff50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa86f59d3-67')
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] No VIF found with MAC fa:16:3e:6d:94:eb, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.network.neutron [req-991c53bc-8170-4f02-a232-4bd387334f52 req-44c599b5-ba2d-4349-8cb0-6b571d86b461 service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Updated VIF entry in instance network info cache for port a86f59d3-672e-46b9-8787-8a1be203a52c. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG nova.network.neutron [req-991c53bc-8170-4f02-a232-4bd387334f52 req-44c599b5-ba2d-4349-8cb0-6b571d86b461 service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Updating instance_info_cache with network_info: [{"id": "a86f59d3-672e-46b9-8787-8a1be203a52c", "address": "fa:16:3e:6d:94:eb", "network": {"id": "f81ae412-3eca-4d8e-ada6-ce522168ff50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-127420871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d5ac18a2e9447e8dda89acddd7a7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa86f59d3-67", "ovs_interfaceid": "a86f59d3-672e-46b9-8787-8a1be203a52c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:21:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-991c53bc-8170-4f02-a232-4bd387334f52 req-44c599b5-ba2d-4349-8cb0-6b571d86b461 service nova] Releasing lock "refresh_cache-afd473af-fc47-4f57-a5c4-7d15e69853c9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:21:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:04 user nova-compute[74669]: DEBUG nova.compute.manager [req-84f29c7f-ae7a-43a9-8693-fdb80a0a3048 req-37985cd9-5d7b-43f2-a589-1d3ad905de27 service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Received event network-vif-plugged-a86f59d3-672e-46b9-8787-8a1be203a52c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:21:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-84f29c7f-ae7a-43a9-8693-fdb80a0a3048 req-37985cd9-5d7b-43f2-a589-1d3ad905de27 service nova] Acquiring lock "afd473af-fc47-4f57-a5c4-7d15e69853c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:21:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-84f29c7f-ae7a-43a9-8693-fdb80a0a3048 req-37985cd9-5d7b-43f2-a589-1d3ad905de27 service nova] Lock "afd473af-fc47-4f57-a5c4-7d15e69853c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:21:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-84f29c7f-ae7a-43a9-8693-fdb80a0a3048 req-37985cd9-5d7b-43f2-a589-1d3ad905de27 service nova] Lock "afd473af-fc47-4f57-a5c4-7d15e69853c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:21:04 user nova-compute[74669]: DEBUG nova.compute.manager [req-84f29c7f-ae7a-43a9-8693-fdb80a0a3048 req-37985cd9-5d7b-43f2-a589-1d3ad905de27 service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] No waiting events found dispatching network-vif-plugged-a86f59d3-672e-46b9-8787-8a1be203a52c {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:21:04 user nova-compute[74669]: WARNING nova.compute.manager [req-84f29c7f-ae7a-43a9-8693-fdb80a0a3048 req-37985cd9-5d7b-43f2-a589-1d3ad905de27 service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Received unexpected event network-vif-plugged-a86f59d3-672e-46b9-8787-8a1be203a52c for instance with vm_state building and task_state spawning.
Nov 08 17:21:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:06 user nova-compute[74669]: DEBUG nova.compute.manager [req-d6101208-9e96-434b-9df2-eeae9397997a req-263b2fef-3f78-4996-8fcc-c0fe75281a6c service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Received event network-vif-plugged-a86f59d3-672e-46b9-8787-8a1be203a52c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:21:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d6101208-9e96-434b-9df2-eeae9397997a req-263b2fef-3f78-4996-8fcc-c0fe75281a6c service nova] Acquiring lock "afd473af-fc47-4f57-a5c4-7d15e69853c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:21:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d6101208-9e96-434b-9df2-eeae9397997a req-263b2fef-3f78-4996-8fcc-c0fe75281a6c service nova] Lock "afd473af-fc47-4f57-a5c4-7d15e69853c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:21:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d6101208-9e96-434b-9df2-eeae9397997a req-263b2fef-3f78-4996-8fcc-c0fe75281a6c service nova] Lock "afd473af-fc47-4f57-a5c4-7d15e69853c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:21:06 user nova-compute[74669]: DEBUG nova.compute.manager [req-d6101208-9e96-434b-9df2-eeae9397997a req-263b2fef-3f78-4996-8fcc-c0fe75281a6c service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] No waiting events found dispatching network-vif-plugged-a86f59d3-672e-46b9-8787-8a1be203a52c {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:21:06 user nova-compute[74669]: WARNING nova.compute.manager [req-d6101208-9e96-434b-9df2-eeae9397997a req-263b2fef-3f78-4996-8fcc-c0fe75281a6c service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Received unexpected event network-vif-plugged-a86f59d3-672e-46b9-8787-8a1be203a52c for instance with vm_state building and task_state spawning.
Nov 08 17:21:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:21:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:21:06 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Instance spawned successfully.
Nov 08 17:21:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:21:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:21:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:21:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:21:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:21:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:21:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:21:07 user nova-compute[74669]: INFO nova.compute.manager [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 08 17:21:07 user nova-compute[74669]: DEBUG nova.compute.manager [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:21:07 user nova-compute[74669]: INFO nova.compute.manager [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Took 6.25 seconds to build instance.
Nov 08 17:21:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-3f22b158-2e87-4728-adfa-bb2274a468f5 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "afd473af-fc47-4f57-a5c4-7d15e69853c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.356s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:21:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:08 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:21:08 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:21:08 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Didn't find any instances for network info cache update. {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 17:21:08 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:21:08 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:21:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:09 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:21:11 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:21:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:21:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:21:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:21:11 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:21:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:21:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:21:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:21:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:21:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:21:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:21:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:21:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:21:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:21:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:21:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:21:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:21:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:13 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:21:13 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:21:13 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8606MB free_disk=25.26767349243164GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:21:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:21:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:21:13 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2980b0f6-162c-47a9-8c10-198a39f7b5db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:21:13 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0796133c-71d6-4d64-94af-49028a6603ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:21:13 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance afd473af-fc47-4f57-a5c4-7d15e69853c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:21:13 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:21:13 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:21:13 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:21:13 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:21:13 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:21:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:21:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:14 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:21:14 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:21:14 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:21:15 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:21:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "50512aed-fdc6-43f3-9666-545c0c62307a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:21:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "50512aed-fdc6-43f3-9666-545c0c62307a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:21:18 user nova-compute[74669]: DEBUG nova.compute.manager [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:21:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:21:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:21:18 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:21:18 user nova-compute[74669]: INFO nova.compute.claims [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Claim successful on node user
Nov 08 17:21:19 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:21:19 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:21:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.257s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:21:19 user nova-compute[74669]: DEBUG nova.compute.manager [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:21:19 user nova-compute[74669]: DEBUG nova.compute.manager [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:21:19 user nova-compute[74669]: DEBUG nova.network.neutron [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:21:19 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:21:19 user nova-compute[74669]: DEBUG nova.compute.manager [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:21:19 user nova-compute[74669]: DEBUG nova.policy [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '565488b722e44809a7cff5e617daae84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58f78f65e774cf78ca0c49aa11f9b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:21:19 user nova-compute[74669]: DEBUG nova.compute.manager [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:21:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:21:19 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Creating image(s)
Nov 08 17:21:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "/opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:21:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "/opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:21:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "/opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:21:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:21:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.181s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:21:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:21:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:21:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:21:19 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:21:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.193s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:21:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:21:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/disk 1073741824" returned: 0 in 0.053s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:21:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:21:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:21:20 user nova-compute[74669]: DEBUG nova.network.neutron [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Successfully created port: 04d22c46-f5a5-46c4-95bd-6b389bb0f6fe {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:21:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.188s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:21:20 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:21:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:21:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:21:20 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Cannot resize image /opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:21:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:21:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Ensure instance console log exists: /opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:21:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:21:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:21:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:21:20 user nova-compute[74669]: DEBUG nova.network.neutron [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Successfully updated port: 04d22c46-f5a5-46c4-95bd-6b389bb0f6fe {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:21:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "refresh_cache-50512aed-fdc6-43f3-9666-545c0c62307a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:21:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquired lock "refresh_cache-50512aed-fdc6-43f3-9666-545c0c62307a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:21:20 user nova-compute[74669]: DEBUG nova.network.neutron [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:21:20 user nova-compute[74669]: DEBUG nova.compute.manager [req-a6b25a9c-4690-420e-8516-aef411215bf6 req-e955ded7-6b58-44d0-b6df-f1d7e7c7ce7a service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Received event network-changed-04d22c46-f5a5-46c4-95bd-6b389bb0f6fe {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:21:20 user nova-compute[74669]: DEBUG nova.compute.manager [req-a6b25a9c-4690-420e-8516-aef411215bf6 req-e955ded7-6b58-44d0-b6df-f1d7e7c7ce7a service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Refreshing instance network info cache due to event network-changed-04d22c46-f5a5-46c4-95bd-6b389bb0f6fe. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:21:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a6b25a9c-4690-420e-8516-aef411215bf6 req-e955ded7-6b58-44d0-b6df-f1d7e7c7ce7a service nova] Acquiring lock "refresh_cache-50512aed-fdc6-43f3-9666-545c0c62307a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:21:20 user nova-compute[74669]: DEBUG nova.network.neutron [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.network.neutron [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Updating instance_info_cache with network_info: [{"id": "04d22c46-f5a5-46c4-95bd-6b389bb0f6fe", "address": "fa:16:3e:7e:28:f6", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d22c46-f5", "ovs_interfaceid": "04d22c46-f5a5-46c4-95bd-6b389bb0f6fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Releasing lock "refresh_cache-50512aed-fdc6-43f3-9666-545c0c62307a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.compute.manager [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Instance network_info: |[{"id": "04d22c46-f5a5-46c4-95bd-6b389bb0f6fe", "address": "fa:16:3e:7e:28:f6", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d22c46-f5", "ovs_interfaceid": "04d22c46-f5a5-46c4-95bd-6b389bb0f6fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a6b25a9c-4690-420e-8516-aef411215bf6 req-e955ded7-6b58-44d0-b6df-f1d7e7c7ce7a service nova] Acquired lock "refresh_cache-50512aed-fdc6-43f3-9666-545c0c62307a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.network.neutron [req-a6b25a9c-4690-420e-8516-aef411215bf6 req-e955ded7-6b58-44d0-b6df-f1d7e7c7ce7a service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Refreshing network info cache for port 04d22c46-f5a5-46c4-95bd-6b389bb0f6fe {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Start _get_guest_xml network_info=[{"id": "04d22c46-f5a5-46c4-95bd-6b389bb0f6fe", "address": "fa:16:3e:7e:28:f6", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d22c46-f5", "ovs_interfaceid": "04d22c46-f5a5-46c4-95bd-6b389bb0f6fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:21:21 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:21:21 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:21:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-551419322',display_name='tempest-AttachVolumeNegativeTest-server-551419322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-551419322',id=40,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXHgbwwEEi8dpyfztjZPuukzYWaK6gFRPfXdfFbTA3g80z/vtgTZ7SnwW4WD/xvnB1t8o1xXUJMmCD9J9056+8aDtTPaTP/e010Nw8GVs1VcRkOOuD9gPuVUBYSliU/Qg==',key_name='tempest-keypair-322385864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f58f78f65e774cf78ca0c49aa11f9b54',ramdisk_id='',reservation_id='r-46u73ljh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1846694333',owner_user_name='tempest-AttachVolumeNegativeTest-1846694333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:21:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='565488b722e44809a7cff5e617daae84',uuid=50512aed-fdc6-43f3-9666-545c0c62307a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04d22c46-f5a5-46c4-95bd-6b389bb0f6fe", "address": "fa:16:3e:7e:28:f6", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d22c46-f5", "ovs_interfaceid": "04d22c46-f5a5-46c4-95bd-6b389bb0f6fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converting VIF {"id": "04d22c46-f5a5-46c4-95bd-6b389bb0f6fe", "address": "fa:16:3e:7e:28:f6", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d22c46-f5", "ovs_interfaceid": "04d22c46-f5a5-46c4-95bd-6b389bb0f6fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:28:f6,bridge_name='br-int',has_traffic_filtering=True,id=04d22c46-f5a5-46c4-95bd-6b389bb0f6fe,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d22c46-f5') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.objects.instance [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lazy-loading 'pci_devices' on Instance uuid 50512aed-fdc6-43f3-9666-545c0c62307a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:21:21 user nova-compute[74669]:   <uuid>50512aed-fdc6-43f3-9666-545c0c62307a</uuid>
Nov 08 17:21:21 user nova-compute[74669]:   <name>instance-00000028</name>
Nov 08 17:21:21 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:21:21 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:21:21 user nova-compute[74669]:   <metadata>
Nov 08 17:21:21 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:21:21 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:21:21 user nova-compute[74669]:       <nova:name>tempest-AttachVolumeNegativeTest-server-551419322</nova:name>
Nov 08 17:21:21 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:21:21</nova:creationTime>
Nov 08 17:21:21 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:21:21 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:21:21 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:21:21 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:21:21 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:21:21 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:21:21 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:21:21 user nova-compute[74669]:       <nova:owner>
Nov 08 17:21:21 user nova-compute[74669]:         <nova:user uuid="565488b722e44809a7cff5e617daae84">tempest-AttachVolumeNegativeTest-1846694333-project-member</nova:user>
Nov 08 17:21:21 user nova-compute[74669]:         <nova:project uuid="f58f78f65e774cf78ca0c49aa11f9b54">tempest-AttachVolumeNegativeTest-1846694333</nova:project>
Nov 08 17:21:21 user nova-compute[74669]:       </nova:owner>
Nov 08 17:21:21 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:21:21 user nova-compute[74669]:       <nova:ports>
Nov 08 17:21:21 user nova-compute[74669]:         <nova:port uuid="04d22c46-f5a5-46c4-95bd-6b389bb0f6fe">
Nov 08 17:21:21 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 17:21:21 user nova-compute[74669]:         </nova:port>
Nov 08 17:21:21 user nova-compute[74669]:       </nova:ports>
Nov 08 17:21:21 user nova-compute[74669]:     </nova:instance>
Nov 08 17:21:21 user nova-compute[74669]:   </metadata>
Nov 08 17:21:21 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:21:21 user nova-compute[74669]:     <system>
Nov 08 17:21:21 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:21:21 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:21:21 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:21:21 user nova-compute[74669]:       <entry name="serial">50512aed-fdc6-43f3-9666-545c0c62307a</entry>
Nov 08 17:21:21 user nova-compute[74669]:       <entry name="uuid">50512aed-fdc6-43f3-9666-545c0c62307a</entry>
Nov 08 17:21:21 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:21:21 user nova-compute[74669]:     </system>
Nov 08 17:21:21 user nova-compute[74669]:   </sysinfo>
Nov 08 17:21:21 user nova-compute[74669]:   <os>
Nov 08 17:21:21 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:21:21 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:21:21 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:21:21 user nova-compute[74669]:   </os>
Nov 08 17:21:21 user nova-compute[74669]:   <features>
Nov 08 17:21:21 user nova-compute[74669]:     <acpi/>
Nov 08 17:21:21 user nova-compute[74669]:     <apic/>
Nov 08 17:21:21 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:21:21 user nova-compute[74669]:   </features>
Nov 08 17:21:21 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:21:21 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:21:21 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:21:21 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:21:21 user nova-compute[74669]:   </clock>
Nov 08 17:21:21 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:21:21 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:21:21 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:21:21 user nova-compute[74669]:   </cpu>
Nov 08 17:21:21 user nova-compute[74669]:   <devices>
Nov 08 17:21:21 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:21:21 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:21:21 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/disk"/>
Nov 08 17:21:21 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:21:21 user nova-compute[74669]:     </disk>
Nov 08 17:21:21 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:21:21 user nova-compute[74669]:       <mac address="fa:16:3e:7e:28:f6"/>
Nov 08 17:21:21 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:21:21 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:21:21 user nova-compute[74669]:       <target dev="tap04d22c46-f5"/>
Nov 08 17:21:21 user nova-compute[74669]:     </interface>
Nov 08 17:21:21 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:21:21 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/console.log" append="off"/>
Nov 08 17:21:21 user nova-compute[74669]:     </serial>
Nov 08 17:21:21 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:21:21 user nova-compute[74669]:     <video>
Nov 08 17:21:21 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:21:21 user nova-compute[74669]:     </video>
Nov 08 17:21:21 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:21:21 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:21:21 user nova-compute[74669]:     </rng>
Nov 08 17:21:21 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:21:21 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:21:21 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:21:21 user nova-compute[74669]:     </memballoon>
Nov 08 17:21:21 user nova-compute[74669]:   </devices>
Nov 08 17:21:21 user nova-compute[74669]: </domain>
Nov 08 17:21:21 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:21:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-551419322',display_name='tempest-AttachVolumeNegativeTest-server-551419322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-551419322',id=40,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXHgbwwEEi8dpyfztjZPuukzYWaK6gFRPfXdfFbTA3g80z/vtgTZ7SnwW4WD/xvnB1t8o1xXUJMmCD9J9056+8aDtTPaTP/e010Nw8GVs1VcRkOOuD9gPuVUBYSliU/Qg==',key_name='tempest-keypair-322385864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f58f78f65e774cf78ca0c49aa11f9b54',ramdisk_id='',reservation_id='r-46u73ljh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1846694333',owner_user_name='tempest-AttachVolumeNegativeTest-1846694333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:21:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='565488b722e44809a7cff5e617daae84',uuid=50512aed-fdc6-43f3-9666-545c0c62307a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04d22c46-f5a5-46c4-95bd-6b389bb0f6fe", "address": "fa:16:3e:7e:28:f6", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d22c46-f5", "ovs_interfaceid": "04d22c46-f5a5-46c4-95bd-6b389bb0f6fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converting VIF {"id": "04d22c46-f5a5-46c4-95bd-6b389bb0f6fe", "address": "fa:16:3e:7e:28:f6", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d22c46-f5", "ovs_interfaceid": "04d22c46-f5a5-46c4-95bd-6b389bb0f6fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:28:f6,bridge_name='br-int',has_traffic_filtering=True,id=04d22c46-f5a5-46c4-95bd-6b389bb0f6fe,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d22c46-f5') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG os_vif [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:28:f6,bridge_name='br-int',has_traffic_filtering=True,id=04d22c46-f5a5-46c4-95bd-6b389bb0f6fe,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d22c46-f5') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5859b0f7-9f51-5d71-b56e-9ee1b4b05a13', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04d22c46-f5, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04d22c46-f5, col_values=(('qos', UUID('7b09987d-37ba-4a29-bd3c-36d0af823b6f')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04d22c46-f5, col_values=(('external_ids', {'iface-id': '04d22c46-f5a5-46c4-95bd-6b389bb0f6fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:28:f6', 'vm-uuid': '50512aed-fdc6-43f3-9666-545c0c62307a'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:21 user nova-compute[74669]: INFO os_vif [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:28:f6,bridge_name='br-int',has_traffic_filtering=True,id=04d22c46-f5a5-46c4-95bd-6b389bb0f6fe,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d22c46-f5')
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] No VIF found with MAC fa:16:3e:7e:28:f6, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.network.neutron [req-a6b25a9c-4690-420e-8516-aef411215bf6 req-e955ded7-6b58-44d0-b6df-f1d7e7c7ce7a service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Updated VIF entry in instance network info cache for port 04d22c46-f5a5-46c4-95bd-6b389bb0f6fe. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG nova.network.neutron [req-a6b25a9c-4690-420e-8516-aef411215bf6 req-e955ded7-6b58-44d0-b6df-f1d7e7c7ce7a service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Updating instance_info_cache with network_info: [{"id": "04d22c46-f5a5-46c4-95bd-6b389bb0f6fe", "address": "fa:16:3e:7e:28:f6", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d22c46-f5", "ovs_interfaceid": "04d22c46-f5a5-46c4-95bd-6b389bb0f6fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:21:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a6b25a9c-4690-420e-8516-aef411215bf6 req-e955ded7-6b58-44d0-b6df-f1d7e7c7ce7a service nova] Releasing lock "refresh_cache-50512aed-fdc6-43f3-9666-545c0c62307a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:21:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:22 user nova-compute[74669]: DEBUG nova.compute.manager [req-623eeeb8-57f5-446a-a23b-869c512266e4 req-7f8c782d-7702-4194-809c-9e9a0f4b384e service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Received event network-vif-plugged-04d22c46-f5a5-46c4-95bd-6b389bb0f6fe {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:21:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-623eeeb8-57f5-446a-a23b-869c512266e4 req-7f8c782d-7702-4194-809c-9e9a0f4b384e service nova] Acquiring lock "50512aed-fdc6-43f3-9666-545c0c62307a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:21:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-623eeeb8-57f5-446a-a23b-869c512266e4 req-7f8c782d-7702-4194-809c-9e9a0f4b384e service nova] Lock "50512aed-fdc6-43f3-9666-545c0c62307a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:21:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-623eeeb8-57f5-446a-a23b-869c512266e4 req-7f8c782d-7702-4194-809c-9e9a0f4b384e service nova] Lock "50512aed-fdc6-43f3-9666-545c0c62307a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:21:22 user nova-compute[74669]: DEBUG nova.compute.manager [req-623eeeb8-57f5-446a-a23b-869c512266e4 req-7f8c782d-7702-4194-809c-9e9a0f4b384e service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] No waiting events found dispatching network-vif-plugged-04d22c46-f5a5-46c4-95bd-6b389bb0f6fe {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:21:22 user nova-compute[74669]: WARNING nova.compute.manager [req-623eeeb8-57f5-446a-a23b-869c512266e4 req-7f8c782d-7702-4194-809c-9e9a0f4b384e service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Received unexpected event network-vif-plugged-04d22c46-f5a5-46c4-95bd-6b389bb0f6fe for instance with vm_state building and task_state spawning.
Nov 08 17:21:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:24 user nova-compute[74669]: DEBUG nova.compute.manager [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:21:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:21:24 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Instance spawned successfully.
Nov 08 17:21:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:21:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:21:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:21:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:21:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:21:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:21:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:21:24 user nova-compute[74669]: INFO nova.compute.manager [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 08 17:21:24 user nova-compute[74669]: DEBUG nova.compute.manager [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:21:24 user nova-compute[74669]: DEBUG nova.compute.manager [req-cb7558e4-66aa-4b55-99bb-e5f3242535fe req-8e17e7fb-4b79-44cd-97e0-2568a3eb8948 service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Received event network-vif-plugged-04d22c46-f5a5-46c4-95bd-6b389bb0f6fe {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:21:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-cb7558e4-66aa-4b55-99bb-e5f3242535fe req-8e17e7fb-4b79-44cd-97e0-2568a3eb8948 service nova] Acquiring lock "50512aed-fdc6-43f3-9666-545c0c62307a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:21:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-cb7558e4-66aa-4b55-99bb-e5f3242535fe req-8e17e7fb-4b79-44cd-97e0-2568a3eb8948 service nova] Lock "50512aed-fdc6-43f3-9666-545c0c62307a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:21:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-cb7558e4-66aa-4b55-99bb-e5f3242535fe req-8e17e7fb-4b79-44cd-97e0-2568a3eb8948 service nova] Lock "50512aed-fdc6-43f3-9666-545c0c62307a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:21:24 user nova-compute[74669]: DEBUG nova.compute.manager [req-cb7558e4-66aa-4b55-99bb-e5f3242535fe req-8e17e7fb-4b79-44cd-97e0-2568a3eb8948 service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] No waiting events found dispatching network-vif-plugged-04d22c46-f5a5-46c4-95bd-6b389bb0f6fe {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:21:24 user nova-compute[74669]: WARNING nova.compute.manager [req-cb7558e4-66aa-4b55-99bb-e5f3242535fe req-8e17e7fb-4b79-44cd-97e0-2568a3eb8948 service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Received unexpected event network-vif-plugged-04d22c46-f5a5-46c4-95bd-6b389bb0f6fe for instance with vm_state building and task_state spawning.
Nov 08 17:21:24 user nova-compute[74669]: INFO nova.compute.manager [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Took 6.05 seconds to build instance.
Nov 08 17:21:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-43b186ae-20a6-4a29-b3f6-b08a3613a4f5 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "50512aed-fdc6-43f3-9666-545c0c62307a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.209s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:21:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:31 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:21:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:22:03 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:22:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:08 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:22:09 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:22:09 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:22:10 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:22:10 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:22:10 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 17:22:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-2980b0f6-162c-47a9-8c10-198a39f7b5db" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:22:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-2980b0f6-162c-47a9-8c10-198a39f7b5db" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:22:10 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:22:10 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lazy-loading 'info_cache' on Instance uuid 2980b0f6-162c-47a9-8c10-198a39f7b5db {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:22:11 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Updating instance_info_cache with network_info: [{"id": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "address": "fa:16:3e:a4:7b:71", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04b94e3-d7", "ovs_interfaceid": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:22:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-2980b0f6-162c-47a9-8c10-198a39f7b5db" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:22:11 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:22:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:12 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:22:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:22:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:22:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:22:12 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:22:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:14 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:22:14 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:22:14 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8484MB free_disk=25.20926284790039GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:22:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:22:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:22:14 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2980b0f6-162c-47a9-8c10-198a39f7b5db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:22:14 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0796133c-71d6-4d64-94af-49028a6603ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:22:14 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance afd473af-fc47-4f57-a5c4-7d15e69853c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:22:14 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 50512aed-fdc6-43f3-9666-545c0c62307a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:22:14 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:22:14 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:22:14 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing inventories for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 17:22:14 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Updating ProviderTree inventory for provider ce26964b-e55b-43d2-801a-7221ff1fe64b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 17:22:14 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Updating inventory in ProviderTree for provider ce26964b-e55b-43d2-801a-7221ff1fe64b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 17:22:15 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing aggregate associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, aggregates: None {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 17:22:15 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing trait associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, traits: HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 17:22:15 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:22:15 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:22:15 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:22:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:22:15 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:22:15 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74669) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 17:22:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "2980b0f6-162c-47a9-8c10-198a39f7b5db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "2980b0f6-162c-47a9-8c10-198a39f7b5db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "2980b0f6-162c-47a9-8c10-198a39f7b5db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "2980b0f6-162c-47a9-8c10-198a39f7b5db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "2980b0f6-162c-47a9-8c10-198a39f7b5db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:22:16 user nova-compute[74669]: INFO nova.compute.manager [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Terminating instance
Nov 08 17:22:16 user nova-compute[74669]: DEBUG nova.compute.manager [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG nova.compute.manager [req-58129d0a-0b6f-4920-92f4-ca9f879bba05 req-03dbd974-d8d1-4be9-a055-846c89e2dc21 service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Received event network-vif-unplugged-b04b94e3-d7d6-4984-9cd6-9e88bf465c74 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-58129d0a-0b6f-4920-92f4-ca9f879bba05 req-03dbd974-d8d1-4be9-a055-846c89e2dc21 service nova] Acquiring lock "2980b0f6-162c-47a9-8c10-198a39f7b5db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-58129d0a-0b6f-4920-92f4-ca9f879bba05 req-03dbd974-d8d1-4be9-a055-846c89e2dc21 service nova] Lock "2980b0f6-162c-47a9-8c10-198a39f7b5db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-58129d0a-0b6f-4920-92f4-ca9f879bba05 req-03dbd974-d8d1-4be9-a055-846c89e2dc21 service nova] Lock "2980b0f6-162c-47a9-8c10-198a39f7b5db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG nova.compute.manager [req-58129d0a-0b6f-4920-92f4-ca9f879bba05 req-03dbd974-d8d1-4be9-a055-846c89e2dc21 service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] No waiting events found dispatching network-vif-unplugged-b04b94e3-d7d6-4984-9cd6-9e88bf465c74 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG nova.compute.manager [req-58129d0a-0b6f-4920-92f4-ca9f879bba05 req-03dbd974-d8d1-4be9-a055-846c89e2dc21 service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Received event network-vif-unplugged-b04b94e3-d7d6-4984-9cd6-9e88bf465c74 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:22:16 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Instance destroyed successfully.
Nov 08 17:22:16 user nova-compute[74669]: DEBUG nova.objects.instance [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lazy-loading 'resources' on Instance uuid 2980b0f6-162c-47a9-8c10-198a39f7b5db {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1443007992',display_name='tempest-VolumesSnapshotTestJSON-instance-1443007992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1443007992',id=36,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaEJJIZuosVMjTCjfdwyRNCValClguCrnQABHENXLij/AMAKyc3LVFgmsvkfBoJXahcZtnJ3nn25XZ3NJsqnuC8lq/4vHVnMD+cJyT8p3A5ojU6gz4pmmKutOJ47ND0cA==',key_name='tempest-keypair-2080375649',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:17:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f7557a75c804d1da4c2d6fea8364f6d',ramdisk_id='',reservation_id='r-hvcbrufj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-600470725',owner_user_name='tempest-VolumesSnapshotTestJSON-600470725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:17:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64378f1b06c14150b824b1c29a5430fd',uuid=2980b0f6-162c-47a9-8c10-198a39f7b5db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "address": "fa:16:3e:a4:7b:71", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04b94e3-d7", "ovs_interfaceid": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Converting VIF {"id": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "address": "fa:16:3e:a4:7b:71", "network": {"id": "284f544e-dabf-4ae2-b70c-f8ce15736863", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2061875436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7557a75c804d1da4c2d6fea8364f6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb04b94e3-d7", "ovs_interfaceid": "b04b94e3-d7d6-4984-9cd6-9e88bf465c74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:7b:71,bridge_name='br-int',has_traffic_filtering=True,id=b04b94e3-d7d6-4984-9cd6-9e88bf465c74,network=Network(284f544e-dabf-4ae2-b70c-f8ce15736863),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb04b94e3-d7') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG os_vif [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:7b:71,bridge_name='br-int',has_traffic_filtering=True,id=b04b94e3-d7d6-4984-9cd6-9e88bf465c74,network=Network(284f544e-dabf-4ae2-b70c-f8ce15736863),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb04b94e3-d7') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb04b94e3-d7, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf74d412-6d6a-4333-a5d4-81b2ac9bffae) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:22:16 user nova-compute[74669]: INFO os_vif [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:7b:71,bridge_name='br-int',has_traffic_filtering=True,id=b04b94e3-d7d6-4984-9cd6-9e88bf465c74,network=Network(284f544e-dabf-4ae2-b70c-f8ce15736863),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb04b94e3-d7')
Nov 08 17:22:16 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Deleting instance files /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db_del
Nov 08 17:22:16 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Deletion of /opt/stack/data/nova/instances/2980b0f6-162c-47a9-8c10-198a39f7b5db_del complete
Nov 08 17:22:17 user nova-compute[74669]: INFO nova.compute.manager [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 08 17:22:17 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:22:17 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:22:17 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:22:17 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:22:17 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:22:17 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Took 0.88 seconds to deallocate network for instance.
Nov 08 17:22:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-db0f852e-1618-4dd1-b1fb-52b579925b84 req-1c88a952-2e7f-4225-b0fe-278fa953e8c5 service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Received event network-vif-deleted-b04b94e3-d7d6-4984-9cd6-9e88bf465c74 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:22:17 user nova-compute[74669]: INFO nova.compute.manager [req-db0f852e-1618-4dd1-b1fb-52b579925b84 req-1c88a952-2e7f-4225-b0fe-278fa953e8c5 service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Neutron deleted interface b04b94e3-d7d6-4984-9cd6-9e88bf465c74; detaching it from the instance and deleting it from the info cache
Nov 08 17:22:17 user nova-compute[74669]: DEBUG nova.network.neutron [req-db0f852e-1618-4dd1-b1fb-52b579925b84 req-1c88a952-2e7f-4225-b0fe-278fa953e8c5 service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:22:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-db0f852e-1618-4dd1-b1fb-52b579925b84 req-1c88a952-2e7f-4225-b0fe-278fa953e8c5 service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Detach interface failed, port_id=b04b94e3-d7d6-4984-9cd6-9e88bf465c74, reason: Instance 2980b0f6-162c-47a9-8c10-198a39f7b5db could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 17:22:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:22:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:22:18 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:22:18 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:22:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:22:18 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Deleted allocations for instance 2980b0f6-162c-47a9-8c10-198a39f7b5db
Nov 08 17:22:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-7c5ee661-e4e0-4485-9026-6c304e39cc41 tempest-VolumesSnapshotTestJSON-600470725 tempest-VolumesSnapshotTestJSON-600470725-project-member] Lock "2980b0f6-162c-47a9-8c10-198a39f7b5db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.164s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:22:18 user nova-compute[74669]: DEBUG nova.compute.manager [req-3ccfd874-d878-43e2-8a2e-abec876e20f9 req-a40f21d3-4f89-4d62-9a42-467c53b6b526 service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Received event network-vif-plugged-b04b94e3-d7d6-4984-9cd6-9e88bf465c74 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:22:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3ccfd874-d878-43e2-8a2e-abec876e20f9 req-a40f21d3-4f89-4d62-9a42-467c53b6b526 service nova] Acquiring lock "2980b0f6-162c-47a9-8c10-198a39f7b5db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:22:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3ccfd874-d878-43e2-8a2e-abec876e20f9 req-a40f21d3-4f89-4d62-9a42-467c53b6b526 service nova] Lock "2980b0f6-162c-47a9-8c10-198a39f7b5db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:22:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3ccfd874-d878-43e2-8a2e-abec876e20f9 req-a40f21d3-4f89-4d62-9a42-467c53b6b526 service nova] Lock "2980b0f6-162c-47a9-8c10-198a39f7b5db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:22:18 user nova-compute[74669]: DEBUG nova.compute.manager [req-3ccfd874-d878-43e2-8a2e-abec876e20f9 req-a40f21d3-4f89-4d62-9a42-467c53b6b526 service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] No waiting events found dispatching network-vif-plugged-b04b94e3-d7d6-4984-9cd6-9e88bf465c74 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:22:18 user nova-compute[74669]: WARNING nova.compute.manager [req-3ccfd874-d878-43e2-8a2e-abec876e20f9 req-a40f21d3-4f89-4d62-9a42-467c53b6b526 service nova] [instance: 2980b0f6-162c-47a9-8c10-198a39f7b5db] Received unexpected event network-vif-plugged-b04b94e3-d7d6-4984-9cd6-9e88bf465c74 for instance with vm_state deleted and task_state None.
Nov 08 17:22:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:22 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:22:22 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 17:22:22 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] There are 0 instances to clean {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 17:22:23 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:22:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:22:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:22:25 user nova-compute[74669]: DEBUG nova.compute.manager [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:22:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:22:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:22:25 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:22:25 user nova-compute[74669]: INFO nova.compute.claims [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Claim successful on node user
Nov 08 17:22:25 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:22:25 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:22:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.257s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:22:25 user nova-compute[74669]: DEBUG nova.compute.manager [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:22:25 user nova-compute[74669]: DEBUG nova.compute.manager [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:22:25 user nova-compute[74669]: DEBUG nova.network.neutron [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:22:25 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:22:25 user nova-compute[74669]: DEBUG nova.compute.manager [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:22:25 user nova-compute[74669]: DEBUG nova.policy [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1fcd1d4cf714f62aa8648b27a04c04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08551815597744d89e3a61d190a9b8a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:22:25 user nova-compute[74669]: INFO nova.virt.block_device [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Booting with blank volume at /dev/vda
Nov 08 17:22:26 user nova-compute[74669]: DEBUG nova.network.neutron [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Successfully created port: a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:22:26 user nova-compute[74669]: DEBUG nova.network.neutron [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Successfully updated port: a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:22:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:22:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquired lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:22:26 user nova-compute[74669]: DEBUG nova.network.neutron [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:22:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-b8fce48f-61dd-4356-9315-e41fa1602f1e req-e6b46994-04df-43a7-89cc-813dd6539696 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received event network-changed-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:22:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-b8fce48f-61dd-4356-9315-e41fa1602f1e req-e6b46994-04df-43a7-89cc-813dd6539696 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Refreshing instance network info cache due to event network-changed-a4820eb9-3a23-479e-b429-47171c75f100. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:22:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b8fce48f-61dd-4356-9315-e41fa1602f1e req-e6b46994-04df-43a7-89cc-813dd6539696 service nova] Acquiring lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:22:26 user nova-compute[74669]: DEBUG nova.network.neutron [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:22:26 user nova-compute[74669]: DEBUG nova.network.neutron [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Updating instance_info_cache with network_info: [{"id": "a4820eb9-3a23-479e-b429-47171c75f100", "address": "fa:16:3e:12:b9:b1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4820eb9-3a", "ovs_interfaceid": "a4820eb9-3a23-479e-b429-47171c75f100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:22:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Releasing lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:22:26 user nova-compute[74669]: DEBUG nova.compute.manager [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Instance network_info: |[{"id": "a4820eb9-3a23-479e-b429-47171c75f100", "address": "fa:16:3e:12:b9:b1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4820eb9-3a", "ovs_interfaceid": "a4820eb9-3a23-479e-b429-47171c75f100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:22:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b8fce48f-61dd-4356-9315-e41fa1602f1e req-e6b46994-04df-43a7-89cc-813dd6539696 service nova] Acquired lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:22:26 user nova-compute[74669]: DEBUG nova.network.neutron [req-b8fce48f-61dd-4356-9315-e41fa1602f1e req-e6b46994-04df-43a7-89cc-813dd6539696 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Refreshing network info cache for port a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:22:27 user nova-compute[74669]: DEBUG nova.network.neutron [req-b8fce48f-61dd-4356-9315-e41fa1602f1e req-e6b46994-04df-43a7-89cc-813dd6539696 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Updated VIF entry in instance network info cache for port a4820eb9-3a23-479e-b429-47171c75f100. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:22:27 user nova-compute[74669]: DEBUG nova.network.neutron [req-b8fce48f-61dd-4356-9315-e41fa1602f1e req-e6b46994-04df-43a7-89cc-813dd6539696 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Updating instance_info_cache with network_info: [{"id": "a4820eb9-3a23-479e-b429-47171c75f100", "address": "fa:16:3e:12:b9:b1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4820eb9-3a", "ovs_interfaceid": "a4820eb9-3a23-479e-b429-47171c75f100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:22:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b8fce48f-61dd-4356-9315-e41fa1602f1e req-e6b46994-04df-43a7-89cc-813dd6539696 service nova] Releasing lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:22:31 user nova-compute[74669]: DEBUG os_brick.utils [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:22:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d22448f-cf6f-4c8d-9b76-451daff28eb5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:22:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e82454-d6f1-4442-8759-413762c7f7aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:22:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b14d58-b422-451a-bbbc-c6cc41401b1d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:22:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee0e550-dcaa-4b3f-9c72-a1c90d9aee4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:22:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:22:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:22:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:22:31 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:22:31 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d88adc-8a08-4f47-a27c-13d608188181]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:22:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:22:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:22:31 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:22:31 user nova-compute[74669]: DEBUG os_brick.utils [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:22:31 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Updating existing volume attachment record: 10a823e4-6424-45d4-841f-80f87645053f {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:22:31 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:22:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:22:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:51 user nova-compute[74669]: DEBUG nova.compute.manager [req-4025ada9-839a-47f4-9003-46ff81b4f7f0 req-5c10b6f2-afb1-458d-a41f-5f642d1d7359 service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Received event network-changed-a86f59d3-672e-46b9-8787-8a1be203a52c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:22:51 user nova-compute[74669]: DEBUG nova.compute.manager [req-4025ada9-839a-47f4-9003-46ff81b4f7f0 req-5c10b6f2-afb1-458d-a41f-5f642d1d7359 service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Refreshing instance network info cache due to event network-changed-a86f59d3-672e-46b9-8787-8a1be203a52c. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:22:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4025ada9-839a-47f4-9003-46ff81b4f7f0 req-5c10b6f2-afb1-458d-a41f-5f642d1d7359 service nova] Acquiring lock "refresh_cache-afd473af-fc47-4f57-a5c4-7d15e69853c9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:22:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4025ada9-839a-47f4-9003-46ff81b4f7f0 req-5c10b6f2-afb1-458d-a41f-5f642d1d7359 service nova] Acquired lock "refresh_cache-afd473af-fc47-4f57-a5c4-7d15e69853c9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:22:51 user nova-compute[74669]: DEBUG nova.network.neutron [req-4025ada9-839a-47f4-9003-46ff81b4f7f0 req-5c10b6f2-afb1-458d-a41f-5f642d1d7359 service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Refreshing network info cache for port a86f59d3-672e-46b9-8787-8a1be203a52c {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:22:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:22:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:22:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:22:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:22:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:52 user nova-compute[74669]: DEBUG nova.network.neutron [req-4025ada9-839a-47f4-9003-46ff81b4f7f0 req-5c10b6f2-afb1-458d-a41f-5f642d1d7359 service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Updated VIF entry in instance network info cache for port a86f59d3-672e-46b9-8787-8a1be203a52c. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:22:52 user nova-compute[74669]: DEBUG nova.network.neutron [req-4025ada9-839a-47f4-9003-46ff81b4f7f0 req-5c10b6f2-afb1-458d-a41f-5f642d1d7359 service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Updating instance_info_cache with network_info: [{"id": "a86f59d3-672e-46b9-8787-8a1be203a52c", "address": "fa:16:3e:6d:94:eb", "network": {"id": "f81ae412-3eca-4d8e-ada6-ce522168ff50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-127420871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d5ac18a2e9447e8dda89acddd7a7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa86f59d3-67", "ovs_interfaceid": "a86f59d3-672e-46b9-8787-8a1be203a52c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:22:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4025ada9-839a-47f4-9003-46ff81b4f7f0 req-5c10b6f2-afb1-458d-a41f-5f642d1d7359 service nova] Releasing lock "refresh_cache-afd473af-fc47-4f57-a5c4-7d15e69853c9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG nova.compute.manager [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:22:53 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Creating image(s)
Nov 08 17:22:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Did not create local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Ensure instance console log exists: /opt/stack/data/nova/instances/fa8c4d88-8b6c-4ef6-9876-62597ace9c37/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Start _get_guest_xml network_info=[{"id": "a4820eb9-3a23-479e-b429-47171c75f100", "address": "fa:16:3e:12:b9:b1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4820eb9-3a", "ovs_interfaceid": "a4820eb9-3a23-479e-b429-47171c75f100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '10a823e4-6424-45d4-841f-80f87645053f', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDbQCvMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fa8c4d88-8b6c-4ef6-9876-62597ace9c37', 'attached_at': '', 'detached_at': '', 'volume_id': '92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c', 'serial': '92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c'}, 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:22:53 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:22:53 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:22:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDbQCvMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:22:53 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:22:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:22:53 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:22:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:22:53 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:22:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[864da4cc-98f6-4238-82c3-97a59a426b0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:22:53 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9970aae5-abe4-423d-8258-bd91dd4b2289]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c] added
Nov 08 17:22:53 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[378cd4e8-9818-4074-9ee3-21cd3146e270]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3a6f69-643b-44fa-b325-3f363accdd07]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WDbQCvMA {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WDbQCvMA" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba6897e-f333-45fe-84e7-5ef88a2b4a4d]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WDbQCvMA'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0462bb8-90fd-4628-b9de-468b98a3b7d6]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:22:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d98230-09dd-4c2d-a734-2e4417e824eb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 17:22:54 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 17:22:54 user nova-compute[74669]:  {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:22:54 user nova-compute[74669]: WARNING os_brick.initiator.connectors.iscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 17:22:54 user nova-compute[74669]: 
Nov 08 17:22:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0f722f-9c53-4259-982f-6f3bf62995fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c, portal: 172.16.0.220,3260]
Nov 08 17:22:54 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c, portal: 172.16.0.220,3260] successful.
Nov 08 17:22:54 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef371670-9f41-4dca-b832-39cfaf52ea34]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcc403b-bf36-49e4-aa14-7233805b768a]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:22:54 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:22:54 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.035s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d173ff-af58-4d41-8be2-e2843f1a4bd3]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDbQCvMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:22:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26532363836396561', 'path': '/dev/sdb'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532363836396561', 'path': '/dev/sdb'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:22:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1647964349',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1647964349',id=41,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08551815597744d89e3a61d190a9b8a7',ramdisk_id='',reservation_id='r-6nt2kfv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293450045',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:22:26Z,user_data=None,user_id='b1fcd1d4cf714f62aa8648b27a04c04e',uuid=fa8c4d88-8b6c-4ef6-9876-62597ace9c37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4820eb9-3a23-479e-b429-47171c75f100", "address": "fa:16:3e:12:b9:b1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4820eb9-3a", "ovs_interfaceid": "a4820eb9-3a23-479e-b429-47171c75f100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converting VIF {"id": "a4820eb9-3a23-479e-b429-47171c75f100", "address": "fa:16:3e:12:b9:b1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4820eb9-3a", "ovs_interfaceid": "a4820eb9-3a23-479e-b429-47171c75f100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:b9:b1,bridge_name='br-int',has_traffic_filtering=True,id=a4820eb9-3a23-479e-b429-47171c75f100,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4820eb9-3a') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG nova.objects.instance [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lazy-loading 'pci_devices' on Instance uuid fa8c4d88-8b6c-4ef6-9876-62597ace9c37 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:22:55 user nova-compute[74669]:   <uuid>fa8c4d88-8b6c-4ef6-9876-62597ace9c37</uuid>
Nov 08 17:22:55 user nova-compute[74669]:   <name>instance-00000029</name>
Nov 08 17:22:55 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:22:55 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:22:55 user nova-compute[74669]:   <metadata>
Nov 08 17:22:55 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:22:55 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:22:55 user nova-compute[74669]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1647964349</nova:name>
Nov 08 17:22:55 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:22:53</nova:creationTime>
Nov 08 17:22:55 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:22:55 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:22:55 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:22:55 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:22:55 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:22:55 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:22:55 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:22:55 user nova-compute[74669]:       <nova:owner>
Nov 08 17:22:55 user nova-compute[74669]:         <nova:user uuid="b1fcd1d4cf714f62aa8648b27a04c04e">tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member</nova:user>
Nov 08 17:22:55 user nova-compute[74669]:         <nova:project uuid="08551815597744d89e3a61d190a9b8a7">tempest-ServerBootFromVolumeStableRescueTest-293450045</nova:project>
Nov 08 17:22:55 user nova-compute[74669]:       </nova:owner>
Nov 08 17:22:55 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:22:55 user nova-compute[74669]:       <nova:ports>
Nov 08 17:22:55 user nova-compute[74669]:         <nova:port uuid="a4820eb9-3a23-479e-b429-47171c75f100">
Nov 08 17:22:55 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 17:22:55 user nova-compute[74669]:         </nova:port>
Nov 08 17:22:55 user nova-compute[74669]:       </nova:ports>
Nov 08 17:22:55 user nova-compute[74669]:     </nova:instance>
Nov 08 17:22:55 user nova-compute[74669]:   </metadata>
Nov 08 17:22:55 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:22:55 user nova-compute[74669]:     <system>
Nov 08 17:22:55 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:22:55 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:22:55 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:22:55 user nova-compute[74669]:       <entry name="serial">fa8c4d88-8b6c-4ef6-9876-62597ace9c37</entry>
Nov 08 17:22:55 user nova-compute[74669]:       <entry name="uuid">fa8c4d88-8b6c-4ef6-9876-62597ace9c37</entry>
Nov 08 17:22:55 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:22:55 user nova-compute[74669]:     </system>
Nov 08 17:22:55 user nova-compute[74669]:   </sysinfo>
Nov 08 17:22:55 user nova-compute[74669]:   <os>
Nov 08 17:22:55 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:22:55 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:22:55 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:22:55 user nova-compute[74669]:   </os>
Nov 08 17:22:55 user nova-compute[74669]:   <features>
Nov 08 17:22:55 user nova-compute[74669]:     <acpi/>
Nov 08 17:22:55 user nova-compute[74669]:     <apic/>
Nov 08 17:22:55 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:22:55 user nova-compute[74669]:   </features>
Nov 08 17:22:55 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:22:55 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:22:55 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:22:55 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:22:55 user nova-compute[74669]:   </clock>
Nov 08 17:22:55 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:22:55 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:22:55 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:22:55 user nova-compute[74669]:   </cpu>
Nov 08 17:22:55 user nova-compute[74669]:   <devices>
Nov 08 17:22:55 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 17:22:55 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:22:55 user nova-compute[74669]:       <source dev="/dev/sdb"/>
Nov 08 17:22:55 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:22:55 user nova-compute[74669]:       <serial>92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c</serial>
Nov 08 17:22:55 user nova-compute[74669]:     </disk>
Nov 08 17:22:55 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:22:55 user nova-compute[74669]:       <mac address="fa:16:3e:12:b9:b1"/>
Nov 08 17:22:55 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:22:55 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:22:55 user nova-compute[74669]:       <target dev="tapa4820eb9-3a"/>
Nov 08 17:22:55 user nova-compute[74669]:     </interface>
Nov 08 17:22:55 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:22:55 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/fa8c4d88-8b6c-4ef6-9876-62597ace9c37/console.log" append="off"/>
Nov 08 17:22:55 user nova-compute[74669]:     </serial>
Nov 08 17:22:55 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:22:55 user nova-compute[74669]:     <video>
Nov 08 17:22:55 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:22:55 user nova-compute[74669]:     </video>
Nov 08 17:22:55 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:22:55 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:22:55 user nova-compute[74669]:     </rng>
Nov 08 17:22:55 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:22:55 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:22:55 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:22:55 user nova-compute[74669]:     </memballoon>
Nov 08 17:22:55 user nova-compute[74669]:   </devices>
Nov 08 17:22:55 user nova-compute[74669]: </domain>
Nov 08 17:22:55 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:22:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1647964349',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1647964349',id=41,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08551815597744d89e3a61d190a9b8a7',ramdisk_id='',reservation_id='r-6nt2kfv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293450045',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:22:26Z,user_data=None,user_id='b1fcd1d4cf714f62aa8648b27a04c04e',uuid=fa8c4d88-8b6c-4ef6-9876-62597ace9c37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4820eb9-3a23-479e-b429-47171c75f100", "address": "fa:16:3e:12:b9:b1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4820eb9-3a", "ovs_interfaceid": "a4820eb9-3a23-479e-b429-47171c75f100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converting VIF {"id": "a4820eb9-3a23-479e-b429-47171c75f100", "address": "fa:16:3e:12:b9:b1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4820eb9-3a", "ovs_interfaceid": "a4820eb9-3a23-479e-b429-47171c75f100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:b9:b1,bridge_name='br-int',has_traffic_filtering=True,id=a4820eb9-3a23-479e-b429-47171c75f100,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4820eb9-3a') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG os_vif [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:b9:b1,bridge_name='br-int',has_traffic_filtering=True,id=a4820eb9-3a23-479e-b429-47171c75f100,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4820eb9-3a') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f68f45d8-a3c1-547d-b8c3-ddde90c35b4e', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4820eb9-3a, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4820eb9-3a, col_values=(('qos', UUID('553dedd6-141e-4cf4-bfa0-63dc72efc6d5')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4820eb9-3a, col_values=(('external_ids', {'iface-id': 'a4820eb9-3a23-479e-b429-47171c75f100', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:b9:b1', 'vm-uuid': 'fa8c4d88-8b6c-4ef6-9876-62597ace9c37'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:55 user nova-compute[74669]: INFO os_vif [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:b9:b1,bridge_name='br-int',has_traffic_filtering=True,id=a4820eb9-3a23-479e-b429-47171c75f100,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4820eb9-3a')
Nov 08 17:22:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:22:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] No VIF found with MAC fa:16:3e:12:b9:b1, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:22:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:22:56 user nova-compute[74669]: DEBUG nova.compute.manager [req-22b5e4da-1cc8-4788-a515-38d1e2f5d760 req-200d5099-19c8-451a-b2e9-9eae3e4bfa04 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received event network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:22:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-22b5e4da-1cc8-4788-a515-38d1e2f5d760 req-200d5099-19c8-451a-b2e9-9eae3e4bfa04 service nova] Acquiring lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:22:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-22b5e4da-1cc8-4788-a515-38d1e2f5d760 req-200d5099-19c8-451a-b2e9-9eae3e4bfa04 service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:22:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-22b5e4da-1cc8-4788-a515-38d1e2f5d760 req-200d5099-19c8-451a-b2e9-9eae3e4bfa04 service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:22:56 user nova-compute[74669]: DEBUG nova.compute.manager [req-22b5e4da-1cc8-4788-a515-38d1e2f5d760 req-200d5099-19c8-451a-b2e9-9eae3e4bfa04 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] No waiting events found dispatching network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:22:56 user nova-compute[74669]: WARNING nova.compute.manager [req-22b5e4da-1cc8-4788-a515-38d1e2f5d760 req-200d5099-19c8-451a-b2e9-9eae3e4bfa04 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received unexpected event network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 for instance with vm_state building and task_state spawning.
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Acquiring lock "afd473af-fc47-4f57-a5c4-7d15e69853c9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "afd473af-fc47-4f57-a5c4-7d15e69853c9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG nova.objects.instance [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lazy-loading 'flavor' on Instance uuid afd473af-fc47-4f57-a5c4-7d15e69853c9 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "afd473af-fc47-4f57-a5c4-7d15e69853c9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Acquiring lock "afd473af-fc47-4f57-a5c4-7d15e69853c9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "afd473af-fc47-4f57-a5c4-7d15e69853c9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:22:58 user nova-compute[74669]: INFO nova.compute.manager [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Attaching volume 4d0f2570-30e1-48cb-adc7-33931efe2a11 to /dev/vdb
Nov 08 17:22:58 user nova-compute[74669]: DEBUG os_brick.utils [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecd44bc-af92-47ac-ac1e-4dc889c55016]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc9b323-bc78-48a7-ab54-5b36694dc58e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[32adef6b-059e-4bd5-8185-6ec7e062ba45]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5063726-bf66-48c0-bb50-0a2c00af17e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:22:58 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9d40d1-63fd-4b5f-af84-fc5bc4b63c90]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG os_brick.utils [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Updating existing volume attachment record: 18b495e7-b4ae-48cd-9709-ce1f7b55d96c {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG nova.compute.manager [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:22:58 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Instance spawned successfully.
Nov 08 17:22:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG nova.compute.manager [req-faeb21dc-64a5-4d2d-8829-aaaa9bee49d6 req-0e0de314-28e9-4ffc-a33f-90783f66783b service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received event network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-faeb21dc-64a5-4d2d-8829-aaaa9bee49d6 req-0e0de314-28e9-4ffc-a33f-90783f66783b service nova] Acquiring lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-faeb21dc-64a5-4d2d-8829-aaaa9bee49d6 req-0e0de314-28e9-4ffc-a33f-90783f66783b service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-faeb21dc-64a5-4d2d-8829-aaaa9bee49d6 req-0e0de314-28e9-4ffc-a33f-90783f66783b service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:22:58 user nova-compute[74669]: DEBUG nova.compute.manager [req-faeb21dc-64a5-4d2d-8829-aaaa9bee49d6 req-0e0de314-28e9-4ffc-a33f-90783f66783b service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] No waiting events found dispatching network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:22:58 user nova-compute[74669]: WARNING nova.compute.manager [req-faeb21dc-64a5-4d2d-8829-aaaa9bee49d6 req-0e0de314-28e9-4ffc-a33f-90783f66783b service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received unexpected event network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 for instance with vm_state building and task_state spawning.
Nov 08 17:22:58 user nova-compute[74669]: INFO nova.compute.manager [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 08 17:22:58 user nova-compute[74669]: DEBUG nova.compute.manager [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:22:59 user nova-compute[74669]: INFO nova.compute.manager [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Took 33.88 seconds to build instance.
Nov 08 17:22:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-37398db1-e053-4bcc-95c7-7b75f6acad4f tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.976s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:22:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:23:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:23:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:23:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:23:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:23:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:23:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:23:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:23:05 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:23:08 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:23:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:23:09 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:23:09 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:23:10 user nova-compute[74669]: DEBUG nova.compute.manager [req-844adde7-ff1d-48e4-8ee4-23a1133633bf req-c0015bc9-06d0-4c05-bd26-0fe31045500c service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Received event network-changed-04d22c46-f5a5-46c4-95bd-6b389bb0f6fe {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:23:10 user nova-compute[74669]: DEBUG nova.compute.manager [req-844adde7-ff1d-48e4-8ee4-23a1133633bf req-c0015bc9-06d0-4c05-bd26-0fe31045500c service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Refreshing instance network info cache due to event network-changed-04d22c46-f5a5-46c4-95bd-6b389bb0f6fe. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:23:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-844adde7-ff1d-48e4-8ee4-23a1133633bf req-c0015bc9-06d0-4c05-bd26-0fe31045500c service nova] Acquiring lock "refresh_cache-50512aed-fdc6-43f3-9666-545c0c62307a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:23:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-844adde7-ff1d-48e4-8ee4-23a1133633bf req-c0015bc9-06d0-4c05-bd26-0fe31045500c service nova] Acquired lock "refresh_cache-50512aed-fdc6-43f3-9666-545c0c62307a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:23:10 user nova-compute[74669]: DEBUG nova.network.neutron [req-844adde7-ff1d-48e4-8ee4-23a1133633bf req-c0015bc9-06d0-4c05-bd26-0fe31045500c service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Refreshing network info cache for port 04d22c46-f5a5-46c4-95bd-6b389bb0f6fe {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:23:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:23:10 user nova-compute[74669]: DEBUG nova.network.neutron [req-844adde7-ff1d-48e4-8ee4-23a1133633bf req-c0015bc9-06d0-4c05-bd26-0fe31045500c service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Updated VIF entry in instance network info cache for port 04d22c46-f5a5-46c4-95bd-6b389bb0f6fe. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:23:10 user nova-compute[74669]: DEBUG nova.network.neutron [req-844adde7-ff1d-48e4-8ee4-23a1133633bf req-c0015bc9-06d0-4c05-bd26-0fe31045500c service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Updating instance_info_cache with network_info: [{"id": "04d22c46-f5a5-46c4-95bd-6b389bb0f6fe", "address": "fa:16:3e:7e:28:f6", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d22c46-f5", "ovs_interfaceid": "04d22c46-f5a5-46c4-95bd-6b389bb0f6fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:23:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-844adde7-ff1d-48e4-8ee4-23a1133633bf req-c0015bc9-06d0-4c05-bd26-0fe31045500c service nova] Releasing lock "refresh_cache-50512aed-fdc6-43f3-9666-545c0c62307a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:23:11 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:23:11 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:23:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:23:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:23:11 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:23:12 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Updating instance_info_cache with network_info: [{"id": "1fa691c0-3473-4f34-a504-3778913558ab", "address": "fa:16:3e:2f:15:d7", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa691c0-34", "ovs_interfaceid": "1fa691c0-3473-4f34-a504-3778913558ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:23:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:23:12 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:23:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:23:14 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:23:14 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:23:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:23:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:23:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:23:14 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:23:14 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:23:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:23:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:16 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:23:16 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:23:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8544MB free_disk=25.225666046142578GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:23:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:23:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:23:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0796133c-71d6-4d64-94af-49028a6603ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:23:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance afd473af-fc47-4f57-a5c4-7d15e69853c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:23:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 50512aed-fdc6-43f3-9666-545c0c62307a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:23:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance fa8c4d88-8b6c-4ef6-9876-62597ace9c37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:23:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:23:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:23:16 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:23:16 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:23:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:23:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:23:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:23:19 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:23:19 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:23:19 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:23:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YhMRFNJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:23:21 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:23:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:23:21 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:23:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:23:21 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ec6bd6-aa4c-4f9a-b82f-1f181a6185b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:23:21 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb9fb64-5635-4348-9673-65cc908618b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11] added
Nov 08 17:23:21 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84888ae-f508-46a8-8b12-9cf836937ae6]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71c4c88-8f3c-412c-8b50-7d789b63e36e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YhMRFNJw {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YhMRFNJw" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e51edac-f443-4f69-b09d-ffbfe99a79a3]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YhMRFNJw'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a2081d-2f5b-4a03-9073-eda008de997e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef03b8c-8718-453b-af84-bcecd2411e47]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:23:21 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:23:21 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a04164-71f1-44ca-aad0-e88a2c725fde]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11, portal: 172.16.0.220,3260]
Nov 08 17:23:21 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11, portal: 172.16.0.220,3260] successful.
Nov 08 17:23:21 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.052s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c32eda3-debe-4a34-9136-e0e6d8f11344]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a25ee5-a304-496b-b866-91f84b52a9da]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:23:21 user nova-compute[74669]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 (non-flash)
Nov 08 17:23:21 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:23:21 user nova-compute[74669]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 (non-flash)
Nov 08 17:23:21 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc780cf-fb38-4b22-a613-49a8c198804e]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:21 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: None {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:23:22 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:23:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YhMRFNJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:23:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:23:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26330346133346131', 'path': '/dev/sdc'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:23:22 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330346133346131', 'path': '/dev/sdc'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:23:22 user nova-compute[74669]: DEBUG nova.objects.instance [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lazy-loading 'flavor' on Instance uuid afd473af-fc47-4f57-a5c4-7d15e69853c9 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:23:22 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 17:23:22 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:23:22 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 17:23:22 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:23:22 user nova-compute[74669]:   <serial>4d0f2570-30e1-48cb-adc7-33931efe2a11</serial>
Nov 08 17:23:22 user nova-compute[74669]: </disk>
Nov 08 17:23:22 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 17:23:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:23:22 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:23:22 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:23:22 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:23:22 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] No VIF found with MAC fa:16:3e:6d:94:eb, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:23:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c3fdfad7-f7af-4cba-9c6c-fb041debceb3 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "afd473af-fc47-4f57-a5c4-7d15e69853c9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.826s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:23:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:23:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "50512aed-fdc6-43f3-9666-545c0c62307a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:23:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "50512aed-fdc6-43f3-9666-545c0c62307a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:23:24 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lazy-loading 'flavor' on Instance uuid 50512aed-fdc6-43f3-9666-545c0c62307a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:23:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "50512aed-fdc6-43f3-9666-545c0c62307a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:23:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "50512aed-fdc6-43f3-9666-545c0c62307a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:23:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "50512aed-fdc6-43f3-9666-545c0c62307a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:23:24 user nova-compute[74669]: INFO nova.compute.manager [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Attaching volume c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e to /dev/vdb
Nov 08 17:23:24 user nova-compute[74669]: DEBUG os_brick.utils [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:23:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8888c6-0c2d-4186-bc91-8deddc1dca0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc400455-eac7-4f00-9f31-050d0f85c9f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df93e95-db8a-4280-afb7-11cda72fb96d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93b65ef-7ce5-43cb-bec0-9239619bb0f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:23:25 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:23:25 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f785d6a5-3212-4cdc-b0e3-06d53ef25b2d]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG os_brick.utils [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Updating existing volume attachment record: 4889f441-7c1b-43cc-9938-af2886a0c1c4 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Acquiring lock "afd473af-fc47-4f57-a5c4-7d15e69853c9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "afd473af-fc47-4f57-a5c4-7d15e69853c9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:23:25 user nova-compute[74669]: INFO nova.compute.manager [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Detaching volume 4d0f2570-30e1-48cb-adc7-33931efe2a11
Nov 08 17:23:25 user nova-compute[74669]: INFO nova.virt.block_device [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Attempting to driver detach volume 4d0f2570-30e1-48cb-adc7-33931efe2a11 from mountpoint /dev/vdb
Nov 08 17:23:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Attempting to detach device vdb from instance afd473af-fc47-4f57-a5c4-7d15e69853c9 from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:23:25 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:23:25 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 17:23:25 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:23:25 user nova-compute[74669]:   <serial>4d0f2570-30e1-48cb-adc7-33931efe2a11</serial>
Nov 08 17:23:25 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:23:25 user nova-compute[74669]: </disk>
Nov 08 17:23:25 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:23:25 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Successfully detached device vdb from instance afd473af-fc47-4f57-a5c4-7d15e69853c9 from the persistent domain config.
Nov 08 17:23:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance afd473af-fc47-4f57-a5c4-7d15e69853c9 from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 17:23:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:23:25 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:23:25 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 17:23:25 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:23:25 user nova-compute[74669]:   <serial>4d0f2570-30e1-48cb-adc7-33931efe2a11</serial>
Nov 08 17:23:25 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:23:25 user nova-compute[74669]: </disk>
Nov 08 17:23:25 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:23:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance afd473af-fc47-4f57-a5c4-7d15e69853c9 {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 17:23:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:23:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:23:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:23:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:23:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:23:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:23:46 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance afd473af-fc47-4f57-a5c4-7d15e69853c9 is timed out.
Nov 08 17:23:46 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Successfully detached device vdb from instance afd473af-fc47-4f57-a5c4-7d15e69853c9 from the live domain config.
Nov 08 17:23:46 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YhMRFNJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:23:46 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:23:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7e0d07-675f-4bf4-af74-2cf200c0f982]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:23:46 user nova-compute[74669]: No targets found.
Nov 08 17:23:46 user nova-compute[74669]: iSNS:
Nov 08 17:23:46 user nova-compute[74669]: No targets found.
Nov 08 17:23:46 user nova-compute[74669]: STATIC:
Nov 08 17:23:46 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11
Nov 08 17:23:46 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:23:46 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:23:46 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c
Nov 08 17:23:46 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:23:46 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:23:46 user nova-compute[74669]: FIRMWARE:
Nov 08 17:23:46 user nova-compute[74669]: No targets found.
Nov 08 17:23:46 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:23:46 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:23:46 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[da21ab87-095f-40f4-9ea5-501a574bf3a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3add7ed-86c1-47b3-820f-216cea4f2464]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:23:46 user nova-compute[74669]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 (non-flash)
Nov 08 17:23:46 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:23:46 user nova-compute[74669]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 (non-flash)
Nov 08 17:23:46 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9845b1a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11'): ({'sdc'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Removing single pathed devices sdc {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[717620c7-c615-496c-8558-4b29128a09cb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a9864a-e896-4e35-af70-d2b78841da20]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Flushing IO for device /dev/sdc {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d112d46-82da-4bff-97f4-a500897d4b32]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0393a1ec-abc3-4247-bcde-df07ffecde2c]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dcba75-9b26-450f-8ca4-d329549d9743]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[03976ddb-6da3-4fb4-a5ef-b15174d2dd3d]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11, portal: 172.16.0.220,3260]
Nov 08 17:23:46 user nova-compute[74669]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11, portal: 172.16.0.220,3260] successful.
Nov 08 17:23:46 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d0f2570-30e1-48cb-adc7-33931efe2a11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ae5a1f-49d6-4d85-bad1-cacd6a30bb08]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] <== disconnect_volume: return (300ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:23:46 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:23:47 user nova-compute[74669]: DEBUG nova.objects.instance [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lazy-loading 'flavor' on Instance uuid afd473af-fc47-4f57-a5c4-7d15e69853c9 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:23:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-72686513-593f-4b21-b4ed-b634b1944bc6 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "afd473af-fc47-4f57-a5c4-7d15e69853c9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.850s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:23:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:23:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:23:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:23:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:23:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:23:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:23:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:24:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:24:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:24:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:24:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:24:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCERfvZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:24:06 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:24:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:24:06 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:24:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:24:06 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[468b540c-d25e-4121-b060-1275044af4c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:24:06 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea3176f-dd60-4713-bade-cf87256784f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e] added
Nov 08 17:24:06 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ce96cf-1ab7-46e2-94a4-4b2beb8080c5]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e5780d-0c8f-4143-bbf1-cfdda6d0ab3b]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GCERfvZh {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GCERfvZh" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf550896-03cd-4b48-9782-c274aa5a7810]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GCERfvZh'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecfbb80-5781-4843-a8f6-53765ed2a0ee]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4f4863-a45c-40ca-ab75-5c8e08f9e353]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:24:06 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:24:06 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcb92f6-386e-412f-8463-2a7603d63c1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e, portal: 172.16.0.220,3260]
Nov 08 17:24:06 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e, portal: 172.16.0.220,3260] successful.
Nov 08 17:24:06 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f486f87-45d3-4bbc-9bc2-237633148ec2]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c236d10-0c27-412a-b695-0fa099c05c24]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:24:06 user nova-compute[74669]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e (non-flash)
Nov 08 17:24:06 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:24:06 user nova-compute[74669]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e (non-flash)
Nov 08 17:24:06 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcf4172-6022-4d9a-9f52-da7afeec3d71]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:06 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:24:07 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:24:07 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCERfvZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:24:07 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:24:07 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26135623233393634', 'path': '/dev/sdc'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:24:07 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135623233393634', 'path': '/dev/sdc'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:24:07 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lazy-loading 'flavor' on Instance uuid 50512aed-fdc6-43f3-9666-545c0c62307a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:24:07 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 17:24:07 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:24:07 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 17:24:07 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:24:07 user nova-compute[74669]:   <serial>c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e</serial>
Nov 08 17:24:07 user nova-compute[74669]: </disk>
Nov 08 17:24:07 user nova-compute[74669]:  {{(pid=74669) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 17:24:07 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:24:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:24:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:24:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] No VIF found with MAC fa:16:3e:7e:28:f6, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:24:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d5cca6f2-16b9-45c4-a97e-93e3e323b9d4 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "50512aed-fdc6-43f3-9666-545c0c62307a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.316s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:08 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:24:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "50512aed-fdc6-43f3-9666-545c0c62307a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "50512aed-fdc6-43f3-9666-545c0c62307a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:09 user nova-compute[74669]: INFO nova.compute.manager [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Detaching volume c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e
Nov 08 17:24:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:09 user nova-compute[74669]: INFO nova.virt.block_device [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Attempting to driver detach volume c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e from mountpoint /dev/vdb
Nov 08 17:24:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Attempting to detach device vdb from instance 50512aed-fdc6-43f3-9666-545c0c62307a from the persistent domain config. {{(pid=74669) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 17:24:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:24:09 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:24:09 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 17:24:09 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:24:09 user nova-compute[74669]:   <serial>c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e</serial>
Nov 08 17:24:09 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:24:09 user nova-compute[74669]: </disk>
Nov 08 17:24:09 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:24:09 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Successfully detached device vdb from instance 50512aed-fdc6-43f3-9666-545c0c62307a from the persistent domain config.
Nov 08 17:24:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 50512aed-fdc6-43f3-9666-545c0c62307a from the live domain config. {{(pid=74669) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 17:24:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 17:24:09 user nova-compute[74669]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:24:09 user nova-compute[74669]:   <source dev="/dev/sdc"/>
Nov 08 17:24:09 user nova-compute[74669]:   <target dev="vdb" bus="virtio"/>
Nov 08 17:24:09 user nova-compute[74669]:   <serial>c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e</serial>
Nov 08 17:24:09 user nova-compute[74669]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 17:24:09 user nova-compute[74669]: </disk>
Nov 08 17:24:09 user nova-compute[74669]:  {{(pid=74669) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 17:24:09 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:24:09 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 50512aed-fdc6-43f3-9666-545c0c62307a {{(pid=74669) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 17:24:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:11 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:24:13 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:24:13 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:24:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-afd473af-fc47-4f57-a5c4-7d15e69853c9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:24:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-afd473af-fc47-4f57-a5c4-7d15e69853c9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:24:13 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:24:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:14 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Updating instance_info_cache with network_info: [{"id": "a86f59d3-672e-46b9-8787-8a1be203a52c", "address": "fa:16:3e:6d:94:eb", "network": {"id": "f81ae412-3eca-4d8e-ada6-ce522168ff50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-127420871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d5ac18a2e9447e8dda89acddd7a7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa86f59d3-67", "ovs_interfaceid": "a86f59d3-672e-46b9-8787-8a1be203a52c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:24:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-afd473af-fc47-4f57-a5c4-7d15e69853c9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:24:14 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:24:14 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:24:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:14 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:24:14 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:24:14 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:16 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:24:16 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:24:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8553MB free_disk=25.22085952758789GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:24:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0796133c-71d6-4d64-94af-49028a6603ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:24:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance afd473af-fc47-4f57-a5c4-7d15e69853c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:24:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 50512aed-fdc6-43f3-9666-545c0c62307a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:24:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance fa8c4d88-8b6c-4ef6-9876-62597ace9c37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:24:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:24:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:24:16 user nova-compute[74669]: INFO nova.compute.manager [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Rescuing
Nov 08 17:24:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:24:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquired lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:24:16 user nova-compute[74669]: DEBUG nova.network.neutron [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:24:16 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:24:16 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:24:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:24:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:16 user nova-compute[74669]: DEBUG nova.network.neutron [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Updating instance_info_cache with network_info: [{"id": "a4820eb9-3a23-479e-b429-47171c75f100", "address": "fa:16:3e:12:b9:b1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4820eb9-3a", "ovs_interfaceid": "a4820eb9-3a23-479e-b429-47171c75f100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:24:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Releasing lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:24:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-5c13cd45-828f-4f3a-8fc1-364145f94ff0 req-0781cd93-dc1d-4c4b-96a2-cea6601302e3 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received event network-vif-unplugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:24:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5c13cd45-828f-4f3a-8fc1-364145f94ff0 req-0781cd93-dc1d-4c4b-96a2-cea6601302e3 service nova] Acquiring lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5c13cd45-828f-4f3a-8fc1-364145f94ff0 req-0781cd93-dc1d-4c4b-96a2-cea6601302e3 service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5c13cd45-828f-4f3a-8fc1-364145f94ff0 req-0781cd93-dc1d-4c4b-96a2-cea6601302e3 service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-5c13cd45-828f-4f3a-8fc1-364145f94ff0 req-0781cd93-dc1d-4c4b-96a2-cea6601302e3 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] No waiting events found dispatching network-vif-unplugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:24:17 user nova-compute[74669]: WARNING nova.compute.manager [req-5c13cd45-828f-4f3a-8fc1-364145f94ff0 req-0781cd93-dc1d-4c4b-96a2-cea6601302e3 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received unexpected event network-vif-unplugged-a4820eb9-3a23-479e-b429-47171c75f100 for instance with vm_state active and task_state rescuing.
Nov 08 17:24:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:17 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Instance destroyed successfully.
Nov 08 17:24:17 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Attempting a stable device rescue
Nov 08 17:24:17 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74669) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 17:24:17 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Instance directory exists: not creating {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 17:24:17 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Creating image(s)
Nov 08 17:24:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa8c4d88-8b6c-4ef6-9876-62597ace9c37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "/opt/stack/data/nova/instances/fa8c4d88-8b6c-4ef6-9876-62597ace9c37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "/opt/stack/data/nova/instances/fa8c4d88-8b6c-4ef6-9876-62597ace9c37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:17 user nova-compute[74669]: DEBUG nova.objects.instance [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lazy-loading 'trusted_certs' on Instance uuid fa8c4d88-8b6c-4ef6-9876-62597ace9c37 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:24:17 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:24:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "35f27fb980af7249e7cb681d1414dc30f8c46045" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "35f27fb980af7249e7cb681d1414dc30f8c46045" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:17 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:24:17 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:24:17 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:24:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/35f27fb980af7249e7cb681d1414dc30f8c46045.part --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/35f27fb980af7249e7cb681d1414dc30f8c46045.part --force-share --output=json" returned: 0 in 0.219s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:18 user nova-compute[74669]: DEBUG nova.virt.images [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] aa25010d-c112-432e-a734-3e77fd118cd9 was qcow2, converting to raw {{(pid=74669) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 17:24:18 user nova-compute[74669]: DEBUG nova.privsep.utils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74669) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 17:24:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/35f27fb980af7249e7cb681d1414dc30f8c46045.part /opt/stack/data/nova/instances/_base/35f27fb980af7249e7cb681d1414dc30f8c46045.converted {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.compute.manager [req-ffbfa10e-78c1-4444-bea1-5841a3b287e9 req-72915fd1-ef2f-4a3a-8478-bbacc1e6aeee service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received event network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ffbfa10e-78c1-4444-bea1-5841a3b287e9 req-72915fd1-ef2f-4a3a-8478-bbacc1e6aeee service nova] Acquiring lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ffbfa10e-78c1-4444-bea1-5841a3b287e9 req-72915fd1-ef2f-4a3a-8478-bbacc1e6aeee service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ffbfa10e-78c1-4444-bea1-5841a3b287e9 req-72915fd1-ef2f-4a3a-8478-bbacc1e6aeee service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.compute.manager [req-ffbfa10e-78c1-4444-bea1-5841a3b287e9 req-72915fd1-ef2f-4a3a-8478-bbacc1e6aeee service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] No waiting events found dispatching network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:24:19 user nova-compute[74669]: WARNING nova.compute.manager [req-ffbfa10e-78c1-4444-bea1-5841a3b287e9 req-72915fd1-ef2f-4a3a-8478-bbacc1e6aeee service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received unexpected event network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 for instance with vm_state active and task_state rescuing.
Nov 08 17:24:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/35f27fb980af7249e7cb681d1414dc30f8c46045.part /opt/stack/data/nova/instances/_base/35f27fb980af7249e7cb681d1414dc30f8c46045.converted" returned: 0 in 0.443s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/35f27fb980af7249e7cb681d1414dc30f8c46045.converted --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/35f27fb980af7249e7cb681d1414dc30f8c46045.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "35f27fb980af7249e7cb681d1414dc30f8c46045" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.969s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "35f27fb980af7249e7cb681d1414dc30f8c46045" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "35f27fb980af7249e7cb681d1414dc30f8c46045" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/35f27fb980af7249e7cb681d1414dc30f8c46045 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/35f27fb980af7249e7cb681d1414dc30f8c46045 --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/35f27fb980af7249e7cb681d1414dc30f8c46045,backing_fmt=raw /opt/stack/data/nova/instances/fa8c4d88-8b6c-4ef6-9876-62597ace9c37/disk.rescue {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/35f27fb980af7249e7cb681d1414dc30f8c46045,backing_fmt=raw /opt/stack/data/nova/instances/fa8c4d88-8b6c-4ef6-9876-62597ace9c37/disk.rescue" returned: 0 in 0.054s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "35f27fb980af7249e7cb681d1414dc30f8c46045" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.objects.instance [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lazy-loading 'migration_context' on Instance uuid fa8c4d88-8b6c-4ef6-9876-62597ace9c37 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.objects.base [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Object Instance<fa8c4d88-8b6c-4ef6-9876-62597ace9c37> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Start _get_guest_xml network_info=[{"id": "a4820eb9-3a23-479e-b429-47171c75f100", "address": "fa:16:3e:12:b9:b1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "vif_mac": "fa:16:3e:12:b9:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4820eb9-3a", "ovs_interfaceid": "a4820eb9-3a23-479e-b429-47171c75f100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'aa25010d-c112-432e-a734-3e77fd118cd9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '10a823e4-6424-45d4-841f-80f87645053f', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDbQCvMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'fa8c4d88-8b6c-4ef6-9876-62597ace9c37', 'attached_at': '', 'detached_at': '', 'volume_id': '92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c', 'serial': '92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c'}, 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.objects.instance [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lazy-loading 'resources' on Instance uuid fa8c4d88-8b6c-4ef6-9876-62597ace9c37 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.objects.base [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Object Instance<fa8c4d88-8b6c-4ef6-9876-62597ace9c37> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.objects.instance [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lazy-loading 'numa_topology' on Instance uuid fa8c4d88-8b6c-4ef6-9876-62597ace9c37 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.objects.base [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Object Instance<fa8c4d88-8b6c-4ef6-9876-62597ace9c37> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:24:19 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:24:19 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.objects.instance [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lazy-loading 'vcpu_model' on Instance uuid fa8c4d88-8b6c-4ef6-9876-62597ace9c37 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.objects.base [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Object Instance<fa8c4d88-8b6c-4ef6-9876-62597ace9c37> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDbQCvMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:24:19 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:24:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:24:19 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:24:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:24:19 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:24:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:19 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1f68f2-3128-44a8-92ff-2870dde8ca31]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = WDbQCvMA\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 17:24:20 user nova-compute[74669]: node.name = iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c
Nov 08 17:24:20 user nova-compute[74669]: node.tpgt = -1
Nov 08 17:24:20 user nova-compute[74669]: node.startup = automatic
Nov 08 17:24:20 user nova-compute[74669]: node.leading_login = No
Nov 08 17:24:20 user nova-compute[74669]: iface.iscsi_ifacename = default
Nov 08 17:24:20 user nova-compute[74669]: iface.net_ifacename = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.ipaddress = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.prefix_len = 0
Nov 08 17:24:20 user nova-compute[74669]: iface.hwaddress = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.transport_name = tcp
Nov 08 17:24:20 user nova-compute[74669]: iface.initiatorname = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.state = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.vlan_id = 0
Nov 08 17:24:20 user nova-compute[74669]: iface.vlan_priority = 0
Nov 08 17:24:20 user nova-compute[74669]: iface.vlan_state = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.iface_num = 0
Nov 08 17:24:20 user nova-compute[74669]: iface.mtu = 0
Nov 08 17:24:20 user nova-compute[74669]: iface.port = 0
Nov 08 17:24:20 user nova-compute[74669]: iface.bootproto = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.subnet_mask = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.gateway = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.dhcp_alt_client_id = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.dhcp_dns = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.dhcp_learn_iqn = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.dhcp_vendor_id_state = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.dhcp_vendor_id = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.dhcp_slp_da = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.fragmentation = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.gratuitous_arp = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.incoming_forwarding = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.tos_state = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.tos = 0
Nov 08 17:24:20 user nova-compute[74669]: iface.ttl = 0
Nov 08 17:24:20 user nova-compute[74669]: iface.delayed_ack = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.tcp_nagle = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.tcp_wsf_state = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.tcp_wsf = 0
Nov 08 17:24:20 user nova-compute[74669]: iface.tcp_timer_scale = 0
Nov 08 17:24:20 user nova-compute[74669]: iface.tcp_timestamp = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.redirect = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.def_task_mgmt_timeout = 0
Nov 08 17:24:20 user nova-compute[74669]: iface.header_digest = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.data_digest = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.immediate_data = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.initial_r2t = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.data_seq_inorder = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.data_pdu_inorder = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.erl = 0
Nov 08 17:24:20 user nova-compute[74669]: iface.max_receive_data_len = 0
Nov 08 17:24:20 user nova-compute[74669]: iface.first_burst_len = 0
Nov 08 17:24:20 user nova-compute[74669]: iface.max_outstanding_r2t = 0
Nov 08 17:24:20 user nova-compute[74669]: iface.max_burst_len = 0
Nov 08 17:24:20 user nova-compute[74669]: iface.chap_auth = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.bidi_chap = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.strict_login_compliance = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.discovery_auth = <empty>
Nov 08 17:24:20 user nova-compute[74669]: iface.discovery_logout = <empty>
Nov 08 17:24:20 user nova-compute[74669]: node.discovery_address = <empty>
Nov 08 17:24:20 user nova-compute[74669]: node.discovery_port = 0
Nov 08 17:24:20 user nova-compute[74669]: node.discovery_type = static
Nov 08 17:24:20 user nova-compute[74669]: node.session.initial_cmdsn = 0
Nov 08 17:24:20 user nova-compute[74669]: node.session.initial_login_retry_max = 8
Nov 08 17:24:20 user nova-compute[74669]: node.session.xmit_thread_priority = -20
Nov 08 17:24:20 user nova-compute[74669]: node.session.cmds_max = 128
Nov 08 17:24:20 user nova-compute[74669]: node.session.queue_depth = 32
Nov 08 17:24:20 user nova-compute[74669]: node.session.nr_sessions = 1
Nov 08 17:24:20 user nova-compute[74669]: node.session.auth.authmethod = CHAP
Nov 08 17:24:20 user nova-compute[74669]: node.session.auth.username = WDbQCvMA
Nov 08 17:24:20 user nova-compute[74669]: node.session.auth.password = ***
Nov 08 17:24:20 user nova-compute[74669]: node.session.auth.username_in = <empty>
Nov 08 17:24:20 user nova-compute[74669]: node.session.auth.password_in = <empty>
Nov 08 17:24:20 user nova-compute[74669]: node.session.auth.chap_algs = MD5
Nov 08 17:24:20 user nova-compute[74669]: node.session.timeo.replacement_timeout = 120
Nov 08 17:24:20 user nova-compute[74669]: node.session.err_timeo.abort_timeout = 15
Nov 08 17:24:20 user nova-compute[74669]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 17:24:20 user nova-compute[74669]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 17:24:20 user nova-compute[74669]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 17:24:20 user nova-compute[74669]: node.session.iscsi.FastAbort = Yes
Nov 08 17:24:20 user nova-compute[74669]: node.session.iscsi.InitialR2T = No
Nov 08 17:24:20 user nova-compute[74669]: node.session.iscsi.ImmediateData = Yes
Nov 08 17:24:20 user nova-compute[74669]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 17:24:20 user nova-compute[74669]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 17:24:20 user nova-compute[74669]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 17:24:20 user nova-compute[74669]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 17:24:20 user nova-compute[74669]: node.session.iscsi.MaxConnections = 1
Nov 08 17:24:20 user nova-compute[74669]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 17:24:20 user nova-compute[74669]: node.session.iscsi.ERL = 0
Nov 08 17:24:20 user nova-compute[74669]: node.session.scan = manual
Nov 08 17:24:20 user nova-compute[74669]: node.session.reopen_max = 0
Nov 08 17:24:20 user nova-compute[74669]: node.conn[0].address = 172.16.0.220
Nov 08 17:24:20 user nova-compute[74669]: node.conn[0].port = 3260
Nov 08 17:24:20 user nova-compute[74669]: node.conn[0].startup = manual
Nov 08 17:24:20 user nova-compute[74669]: node.conn[0].tcp.window_size = 524288
Nov 08 17:24:20 user nova-compute[74669]: node.conn[0].tcp.type_of_service = 0
Nov 08 17:24:20 user nova-compute[74669]: node.conn[0].timeo.logout_timeout = 15
Nov 08 17:24:20 user nova-compute[74669]: node.conn[0].timeo.login_timeout = 15
Nov 08 17:24:20 user nova-compute[74669]: node.conn[0].timeo.auth_timeout = 45
Nov 08 17:24:20 user nova-compute[74669]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 17:24:20 user nova-compute[74669]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 17:24:20 user nova-compute[74669]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 17:24:20 user nova-compute[74669]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 17:24:20 user nova-compute[74669]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 17:24:20 user nova-compute[74669]: node.conn[0].iscsi.DataDigest = None
Nov 08 17:24:20 user nova-compute[74669]: node.conn[0].iscsi.IFMarker = No
Nov 08 17:24:20 user nova-compute[74669]: node.conn[0].iscsi.OFMarker = No
Nov 08 17:24:20 user nova-compute[74669]: # END RECORD
Nov 08 17:24:20 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d61c3b5-e30d-43a8-b428-d902df5ee249]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6c1770-1cfd-4a3b-8434-6713cf9886fe]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WDbQCvMA {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WDbQCvMA" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d214cd-4b8f-4957-beb6-f013f62ecc3c]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WDbQCvMA'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.044s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e04b429-2060-4a66-9928-e81327abe73c]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[759587a7-5e84-418c-b91b-3a067b550d4d]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:24:20 user nova-compute[74669]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e (non-flash)
Nov 08 17:24:20 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:24:20 user nova-compute[74669]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e (non-flash)
Nov 08 17:24:20 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.189s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] HCTL ('33', '0', '0', 0) found on session 40 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70a5727-4ec4-4fc8-84e8-2a3fbff1f2ea]: (4, ('0 0 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Searching for a device in session 40 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDbQCvMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.214s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] <== connect_volume: return (215ms) {'type': 'block', 'scsi_wwn': '26532363836396561', 'path': '/dev/sdb'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532363836396561', 'path': '/dev/sdb'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:22:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1647964349',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1647964349',id=41,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:22:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08551815597744d89e3a61d190a9b8a7',ramdisk_id='',reservation_id='r-6nt2kfv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293450045',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:22:59Z,user_data=None,user_id='b1fcd1d4cf714f62aa8648b27a04c04e',uuid=fa8c4d88-8b6c-4ef6-9876-62597ace9c37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4820eb9-3a23-479e-b429-47171c75f100", "address": "fa:16:3e:12:b9:b1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "vif_mac": "fa:16:3e:12:b9:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4820eb9-3a", "ovs_interfaceid": "a4820eb9-3a23-479e-b429-47171c75f100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converting VIF {"id": "a4820eb9-3a23-479e-b429-47171c75f100", "address": "fa:16:3e:12:b9:b1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "vif_mac": "fa:16:3e:12:b9:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4820eb9-3a", "ovs_interfaceid": "a4820eb9-3a23-479e-b429-47171c75f100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:b9:b1,bridge_name='br-int',has_traffic_filtering=True,id=a4820eb9-3a23-479e-b429-47171c75f100,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4820eb9-3a') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG nova.objects.instance [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lazy-loading 'pci_devices' on Instance uuid fa8c4d88-8b6c-4ef6-9876-62597ace9c37 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG nova.objects.base [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Object Instance<fa8c4d88-8b6c-4ef6-9876-62597ace9c37> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:24:20 user nova-compute[74669]:   <uuid>fa8c4d88-8b6c-4ef6-9876-62597ace9c37</uuid>
Nov 08 17:24:20 user nova-compute[74669]:   <name>instance-00000029</name>
Nov 08 17:24:20 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:24:20 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:24:20 user nova-compute[74669]:   <metadata>
Nov 08 17:24:20 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:24:20 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:24:20 user nova-compute[74669]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1647964349</nova:name>
Nov 08 17:24:20 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:24:19</nova:creationTime>
Nov 08 17:24:20 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:24:20 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:24:20 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:24:20 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:24:20 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:24:20 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:24:20 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:24:20 user nova-compute[74669]:       <nova:owner>
Nov 08 17:24:20 user nova-compute[74669]:         <nova:user uuid="b1fcd1d4cf714f62aa8648b27a04c04e">tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member</nova:user>
Nov 08 17:24:20 user nova-compute[74669]:         <nova:project uuid="08551815597744d89e3a61d190a9b8a7">tempest-ServerBootFromVolumeStableRescueTest-293450045</nova:project>
Nov 08 17:24:20 user nova-compute[74669]:       </nova:owner>
Nov 08 17:24:20 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:24:20 user nova-compute[74669]:       <nova:ports>
Nov 08 17:24:20 user nova-compute[74669]:         <nova:port uuid="a4820eb9-3a23-479e-b429-47171c75f100">
Nov 08 17:24:20 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 17:24:20 user nova-compute[74669]:         </nova:port>
Nov 08 17:24:20 user nova-compute[74669]:       </nova:ports>
Nov 08 17:24:20 user nova-compute[74669]:     </nova:instance>
Nov 08 17:24:20 user nova-compute[74669]:   </metadata>
Nov 08 17:24:20 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:24:20 user nova-compute[74669]:     <system>
Nov 08 17:24:20 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:24:20 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:24:20 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:24:20 user nova-compute[74669]:       <entry name="serial">fa8c4d88-8b6c-4ef6-9876-62597ace9c37</entry>
Nov 08 17:24:20 user nova-compute[74669]:       <entry name="uuid">fa8c4d88-8b6c-4ef6-9876-62597ace9c37</entry>
Nov 08 17:24:20 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:24:20 user nova-compute[74669]:     </system>
Nov 08 17:24:20 user nova-compute[74669]:   </sysinfo>
Nov 08 17:24:20 user nova-compute[74669]:   <os>
Nov 08 17:24:20 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:24:20 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:24:20 user nova-compute[74669]:   </os>
Nov 08 17:24:20 user nova-compute[74669]:   <features>
Nov 08 17:24:20 user nova-compute[74669]:     <acpi/>
Nov 08 17:24:20 user nova-compute[74669]:     <apic/>
Nov 08 17:24:20 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:24:20 user nova-compute[74669]:   </features>
Nov 08 17:24:20 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:24:20 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:24:20 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:24:20 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:24:20 user nova-compute[74669]:   </clock>
Nov 08 17:24:20 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:24:20 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:24:20 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:24:20 user nova-compute[74669]:   </cpu>
Nov 08 17:24:20 user nova-compute[74669]:   <devices>
Nov 08 17:24:20 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 17:24:20 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:24:20 user nova-compute[74669]:       <source dev="/dev/sdb"/>
Nov 08 17:24:20 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:24:20 user nova-compute[74669]:       <serial>92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c</serial>
Nov 08 17:24:20 user nova-compute[74669]:     </disk>
Nov 08 17:24:20 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:24:20 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:24:20 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/fa8c4d88-8b6c-4ef6-9876-62597ace9c37/disk.rescue"/>
Nov 08 17:24:20 user nova-compute[74669]:       <target dev="vdb" bus="virtio"/>
Nov 08 17:24:20 user nova-compute[74669]:       <boot order="1"/>
Nov 08 17:24:20 user nova-compute[74669]:     </disk>
Nov 08 17:24:20 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:24:20 user nova-compute[74669]:       <mac address="fa:16:3e:12:b9:b1"/>
Nov 08 17:24:20 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:24:20 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:24:20 user nova-compute[74669]:       <target dev="tapa4820eb9-3a"/>
Nov 08 17:24:20 user nova-compute[74669]:     </interface>
Nov 08 17:24:20 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:24:20 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/fa8c4d88-8b6c-4ef6-9876-62597ace9c37/console.log" append="off"/>
Nov 08 17:24:20 user nova-compute[74669]:     </serial>
Nov 08 17:24:20 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:24:20 user nova-compute[74669]:     <video>
Nov 08 17:24:20 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:24:20 user nova-compute[74669]:     </video>
Nov 08 17:24:20 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:24:20 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:24:20 user nova-compute[74669]:     </rng>
Nov 08 17:24:20 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:24:20 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:24:20 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:24:20 user nova-compute[74669]:     </memballoon>
Nov 08 17:24:20 user nova-compute[74669]:   </devices>
Nov 08 17:24:20 user nova-compute[74669]: </domain>
Nov 08 17:24:20 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:24:20 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Instance destroyed successfully.
Nov 08 17:24:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:24:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] No VIF found with MAC fa:16:3e:12:b9:b1, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:24:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:21 user nova-compute[74669]: DEBUG nova.compute.manager [req-e99ae960-7f7c-448c-877c-19d56297e2cb req-2083f29a-6d05-4d22-ad6e-07ece97fdaa2 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received event network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:24:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e99ae960-7f7c-448c-877c-19d56297e2cb req-2083f29a-6d05-4d22-ad6e-07ece97fdaa2 service nova] Acquiring lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e99ae960-7f7c-448c-877c-19d56297e2cb req-2083f29a-6d05-4d22-ad6e-07ece97fdaa2 service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-e99ae960-7f7c-448c-877c-19d56297e2cb req-2083f29a-6d05-4d22-ad6e-07ece97fdaa2 service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:21 user nova-compute[74669]: DEBUG nova.compute.manager [req-e99ae960-7f7c-448c-877c-19d56297e2cb req-2083f29a-6d05-4d22-ad6e-07ece97fdaa2 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] No waiting events found dispatching network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:24:21 user nova-compute[74669]: WARNING nova.compute.manager [req-e99ae960-7f7c-448c-877c-19d56297e2cb req-2083f29a-6d05-4d22-ad6e-07ece97fdaa2 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received unexpected event network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 for instance with vm_state active and task_state rescuing.
Nov 08 17:24:23 user nova-compute[74669]: DEBUG nova.compute.manager [None req-1450ce5b-6061-4c27-9313-558415059ba7 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:24:24 user nova-compute[74669]: DEBUG nova.compute.manager [req-0cc4cc21-3271-407f-8286-111b1e8ba8d5 req-8afef8d3-55dc-4cdb-baa8-f75481ec76f2 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received event network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:24:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0cc4cc21-3271-407f-8286-111b1e8ba8d5 req-8afef8d3-55dc-4cdb-baa8-f75481ec76f2 service nova] Acquiring lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0cc4cc21-3271-407f-8286-111b1e8ba8d5 req-8afef8d3-55dc-4cdb-baa8-f75481ec76f2 service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0cc4cc21-3271-407f-8286-111b1e8ba8d5 req-8afef8d3-55dc-4cdb-baa8-f75481ec76f2 service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:24 user nova-compute[74669]: DEBUG nova.compute.manager [req-0cc4cc21-3271-407f-8286-111b1e8ba8d5 req-8afef8d3-55dc-4cdb-baa8-f75481ec76f2 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] No waiting events found dispatching network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:24:24 user nova-compute[74669]: WARNING nova.compute.manager [req-0cc4cc21-3271-407f-8286-111b1e8ba8d5 req-8afef8d3-55dc-4cdb-baa8-f75481ec76f2 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received unexpected event network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 for instance with vm_state rescued and task_state None.
Nov 08 17:24:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Acquiring lock "c3d8529c-c585-4412-82e1-c261cc43bd46" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "c3d8529c-c585-4412-82e1-c261cc43bd46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:24 user nova-compute[74669]: DEBUG nova.compute.manager [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:24:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:24:24 user nova-compute[74669]: INFO nova.compute.claims [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Claim successful on node user
Nov 08 17:24:24 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:24:24 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:24:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:24 user nova-compute[74669]: DEBUG nova.compute.manager [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:24:24 user nova-compute[74669]: DEBUG nova.compute.manager [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:24:24 user nova-compute[74669]: DEBUG nova.network.neutron [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:24:24 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:24:24 user nova-compute[74669]: DEBUG nova.compute.manager [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:24:25 user nova-compute[74669]: DEBUG nova.policy [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8c915ea3a094ac9b2766df66945880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863682646f70460aa388b2715796755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:24:25 user nova-compute[74669]: DEBUG nova.compute.manager [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:24:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:24:25 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Creating image(s)
Nov 08 17:24:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3d8529c-c585-4412-82e1-c261cc43bd46/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "/opt/stack/data/nova/instances/c3d8529c-c585-4412-82e1-c261cc43bd46/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "/opt/stack/data/nova/instances/c3d8529c-c585-4412-82e1-c261cc43bd46/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.215s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.204s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/c3d8529c-c585-4412-82e1-c261cc43bd46/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/c3d8529c-c585-4412-82e1-c261cc43bd46/disk 1073741824" returned: 0 in 0.050s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:25 user nova-compute[74669]: DEBUG nova.network.neutron [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Successfully created port: 5343f1ca-9fbb-475f-8348-5fdd6d769e6a {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:24:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.201s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:25 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3d8529c-c585-4412-82e1-c261cc43bd46/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:24:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d8529c-c585-4412-82e1-c261cc43bd46/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d8529c-c585-4412-82e1-c261cc43bd46/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Cannot resize image /opt/stack/data/nova/instances/c3d8529c-c585-4412-82e1-c261cc43bd46/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Ensure instance console log exists: /opt/stack/data/nova/instances/c3d8529c-c585-4412-82e1-c261cc43bd46/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.network.neutron [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Successfully updated port: 5343f1ca-9fbb-475f-8348-5fdd6d769e6a {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Acquiring lock "refresh_cache-c3d8529c-c585-4412-82e1-c261cc43bd46" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Acquired lock "refresh_cache-c3d8529c-c585-4412-82e1-c261cc43bd46" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.network.neutron [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-27aa7b82-ff48-4a61-ad33-b5f071d5ed03 req-a22441da-503f-4096-a3a5-9dcdd868ddfa service nova] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Received event network-changed-5343f1ca-9fbb-475f-8348-5fdd6d769e6a {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-27aa7b82-ff48-4a61-ad33-b5f071d5ed03 req-a22441da-503f-4096-a3a5-9dcdd868ddfa service nova] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Refreshing instance network info cache due to event network-changed-5343f1ca-9fbb-475f-8348-5fdd6d769e6a. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-27aa7b82-ff48-4a61-ad33-b5f071d5ed03 req-a22441da-503f-4096-a3a5-9dcdd868ddfa service nova] Acquiring lock "refresh_cache-c3d8529c-c585-4412-82e1-c261cc43bd46" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.network.neutron [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.network.neutron [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Updating instance_info_cache with network_info: [{"id": "5343f1ca-9fbb-475f-8348-5fdd6d769e6a", "address": "fa:16:3e:dd:90:fa", "network": {"id": "300cee8e-ea32-456f-8ba3-c7c377e3c068", "bridge": "br-int", "label": "tempest-VolumesActionsTest-456444300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863682646f70460aa388b2715796755e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5343f1ca-9f", "ovs_interfaceid": "5343f1ca-9fbb-475f-8348-5fdd6d769e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Releasing lock "refresh_cache-c3d8529c-c585-4412-82e1-c261cc43bd46" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.compute.manager [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Instance network_info: |[{"id": "5343f1ca-9fbb-475f-8348-5fdd6d769e6a", "address": "fa:16:3e:dd:90:fa", "network": {"id": "300cee8e-ea32-456f-8ba3-c7c377e3c068", "bridge": "br-int", "label": "tempest-VolumesActionsTest-456444300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863682646f70460aa388b2715796755e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5343f1ca-9f", "ovs_interfaceid": "5343f1ca-9fbb-475f-8348-5fdd6d769e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-27aa7b82-ff48-4a61-ad33-b5f071d5ed03 req-a22441da-503f-4096-a3a5-9dcdd868ddfa service nova] Acquired lock "refresh_cache-c3d8529c-c585-4412-82e1-c261cc43bd46" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.network.neutron [req-27aa7b82-ff48-4a61-ad33-b5f071d5ed03 req-a22441da-503f-4096-a3a5-9dcdd868ddfa service nova] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Refreshing network info cache for port 5343f1ca-9fbb-475f-8348-5fdd6d769e6a {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Start _get_guest_xml network_info=[{"id": "5343f1ca-9fbb-475f-8348-5fdd6d769e6a", "address": "fa:16:3e:dd:90:fa", "network": {"id": "300cee8e-ea32-456f-8ba3-c7c377e3c068", "bridge": "br-int", "label": "tempest-VolumesActionsTest-456444300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863682646f70460aa388b2715796755e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5343f1ca-9f", "ovs_interfaceid": "5343f1ca-9fbb-475f-8348-5fdd6d769e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:24:26 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:24:26 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:24:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-145179301',display_name='tempest-VolumesActionsTest-instance-145179301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-145179301',id=42,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='863682646f70460aa388b2715796755e',ramdisk_id='',reservation_id='r-zsarzr5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-733585185',owner_user_name='tempest-VolumesActionsTest-733585185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:24:25Z,user_data=None,user_id='d8c915ea3a094ac9b2766df66945880d',uuid=c3d8529c-c585-4412-82e1-c261cc43bd46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5343f1ca-9fbb-475f-8348-5fdd6d769e6a", "address": "fa:16:3e:dd:90:fa", "network": {"id": "300cee8e-ea32-456f-8ba3-c7c377e3c068", "bridge": "br-int", "label": "tempest-VolumesActionsTest-456444300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863682646f70460aa388b2715796755e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5343f1ca-9f", "ovs_interfaceid": "5343f1ca-9fbb-475f-8348-5fdd6d769e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Converting VIF {"id": "5343f1ca-9fbb-475f-8348-5fdd6d769e6a", "address": "fa:16:3e:dd:90:fa", "network": {"id": "300cee8e-ea32-456f-8ba3-c7c377e3c068", "bridge": "br-int", "label": "tempest-VolumesActionsTest-456444300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863682646f70460aa388b2715796755e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5343f1ca-9f", "ovs_interfaceid": "5343f1ca-9fbb-475f-8348-5fdd6d769e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:fa,bridge_name='br-int',has_traffic_filtering=True,id=5343f1ca-9fbb-475f-8348-5fdd6d769e6a,network=Network(300cee8e-ea32-456f-8ba3-c7c377e3c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5343f1ca-9f') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.objects.instance [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lazy-loading 'pci_devices' on Instance uuid c3d8529c-c585-4412-82e1-c261cc43bd46 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:24:26 user nova-compute[74669]:   <uuid>c3d8529c-c585-4412-82e1-c261cc43bd46</uuid>
Nov 08 17:24:26 user nova-compute[74669]:   <name>instance-0000002a</name>
Nov 08 17:24:26 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:24:26 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:24:26 user nova-compute[74669]:   <metadata>
Nov 08 17:24:26 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:24:26 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:24:26 user nova-compute[74669]:       <nova:name>tempest-VolumesActionsTest-instance-145179301</nova:name>
Nov 08 17:24:26 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:24:26</nova:creationTime>
Nov 08 17:24:26 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:24:26 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:24:26 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:24:26 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:24:26 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:24:26 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:24:26 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:24:26 user nova-compute[74669]:       <nova:owner>
Nov 08 17:24:26 user nova-compute[74669]:         <nova:user uuid="d8c915ea3a094ac9b2766df66945880d">tempest-VolumesActionsTest-733585185-project-member</nova:user>
Nov 08 17:24:26 user nova-compute[74669]:         <nova:project uuid="863682646f70460aa388b2715796755e">tempest-VolumesActionsTest-733585185</nova:project>
Nov 08 17:24:26 user nova-compute[74669]:       </nova:owner>
Nov 08 17:24:26 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:24:26 user nova-compute[74669]:       <nova:ports>
Nov 08 17:24:26 user nova-compute[74669]:         <nova:port uuid="5343f1ca-9fbb-475f-8348-5fdd6d769e6a">
Nov 08 17:24:26 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 17:24:26 user nova-compute[74669]:         </nova:port>
Nov 08 17:24:26 user nova-compute[74669]:       </nova:ports>
Nov 08 17:24:26 user nova-compute[74669]:     </nova:instance>
Nov 08 17:24:26 user nova-compute[74669]:   </metadata>
Nov 08 17:24:26 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:24:26 user nova-compute[74669]:     <system>
Nov 08 17:24:26 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:24:26 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:24:26 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:24:26 user nova-compute[74669]:       <entry name="serial">c3d8529c-c585-4412-82e1-c261cc43bd46</entry>
Nov 08 17:24:26 user nova-compute[74669]:       <entry name="uuid">c3d8529c-c585-4412-82e1-c261cc43bd46</entry>
Nov 08 17:24:26 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:24:26 user nova-compute[74669]:     </system>
Nov 08 17:24:26 user nova-compute[74669]:   </sysinfo>
Nov 08 17:24:26 user nova-compute[74669]:   <os>
Nov 08 17:24:26 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:24:26 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:24:26 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:24:26 user nova-compute[74669]:   </os>
Nov 08 17:24:26 user nova-compute[74669]:   <features>
Nov 08 17:24:26 user nova-compute[74669]:     <acpi/>
Nov 08 17:24:26 user nova-compute[74669]:     <apic/>
Nov 08 17:24:26 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:24:26 user nova-compute[74669]:   </features>
Nov 08 17:24:26 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:24:26 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:24:26 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:24:26 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:24:26 user nova-compute[74669]:   </clock>
Nov 08 17:24:26 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:24:26 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:24:26 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:24:26 user nova-compute[74669]:   </cpu>
Nov 08 17:24:26 user nova-compute[74669]:   <devices>
Nov 08 17:24:26 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:24:26 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:24:26 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/c3d8529c-c585-4412-82e1-c261cc43bd46/disk"/>
Nov 08 17:24:26 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:24:26 user nova-compute[74669]:     </disk>
Nov 08 17:24:26 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:24:26 user nova-compute[74669]:       <mac address="fa:16:3e:dd:90:fa"/>
Nov 08 17:24:26 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:24:26 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:24:26 user nova-compute[74669]:       <target dev="tap5343f1ca-9f"/>
Nov 08 17:24:26 user nova-compute[74669]:     </interface>
Nov 08 17:24:26 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:24:26 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/c3d8529c-c585-4412-82e1-c261cc43bd46/console.log" append="off"/>
Nov 08 17:24:26 user nova-compute[74669]:     </serial>
Nov 08 17:24:26 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:24:26 user nova-compute[74669]:     <video>
Nov 08 17:24:26 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:24:26 user nova-compute[74669]:     </video>
Nov 08 17:24:26 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:24:26 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:24:26 user nova-compute[74669]:     </rng>
Nov 08 17:24:26 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:24:26 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:24:26 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:24:26 user nova-compute[74669]:     </memballoon>
Nov 08 17:24:26 user nova-compute[74669]:   </devices>
Nov 08 17:24:26 user nova-compute[74669]: </domain>
Nov 08 17:24:26 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:24:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-145179301',display_name='tempest-VolumesActionsTest-instance-145179301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-145179301',id=42,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='863682646f70460aa388b2715796755e',ramdisk_id='',reservation_id='r-zsarzr5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-733585185',owner_user_name='tempest-VolumesActionsTest-733585185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:24:25Z,user_data=None,user_id='d8c915ea3a094ac9b2766df66945880d',uuid=c3d8529c-c585-4412-82e1-c261cc43bd46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5343f1ca-9fbb-475f-8348-5fdd6d769e6a", "address": "fa:16:3e:dd:90:fa", "network": {"id": "300cee8e-ea32-456f-8ba3-c7c377e3c068", "bridge": "br-int", "label": "tempest-VolumesActionsTest-456444300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863682646f70460aa388b2715796755e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5343f1ca-9f", "ovs_interfaceid": "5343f1ca-9fbb-475f-8348-5fdd6d769e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Converting VIF {"id": "5343f1ca-9fbb-475f-8348-5fdd6d769e6a", "address": "fa:16:3e:dd:90:fa", "network": {"id": "300cee8e-ea32-456f-8ba3-c7c377e3c068", "bridge": "br-int", "label": "tempest-VolumesActionsTest-456444300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863682646f70460aa388b2715796755e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5343f1ca-9f", "ovs_interfaceid": "5343f1ca-9fbb-475f-8348-5fdd6d769e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:fa,bridge_name='br-int',has_traffic_filtering=True,id=5343f1ca-9fbb-475f-8348-5fdd6d769e6a,network=Network(300cee8e-ea32-456f-8ba3-c7c377e3c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5343f1ca-9f') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG os_vif [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:fa,bridge_name='br-int',has_traffic_filtering=True,id=5343f1ca-9fbb-475f-8348-5fdd6d769e6a,network=Network(300cee8e-ea32-456f-8ba3-c7c377e3c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5343f1ca-9f') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3e23af9-f379-513c-8701-04ed4f4b7c70', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5343f1ca-9f, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5343f1ca-9f, col_values=(('qos', UUID('c9218c99-cb6d-41b1-8a32-d437c1fa85b1')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5343f1ca-9f, col_values=(('external_ids', {'iface-id': '5343f1ca-9fbb-475f-8348-5fdd6d769e6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:90:fa', 'vm-uuid': 'c3d8529c-c585-4412-82e1-c261cc43bd46'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:24:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:26 user nova-compute[74669]: INFO os_vif [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:fa,bridge_name='br-int',has_traffic_filtering=True,id=5343f1ca-9fbb-475f-8348-5fdd6d769e6a,network=Network(300cee8e-ea32-456f-8ba3-c7c377e3c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5343f1ca-9f')
Nov 08 17:24:27 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:24:27 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] No VIF found with MAC fa:16:3e:dd:90:fa, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:24:27 user nova-compute[74669]: DEBUG nova.network.neutron [req-27aa7b82-ff48-4a61-ad33-b5f071d5ed03 req-a22441da-503f-4096-a3a5-9dcdd868ddfa service nova] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Updated VIF entry in instance network info cache for port 5343f1ca-9fbb-475f-8348-5fdd6d769e6a. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:24:27 user nova-compute[74669]: DEBUG nova.network.neutron [req-27aa7b82-ff48-4a61-ad33-b5f071d5ed03 req-a22441da-503f-4096-a3a5-9dcdd868ddfa service nova] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Updating instance_info_cache with network_info: [{"id": "5343f1ca-9fbb-475f-8348-5fdd6d769e6a", "address": "fa:16:3e:dd:90:fa", "network": {"id": "300cee8e-ea32-456f-8ba3-c7c377e3c068", "bridge": "br-int", "label": "tempest-VolumesActionsTest-456444300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863682646f70460aa388b2715796755e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5343f1ca-9f", "ovs_interfaceid": "5343f1ca-9fbb-475f-8348-5fdd6d769e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:24:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-27aa7b82-ff48-4a61-ad33-b5f071d5ed03 req-a22441da-503f-4096-a3a5-9dcdd868ddfa service nova] Releasing lock "refresh_cache-c3d8529c-c585-4412-82e1-c261cc43bd46" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:24:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Acquiring lock "afd473af-fc47-4f57-a5c4-7d15e69853c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "afd473af-fc47-4f57-a5c4-7d15e69853c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Acquiring lock "afd473af-fc47-4f57-a5c4-7d15e69853c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "afd473af-fc47-4f57-a5c4-7d15e69853c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "afd473af-fc47-4f57-a5c4-7d15e69853c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:28 user nova-compute[74669]: INFO nova.compute.manager [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Terminating instance
Nov 08 17:24:28 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:24:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-80447321-5405-415d-a1ca-6d0682713ae2 req-625097dd-a796-4dd9-aecd-44bd1495f961 service nova] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Received event network-vif-plugged-5343f1ca-9fbb-475f-8348-5fdd6d769e6a {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:24:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-80447321-5405-415d-a1ca-6d0682713ae2 req-625097dd-a796-4dd9-aecd-44bd1495f961 service nova] Acquiring lock "c3d8529c-c585-4412-82e1-c261cc43bd46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-80447321-5405-415d-a1ca-6d0682713ae2 req-625097dd-a796-4dd9-aecd-44bd1495f961 service nova] Lock "c3d8529c-c585-4412-82e1-c261cc43bd46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-80447321-5405-415d-a1ca-6d0682713ae2 req-625097dd-a796-4dd9-aecd-44bd1495f961 service nova] Lock "c3d8529c-c585-4412-82e1-c261cc43bd46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-80447321-5405-415d-a1ca-6d0682713ae2 req-625097dd-a796-4dd9-aecd-44bd1495f961 service nova] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] No waiting events found dispatching network-vif-plugged-5343f1ca-9fbb-475f-8348-5fdd6d769e6a {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:24:28 user nova-compute[74669]: WARNING nova.compute.manager [req-80447321-5405-415d-a1ca-6d0682713ae2 req-625097dd-a796-4dd9-aecd-44bd1495f961 service nova] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Received unexpected event network-vif-plugged-5343f1ca-9fbb-475f-8348-5fdd6d769e6a for instance with vm_state building and task_state spawning.
Nov 08 17:24:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-8647079c-b116-41d4-b896-217cc35d1b75 req-794492c4-63f8-4a19-997d-f9592c072fe1 service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Received event network-vif-unplugged-a86f59d3-672e-46b9-8787-8a1be203a52c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:24:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8647079c-b116-41d4-b896-217cc35d1b75 req-794492c4-63f8-4a19-997d-f9592c072fe1 service nova] Acquiring lock "afd473af-fc47-4f57-a5c4-7d15e69853c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8647079c-b116-41d4-b896-217cc35d1b75 req-794492c4-63f8-4a19-997d-f9592c072fe1 service nova] Lock "afd473af-fc47-4f57-a5c4-7d15e69853c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8647079c-b116-41d4-b896-217cc35d1b75 req-794492c4-63f8-4a19-997d-f9592c072fe1 service nova] Lock "afd473af-fc47-4f57-a5c4-7d15e69853c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-8647079c-b116-41d4-b896-217cc35d1b75 req-794492c4-63f8-4a19-997d-f9592c072fe1 service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] No waiting events found dispatching network-vif-unplugged-a86f59d3-672e-46b9-8787-8a1be203a52c {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:24:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-8647079c-b116-41d4-b896-217cc35d1b75 req-794492c4-63f8-4a19-997d-f9592c072fe1 service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Received event network-vif-unplugged-a86f59d3-672e-46b9-8787-8a1be203a52c for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:29 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Instance destroyed successfully.
Nov 08 17:24:29 user nova-compute[74669]: DEBUG nova.objects.instance [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lazy-loading 'resources' on Instance uuid afd473af-fc47-4f57-a5c4-7d15e69853c9 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:21:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1326124448',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1326124448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1326124',id=39,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvuaJsffeP6U4PyVJA2ZkbH5Bi10qsHbJWO1xBjKQe1FklxmgG7v1gZRX9r5gJ1+EK6wrONlXhI2dmQ361JFJGejywxzdkPnoPxXIifFaBAh8gqw0Wk9eiq6ddF+oxwQQ==',key_name='tempest-keypair-1158367944',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:21:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36d5ac18a2e9447e8dda89acddd7a7d3',ramdisk_id='',reservation_id='r-uv0fhxtk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-881785813',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:21:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26fd2f7b974d4124b4cea209564f74f2',uuid=afd473af-fc47-4f57-a5c4-7d15e69853c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a86f59d3-672e-46b9-8787-8a1be203a52c", "address": "fa:16:3e:6d:94:eb", "network": {"id": "f81ae412-3eca-4d8e-ada6-ce522168ff50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-127420871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d5ac18a2e9447e8dda89acddd7a7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa86f59d3-67", "ovs_interfaceid": "a86f59d3-672e-46b9-8787-8a1be203a52c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Converting VIF {"id": "a86f59d3-672e-46b9-8787-8a1be203a52c", "address": "fa:16:3e:6d:94:eb", "network": {"id": "f81ae412-3eca-4d8e-ada6-ce522168ff50", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-127420871-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d5ac18a2e9447e8dda89acddd7a7d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa86f59d3-67", "ovs_interfaceid": "a86f59d3-672e-46b9-8787-8a1be203a52c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:94:eb,bridge_name='br-int',has_traffic_filtering=True,id=a86f59d3-672e-46b9-8787-8a1be203a52c,network=Network(f81ae412-3eca-4d8e-ada6-ce522168ff50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa86f59d3-67') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG os_vif [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:94:eb,bridge_name='br-int',has_traffic_filtering=True,id=a86f59d3-672e-46b9-8787-8a1be203a52c,network=Network(f81ae412-3eca-4d8e-ada6-ce522168ff50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa86f59d3-67') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa86f59d3-67, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f53afb6e-25ab-4d11-9910-9663c44f2be0) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:29 user nova-compute[74669]: INFO os_vif [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:94:eb,bridge_name='br-int',has_traffic_filtering=True,id=a86f59d3-672e-46b9-8787-8a1be203a52c,network=Network(f81ae412-3eca-4d8e-ada6-ce522168ff50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa86f59d3-67')
Nov 08 17:24:29 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Deleting instance files /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9_del
Nov 08 17:24:29 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Deletion of /opt/stack/data/nova/instances/afd473af-fc47-4f57-a5c4-7d15e69853c9_del complete
Nov 08 17:24:29 user nova-compute[74669]: INFO nova.compute.manager [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:24:29 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 50512aed-fdc6-43f3-9666-545c0c62307a is timed out.
Nov 08 17:24:29 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Successfully detached device vdb from instance 50512aed-fdc6-43f3-9666-545c0c62307a from the live domain config.
Nov 08 17:24:29 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCERfvZh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:24:29 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:24:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[33477f58-0fd4-4237-a5f4-6933232c26f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:24:29 user nova-compute[74669]: No targets found.
Nov 08 17:24:29 user nova-compute[74669]: iSNS:
Nov 08 17:24:29 user nova-compute[74669]: No targets found.
Nov 08 17:24:29 user nova-compute[74669]: STATIC:
Nov 08 17:24:29 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e
Nov 08 17:24:29 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:24:29 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:24:29 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c
Nov 08 17:24:29 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:24:29 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:24:29 user nova-compute[74669]: FIRMWARE:
Nov 08 17:24:29 user nova-compute[74669]: No targets found.
Nov 08 17:24:29 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:24:29 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:24:29 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7b3325-1e1d-4716-9041-083f712ef89a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a6037a-f3ac-4a18-9147-73483df02517]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:24:29 user nova-compute[74669]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e (non-flash)
Nov 08 17:24:29 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:24:29 user nova-compute[74669]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e (non-flash)
Nov 08 17:24:29 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9a833e8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e'): ({'sdc'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Removing single pathed devices sdc {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[df72db30-2b5c-499f-8f16-b8e4e8bbde54]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d552aa50-7d2f-4786-93e5-1d3f859a75fc]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Flushing IO for device /dev/sdc {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a291a6-f193-4b28-8046-3129696c28cd]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[341b3c62-8fe2-482d-9225-b354f83f94f0]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80697df-7f87-47b5-ba07-dfcfd9bfe831]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:24:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae9de97-5d9c-4fb1-b7a7-30630b0383d5]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e, portal: 172.16.0.220,3260]
Nov 08 17:24:30 user nova-compute[74669]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e, portal: 172.16.0.220,3260] successful.
Nov 08 17:24:30 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c68497f0-4eaf-4f9a-a9d0-8ce772a0fb6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed079351-ddea-41ca-ae50-f0d6407c7be3]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] <== disconnect_volume: return (313ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:24:30 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Took 0.87 seconds to deallocate network for instance.
Nov 08 17:24:30 user nova-compute[74669]: DEBUG nova.compute.manager [req-54d6a889-38ff-4917-864f-5a9e9d6eeb8c req-c1851154-afff-498c-bf81-aec833324bd2 service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Received event network-vif-deleted-a86f59d3-672e-46b9-8787-8a1be203a52c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:30 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Deleted allocations for instance afd473af-fc47-4f57-a5c4-7d15e69853c9
Nov 08 17:24:30 user nova-compute[74669]: DEBUG nova.compute.manager [req-a5ccbfae-a873-412e-ae4a-59012eb3ae19 req-c046c337-7065-4dec-a6e9-a34e46b38913 service nova] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Received event network-vif-plugged-5343f1ca-9fbb-475f-8348-5fdd6d769e6a {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a5ccbfae-a873-412e-ae4a-59012eb3ae19 req-c046c337-7065-4dec-a6e9-a34e46b38913 service nova] Acquiring lock "c3d8529c-c585-4412-82e1-c261cc43bd46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a5ccbfae-a873-412e-ae4a-59012eb3ae19 req-c046c337-7065-4dec-a6e9-a34e46b38913 service nova] Lock "c3d8529c-c585-4412-82e1-c261cc43bd46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a5ccbfae-a873-412e-ae4a-59012eb3ae19 req-c046c337-7065-4dec-a6e9-a34e46b38913 service nova] Lock "c3d8529c-c585-4412-82e1-c261cc43bd46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG nova.compute.manager [req-a5ccbfae-a873-412e-ae4a-59012eb3ae19 req-c046c337-7065-4dec-a6e9-a34e46b38913 service nova] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] No waiting events found dispatching network-vif-plugged-5343f1ca-9fbb-475f-8348-5fdd6d769e6a {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:24:30 user nova-compute[74669]: WARNING nova.compute.manager [req-a5ccbfae-a873-412e-ae4a-59012eb3ae19 req-c046c337-7065-4dec-a6e9-a34e46b38913 service nova] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Received unexpected event network-vif-plugged-5343f1ca-9fbb-475f-8348-5fdd6d769e6a for instance with vm_state building and task_state spawning.
Nov 08 17:24:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ba15e5f6-412f-4b63-a651-b2fc2f647400 tempest-TestServerVolumeAttachScenarioOldVersion-881785813 tempest-TestServerVolumeAttachScenarioOldVersion-881785813-project-member] Lock "afd473af-fc47-4f57-a5c4-7d15e69853c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.529s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG nova.compute.manager [req-7b8f696f-638c-4953-a42f-9b99d2f72cb7 req-3d8c2bf3-9f10-411c-9f43-ec8e82bc7baf service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Received event network-vif-plugged-a86f59d3-672e-46b9-8787-8a1be203a52c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-7b8f696f-638c-4953-a42f-9b99d2f72cb7 req-3d8c2bf3-9f10-411c-9f43-ec8e82bc7baf service nova] Acquiring lock "afd473af-fc47-4f57-a5c4-7d15e69853c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-7b8f696f-638c-4953-a42f-9b99d2f72cb7 req-3d8c2bf3-9f10-411c-9f43-ec8e82bc7baf service nova] Lock "afd473af-fc47-4f57-a5c4-7d15e69853c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-7b8f696f-638c-4953-a42f-9b99d2f72cb7 req-3d8c2bf3-9f10-411c-9f43-ec8e82bc7baf service nova] Lock "afd473af-fc47-4f57-a5c4-7d15e69853c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:30 user nova-compute[74669]: DEBUG nova.compute.manager [req-7b8f696f-638c-4953-a42f-9b99d2f72cb7 req-3d8c2bf3-9f10-411c-9f43-ec8e82bc7baf service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] No waiting events found dispatching network-vif-plugged-a86f59d3-672e-46b9-8787-8a1be203a52c {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:24:30 user nova-compute[74669]: WARNING nova.compute.manager [req-7b8f696f-638c-4953-a42f-9b99d2f72cb7 req-3d8c2bf3-9f10-411c-9f43-ec8e82bc7baf service nova] [instance: afd473af-fc47-4f57-a5c4-7d15e69853c9] Received unexpected event network-vif-plugged-a86f59d3-672e-46b9-8787-8a1be203a52c for instance with vm_state deleted and task_state None.
Nov 08 17:24:31 user nova-compute[74669]: DEBUG nova.objects.instance [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lazy-loading 'flavor' on Instance uuid 50512aed-fdc6-43f3-9666-545c0c62307a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:24:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-4351c11b-b7b5-4e4f-9a5b-f879185ee5e0 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "50512aed-fdc6-43f3-9666-545c0c62307a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.893s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:31 user nova-compute[74669]: DEBUG nova.compute.manager [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:24:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:24:31 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Instance spawned successfully.
Nov 08 17:24:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:24:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:24:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:24:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:24:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:24:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:24:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:24:31 user nova-compute[74669]: INFO nova.compute.manager [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Took 6.24 seconds to spawn the instance on the hypervisor.
Nov 08 17:24:31 user nova-compute[74669]: DEBUG nova.compute.manager [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:24:31 user nova-compute[74669]: INFO nova.compute.manager [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Took 6.91 seconds to build instance.
Nov 08 17:24:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-150997c1-ca67-4af7-866c-08b03135a962 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "c3d8529c-c585-4412-82e1-c261cc43bd46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.043s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "50512aed-fdc6-43f3-9666-545c0c62307a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "50512aed-fdc6-43f3-9666-545c0c62307a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "50512aed-fdc6-43f3-9666-545c0c62307a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "50512aed-fdc6-43f3-9666-545c0c62307a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "50512aed-fdc6-43f3-9666-545c0c62307a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:59 user nova-compute[74669]: INFO nova.compute.manager [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Terminating instance
Nov 08 17:24:59 user nova-compute[74669]: DEBUG nova.compute.manager [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:24:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:24:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-36dacb4f-d456-41ca-81a9-d4695101d48d req-b3ea322d-efa5-453b-a045-5b37a72ead4f service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Received event network-vif-unplugged-04d22c46-f5a5-46c4-95bd-6b389bb0f6fe {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:24:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-36dacb4f-d456-41ca-81a9-d4695101d48d req-b3ea322d-efa5-453b-a045-5b37a72ead4f service nova] Acquiring lock "50512aed-fdc6-43f3-9666-545c0c62307a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:24:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-36dacb4f-d456-41ca-81a9-d4695101d48d req-b3ea322d-efa5-453b-a045-5b37a72ead4f service nova] Lock "50512aed-fdc6-43f3-9666-545c0c62307a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:24:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-36dacb4f-d456-41ca-81a9-d4695101d48d req-b3ea322d-efa5-453b-a045-5b37a72ead4f service nova] Lock "50512aed-fdc6-43f3-9666-545c0c62307a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:24:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-36dacb4f-d456-41ca-81a9-d4695101d48d req-b3ea322d-efa5-453b-a045-5b37a72ead4f service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] No waiting events found dispatching network-vif-unplugged-04d22c46-f5a5-46c4-95bd-6b389bb0f6fe {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:24:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-36dacb4f-d456-41ca-81a9-d4695101d48d req-b3ea322d-efa5-453b-a045-5b37a72ead4f service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Received event network-vif-unplugged-04d22c46-f5a5-46c4-95bd-6b389bb0f6fe for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:25:00 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Instance destroyed successfully.
Nov 08 17:25:00 user nova-compute[74669]: DEBUG nova.objects.instance [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lazy-loading 'resources' on Instance uuid 50512aed-fdc6-43f3-9666-545c0c62307a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:25:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:21:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-551419322',display_name='tempest-AttachVolumeNegativeTest-server-551419322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-551419322',id=40,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXHgbwwEEi8dpyfztjZPuukzYWaK6gFRPfXdfFbTA3g80z/vtgTZ7SnwW4WD/xvnB1t8o1xXUJMmCD9J9056+8aDtTPaTP/e010Nw8GVs1VcRkOOuD9gPuVUBYSliU/Qg==',key_name='tempest-keypair-322385864',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:21:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f58f78f65e774cf78ca0c49aa11f9b54',ramdisk_id='',reservation_id='r-46u73ljh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1846694333',owner_user_name='tempest-AttachVolumeNegativeTest-1846694333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:21:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='565488b722e44809a7cff5e617daae84',uuid=50512aed-fdc6-43f3-9666-545c0c62307a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04d22c46-f5a5-46c4-95bd-6b389bb0f6fe", "address": "fa:16:3e:7e:28:f6", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d22c46-f5", "ovs_interfaceid": "04d22c46-f5a5-46c4-95bd-6b389bb0f6fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:25:00 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converting VIF {"id": "04d22c46-f5a5-46c4-95bd-6b389bb0f6fe", "address": "fa:16:3e:7e:28:f6", "network": {"id": "cfbaa743-f7e5-4e0f-b2be-3b27df11c504", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1481304688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f58f78f65e774cf78ca0c49aa11f9b54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04d22c46-f5", "ovs_interfaceid": "04d22c46-f5a5-46c4-95bd-6b389bb0f6fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:25:00 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:28:f6,bridge_name='br-int',has_traffic_filtering=True,id=04d22c46-f5a5-46c4-95bd-6b389bb0f6fe,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d22c46-f5') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:25:00 user nova-compute[74669]: DEBUG os_vif [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:28:f6,bridge_name='br-int',has_traffic_filtering=True,id=04d22c46-f5a5-46c4-95bd-6b389bb0f6fe,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d22c46-f5') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:25:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:25:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04d22c46-f5, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:25:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:25:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:25:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:25:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b09987d-37ba-4a29-bd3c-36d0af823b6f) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:25:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:25:00 user nova-compute[74669]: INFO os_vif [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:28:f6,bridge_name='br-int',has_traffic_filtering=True,id=04d22c46-f5a5-46c4-95bd-6b389bb0f6fe,network=Network(cfbaa743-f7e5-4e0f-b2be-3b27df11c504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04d22c46-f5')
Nov 08 17:25:00 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Deleting instance files /opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a_del
Nov 08 17:25:00 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Deletion of /opt/stack/data/nova/instances/50512aed-fdc6-43f3-9666-545c0c62307a_del complete
Nov 08 17:25:00 user nova-compute[74669]: INFO nova.compute.manager [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 08 17:25:00 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:25:00 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:25:00 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:25:01 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:25:01 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Took 0.62 seconds to deallocate network for instance.
Nov 08 17:25:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-164a075c-bd1c-4609-91da-c3e4365aab04 req-d98fb612-ec55-49f3-815d-887fc527a60b service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Received event network-vif-deleted-04d22c46-f5a5-46c4-95bd-6b389bb0f6fe {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:25:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:25:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:25:01 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:25:01 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:25:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:25:01 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Deleted allocations for instance 50512aed-fdc6-43f3-9666-545c0c62307a
Nov 08 17:25:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1c5d8c20-10b8-40b3-87f9-602ef18c3ef8 tempest-AttachVolumeNegativeTest-1846694333 tempest-AttachVolumeNegativeTest-1846694333-project-member] Lock "50512aed-fdc6-43f3-9666-545c0c62307a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.828s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:25:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-259f3f3b-0b04-40ce-84ce-9b5a92706c4d req-a67f3f3e-6520-4607-bc1a-3f3cf79c0bd5 service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Received event network-vif-plugged-04d22c46-f5a5-46c4-95bd-6b389bb0f6fe {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:25:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-259f3f3b-0b04-40ce-84ce-9b5a92706c4d req-a67f3f3e-6520-4607-bc1a-3f3cf79c0bd5 service nova] Acquiring lock "50512aed-fdc6-43f3-9666-545c0c62307a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:25:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-259f3f3b-0b04-40ce-84ce-9b5a92706c4d req-a67f3f3e-6520-4607-bc1a-3f3cf79c0bd5 service nova] Lock "50512aed-fdc6-43f3-9666-545c0c62307a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:25:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-259f3f3b-0b04-40ce-84ce-9b5a92706c4d req-a67f3f3e-6520-4607-bc1a-3f3cf79c0bd5 service nova] Lock "50512aed-fdc6-43f3-9666-545c0c62307a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:25:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-259f3f3b-0b04-40ce-84ce-9b5a92706c4d req-a67f3f3e-6520-4607-bc1a-3f3cf79c0bd5 service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] No waiting events found dispatching network-vif-plugged-04d22c46-f5a5-46c4-95bd-6b389bb0f6fe {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:25:01 user nova-compute[74669]: WARNING nova.compute.manager [req-259f3f3b-0b04-40ce-84ce-9b5a92706c4d req-a67f3f3e-6520-4607-bc1a-3f3cf79c0bd5 service nova] [instance: 50512aed-fdc6-43f3-9666-545c0c62307a] Received unexpected event network-vif-plugged-04d22c46-f5a5-46c4-95bd-6b389bb0f6fe for instance with vm_state deleted and task_state None.
Nov 08 17:25:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:25:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:25:09 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:25:09 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:25:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:25:10 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:25:11 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:25:13 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:25:13 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:25:13 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Didn't find any instances for network info cache update. {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 17:25:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:25:15 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:25:15 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:25:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:25:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:25:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:25:15 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:25:15 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:25:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8c4d88-8b6c-4ef6-9876-62597ace9c37/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:25:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8c4d88-8b6c-4ef6-9876-62597ace9c37/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:25:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8c4d88-8b6c-4ef6-9876-62597ace9c37/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:25:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8c4d88-8b6c-4ef6-9876-62597ace9c37/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:25:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d8529c-c585-4412-82e1-c261cc43bd46/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:25:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d8529c-c585-4412-82e1-c261cc43bd46/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:25:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d8529c-c585-4412-82e1-c261cc43bd46/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:25:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3d8529c-c585-4412-82e1-c261cc43bd46/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:25:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:25:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:25:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:25:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:25:17 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:25:17 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:25:17 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8510MB free_disk=25.141948699951172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:25:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:25:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:25:17 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0796133c-71d6-4d64-94af-49028a6603ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:25:17 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance fa8c4d88-8b6c-4ef6-9876-62597ace9c37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:25:17 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance c3d8529c-c585-4412-82e1-c261cc43bd46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:25:17 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:25:17 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:25:17 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:25:17 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:25:17 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:25:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:25:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:25:19 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:25:19 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:25:19 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:25:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:25:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:25:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:25:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:25:27 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:25:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:25:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:25:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:25:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:25:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:25:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:25:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:07 user nova-compute[74669]: INFO nova.compute.manager [None req-f1ef8474-54da-4376-beab-7c22e68ff110 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Unrescuing
Nov 08 17:26:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f1ef8474-54da-4376-beab-7c22e68ff110 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:26:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f1ef8474-54da-4376-beab-7c22e68ff110 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquired lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:26:07 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f1ef8474-54da-4376-beab-7c22e68ff110 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:26:07 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f1ef8474-54da-4376-beab-7c22e68ff110 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Updating instance_info_cache with network_info: [{"id": "a4820eb9-3a23-479e-b429-47171c75f100", "address": "fa:16:3e:12:b9:b1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4820eb9-3a", "ovs_interfaceid": "a4820eb9-3a23-479e-b429-47171c75f100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:26:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f1ef8474-54da-4376-beab-7c22e68ff110 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Releasing lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:26:07 user nova-compute[74669]: DEBUG nova.objects.instance [None req-f1ef8474-54da-4376-beab-7c22e68ff110 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lazy-loading 'flavor' on Instance uuid fa8c4d88-8b6c-4ef6-9876-62597ace9c37 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:26:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:08 user nova-compute[74669]: DEBUG nova.compute.manager [req-a05b8b04-7d71-4f50-b71e-7f348050a4c7 req-fcf86139-08b1-4ec9-bebf-016850b7e211 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received event network-vif-unplugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:26:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a05b8b04-7d71-4f50-b71e-7f348050a4c7 req-fcf86139-08b1-4ec9-bebf-016850b7e211 service nova] Acquiring lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:26:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a05b8b04-7d71-4f50-b71e-7f348050a4c7 req-fcf86139-08b1-4ec9-bebf-016850b7e211 service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:26:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a05b8b04-7d71-4f50-b71e-7f348050a4c7 req-fcf86139-08b1-4ec9-bebf-016850b7e211 service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:26:08 user nova-compute[74669]: DEBUG nova.compute.manager [req-a05b8b04-7d71-4f50-b71e-7f348050a4c7 req-fcf86139-08b1-4ec9-bebf-016850b7e211 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] No waiting events found dispatching network-vif-unplugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:26:08 user nova-compute[74669]: WARNING nova.compute.manager [req-a05b8b04-7d71-4f50-b71e-7f348050a4c7 req-fcf86139-08b1-4ec9-bebf-016850b7e211 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received unexpected event network-vif-unplugged-a4820eb9-3a23-479e-b429-47171c75f100 for instance with vm_state rescued and task_state unrescuing.
Nov 08 17:26:08 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Instance destroyed successfully.
Nov 08 17:26:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:10 user nova-compute[74669]: DEBUG nova.compute.manager [req-c7b0b9da-8fa8-404d-b76c-02e69df732db req-34456fa2-421b-4821-ab05-16cb5ad39b3f service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received event network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:26:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c7b0b9da-8fa8-404d-b76c-02e69df732db req-34456fa2-421b-4821-ab05-16cb5ad39b3f service nova] Acquiring lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:26:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c7b0b9da-8fa8-404d-b76c-02e69df732db req-34456fa2-421b-4821-ab05-16cb5ad39b3f service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:26:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c7b0b9da-8fa8-404d-b76c-02e69df732db req-34456fa2-421b-4821-ab05-16cb5ad39b3f service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:26:10 user nova-compute[74669]: DEBUG nova.compute.manager [req-c7b0b9da-8fa8-404d-b76c-02e69df732db req-34456fa2-421b-4821-ab05-16cb5ad39b3f service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] No waiting events found dispatching network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:26:10 user nova-compute[74669]: WARNING nova.compute.manager [req-c7b0b9da-8fa8-404d-b76c-02e69df732db req-34456fa2-421b-4821-ab05-16cb5ad39b3f service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received unexpected event network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 for instance with vm_state rescued and task_state unrescuing.
Nov 08 17:26:10 user nova-compute[74669]: DEBUG nova.compute.manager [req-c7b0b9da-8fa8-404d-b76c-02e69df732db req-34456fa2-421b-4821-ab05-16cb5ad39b3f service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received event network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:26:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c7b0b9da-8fa8-404d-b76c-02e69df732db req-34456fa2-421b-4821-ab05-16cb5ad39b3f service nova] Acquiring lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:26:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c7b0b9da-8fa8-404d-b76c-02e69df732db req-34456fa2-421b-4821-ab05-16cb5ad39b3f service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:26:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c7b0b9da-8fa8-404d-b76c-02e69df732db req-34456fa2-421b-4821-ab05-16cb5ad39b3f service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:26:10 user nova-compute[74669]: DEBUG nova.compute.manager [req-c7b0b9da-8fa8-404d-b76c-02e69df732db req-34456fa2-421b-4821-ab05-16cb5ad39b3f service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] No waiting events found dispatching network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:26:10 user nova-compute[74669]: WARNING nova.compute.manager [req-c7b0b9da-8fa8-404d-b76c-02e69df732db req-34456fa2-421b-4821-ab05-16cb5ad39b3f service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received unexpected event network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 for instance with vm_state rescued and task_state unrescuing.
Nov 08 17:26:10 user nova-compute[74669]: DEBUG nova.compute.manager [req-c7b0b9da-8fa8-404d-b76c-02e69df732db req-34456fa2-421b-4821-ab05-16cb5ad39b3f service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received event network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:26:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c7b0b9da-8fa8-404d-b76c-02e69df732db req-34456fa2-421b-4821-ab05-16cb5ad39b3f service nova] Acquiring lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:26:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c7b0b9da-8fa8-404d-b76c-02e69df732db req-34456fa2-421b-4821-ab05-16cb5ad39b3f service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:26:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c7b0b9da-8fa8-404d-b76c-02e69df732db req-34456fa2-421b-4821-ab05-16cb5ad39b3f service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:26:10 user nova-compute[74669]: DEBUG nova.compute.manager [req-c7b0b9da-8fa8-404d-b76c-02e69df732db req-34456fa2-421b-4821-ab05-16cb5ad39b3f service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] No waiting events found dispatching network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:26:10 user nova-compute[74669]: WARNING nova.compute.manager [req-c7b0b9da-8fa8-404d-b76c-02e69df732db req-34456fa2-421b-4821-ab05-16cb5ad39b3f service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received unexpected event network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 for instance with vm_state rescued and task_state unrescuing.
Nov 08 17:26:10 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:26:11 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:26:11 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:26:12 user nova-compute[74669]: DEBUG nova.compute.manager [None req-f1ef8474-54da-4376-beab-7c22e68ff110 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:26:12 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:26:13 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:26:13 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:26:13 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 17:26:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:26:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:26:13 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:26:13 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lazy-loading 'info_cache' on Instance uuid 0796133c-71d6-4d64-94af-49028a6603ea {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:26:14 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Updating instance_info_cache with network_info: [{"id": "1fa691c0-3473-4f34-a504-3778913558ab", "address": "fa:16:3e:2f:15:d7", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa691c0-34", "ovs_interfaceid": "1fa691c0-3473-4f34-a504-3778913558ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:26:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:26:14 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:26:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Acquiring lock "c3d8529c-c585-4412-82e1-c261cc43bd46" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:26:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "c3d8529c-c585-4412-82e1-c261cc43bd46" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:26:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Acquiring lock "c3d8529c-c585-4412-82e1-c261cc43bd46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:26:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "c3d8529c-c585-4412-82e1-c261cc43bd46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:26:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "c3d8529c-c585-4412-82e1-c261cc43bd46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:26:14 user nova-compute[74669]: INFO nova.compute.manager [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Terminating instance
Nov 08 17:26:14 user nova-compute[74669]: DEBUG nova.compute.manager [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-10193a62-9f99-47d9-910e-edac9e0d0eb7 req-d96016ce-ffd8-4272-93b5-c9a390b410cc service nova] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Received event network-vif-unplugged-5343f1ca-9fbb-475f-8348-5fdd6d769e6a {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-10193a62-9f99-47d9-910e-edac9e0d0eb7 req-d96016ce-ffd8-4272-93b5-c9a390b410cc service nova] Acquiring lock "c3d8529c-c585-4412-82e1-c261cc43bd46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-10193a62-9f99-47d9-910e-edac9e0d0eb7 req-d96016ce-ffd8-4272-93b5-c9a390b410cc service nova] Lock "c3d8529c-c585-4412-82e1-c261cc43bd46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-10193a62-9f99-47d9-910e-edac9e0d0eb7 req-d96016ce-ffd8-4272-93b5-c9a390b410cc service nova] Lock "c3d8529c-c585-4412-82e1-c261cc43bd46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-10193a62-9f99-47d9-910e-edac9e0d0eb7 req-d96016ce-ffd8-4272-93b5-c9a390b410cc service nova] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] No waiting events found dispatching network-vif-unplugged-5343f1ca-9fbb-475f-8348-5fdd6d769e6a {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-10193a62-9f99-47d9-910e-edac9e0d0eb7 req-d96016ce-ffd8-4272-93b5-c9a390b410cc service nova] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Received event network-vif-unplugged-5343f1ca-9fbb-475f-8348-5fdd6d769e6a for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:15 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Instance destroyed successfully.
Nov 08 17:26:15 user nova-compute[74669]: DEBUG nova.objects.instance [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lazy-loading 'resources' on Instance uuid c3d8529c-c585-4412-82e1-c261cc43bd46 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:24:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-145179301',display_name='tempest-VolumesActionsTest-instance-145179301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-145179301',id=42,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:24:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='863682646f70460aa388b2715796755e',ramdisk_id='',reservation_id='r-zsarzr5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-733585185',owner_user_name='tempest-VolumesActionsTest-733585185-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:24:31Z,user_data=None,user_id='d8c915ea3a094ac9b2766df66945880d',uuid=c3d8529c-c585-4412-82e1-c261cc43bd46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5343f1ca-9fbb-475f-8348-5fdd6d769e6a", "address": "fa:16:3e:dd:90:fa", "network": {"id": "300cee8e-ea32-456f-8ba3-c7c377e3c068", "bridge": "br-int", "label": "tempest-VolumesActionsTest-456444300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863682646f70460aa388b2715796755e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5343f1ca-9f", "ovs_interfaceid": "5343f1ca-9fbb-475f-8348-5fdd6d769e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Converting VIF {"id": "5343f1ca-9fbb-475f-8348-5fdd6d769e6a", "address": "fa:16:3e:dd:90:fa", "network": {"id": "300cee8e-ea32-456f-8ba3-c7c377e3c068", "bridge": "br-int", "label": "tempest-VolumesActionsTest-456444300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863682646f70460aa388b2715796755e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5343f1ca-9f", "ovs_interfaceid": "5343f1ca-9fbb-475f-8348-5fdd6d769e6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:fa,bridge_name='br-int',has_traffic_filtering=True,id=5343f1ca-9fbb-475f-8348-5fdd6d769e6a,network=Network(300cee8e-ea32-456f-8ba3-c7c377e3c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5343f1ca-9f') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG os_vif [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:fa,bridge_name='br-int',has_traffic_filtering=True,id=5343f1ca-9fbb-475f-8348-5fdd6d769e6a,network=Network(300cee8e-ea32-456f-8ba3-c7c377e3c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5343f1ca-9f') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5343f1ca-9f, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9218c99-cb6d-41b1-8a32-d437c1fa85b1) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:26:15 user nova-compute[74669]: INFO os_vif [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:fa,bridge_name='br-int',has_traffic_filtering=True,id=5343f1ca-9fbb-475f-8348-5fdd6d769e6a,network=Network(300cee8e-ea32-456f-8ba3-c7c377e3c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5343f1ca-9f')
Nov 08 17:26:15 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Deleting instance files /opt/stack/data/nova/instances/c3d8529c-c585-4412-82e1-c261cc43bd46_del
Nov 08 17:26:15 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Deletion of /opt/stack/data/nova/instances/c3d8529c-c585-4412-82e1-c261cc43bd46_del complete
Nov 08 17:26:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:26:15 user nova-compute[74669]: INFO nova.compute.manager [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 08 17:26:15 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:26:15 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:26:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:26:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:26:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:26:16 user nova-compute[74669]: DEBUG nova.compute.manager [req-e670ae8c-0796-4286-b85d-0f6072621b43 req-6472acfd-6518-453b-9c23-d62221966eb6 service nova] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Received event network-vif-deleted-5343f1ca-9fbb-475f-8348-5fdd6d769e6a {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:26:16 user nova-compute[74669]: INFO nova.compute.manager [req-e670ae8c-0796-4286-b85d-0f6072621b43 req-6472acfd-6518-453b-9c23-d62221966eb6 service nova] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Neutron deleted interface 5343f1ca-9fbb-475f-8348-5fdd6d769e6a; detaching it from the instance and deleting it from the info cache
Nov 08 17:26:16 user nova-compute[74669]: DEBUG nova.network.neutron [req-e670ae8c-0796-4286-b85d-0f6072621b43 req-6472acfd-6518-453b-9c23-d62221966eb6 service nova] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:26:16 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:26:16 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:26:16 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:26:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8758MB free_disk=25.159496307373047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:26:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:26:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:26:16 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Took 0.84 seconds to deallocate network for instance.
Nov 08 17:26:16 user nova-compute[74669]: DEBUG nova.compute.manager [req-e670ae8c-0796-4286-b85d-0f6072621b43 req-6472acfd-6518-453b-9c23-d62221966eb6 service nova] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Detach interface failed, port_id=5343f1ca-9fbb-475f-8348-5fdd6d769e6a, reason: Instance c3d8529c-c585-4412-82e1-c261cc43bd46 could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 17:26:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:26:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0796133c-71d6-4d64-94af-49028a6603ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:26:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance fa8c4d88-8b6c-4ef6-9876-62597ace9c37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:26:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance c3d8529c-c585-4412-82e1-c261cc43bd46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:26:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:26:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:26:16 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:26:16 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:26:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:26:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:26:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.191s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:26:17 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:26:17 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:26:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:26:17 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Deleted allocations for instance c3d8529c-c585-4412-82e1-c261cc43bd46
Nov 08 17:26:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-932e2abc-e5d2-4752-b6ff-3b9224741006 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "c3d8529c-c585-4412-82e1-c261cc43bd46" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.274s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:26:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-df69423e-8f66-4f36-a319-2525494d1c82 req-67fdcb39-29fe-44fd-afd1-05862bdcf3e4 service nova] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Received event network-vif-plugged-5343f1ca-9fbb-475f-8348-5fdd6d769e6a {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:26:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-df69423e-8f66-4f36-a319-2525494d1c82 req-67fdcb39-29fe-44fd-afd1-05862bdcf3e4 service nova] Acquiring lock "c3d8529c-c585-4412-82e1-c261cc43bd46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:26:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-df69423e-8f66-4f36-a319-2525494d1c82 req-67fdcb39-29fe-44fd-afd1-05862bdcf3e4 service nova] Lock "c3d8529c-c585-4412-82e1-c261cc43bd46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:26:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-df69423e-8f66-4f36-a319-2525494d1c82 req-67fdcb39-29fe-44fd-afd1-05862bdcf3e4 service nova] Lock "c3d8529c-c585-4412-82e1-c261cc43bd46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:26:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-df69423e-8f66-4f36-a319-2525494d1c82 req-67fdcb39-29fe-44fd-afd1-05862bdcf3e4 service nova] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] No waiting events found dispatching network-vif-plugged-5343f1ca-9fbb-475f-8348-5fdd6d769e6a {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:26:17 user nova-compute[74669]: WARNING nova.compute.manager [req-df69423e-8f66-4f36-a319-2525494d1c82 req-67fdcb39-29fe-44fd-afd1-05862bdcf3e4 service nova] [instance: c3d8529c-c585-4412-82e1-c261cc43bd46] Received unexpected event network-vif-plugged-5343f1ca-9fbb-475f-8348-5fdd6d769e6a for instance with vm_state deleted and task_state None.
Nov 08 17:26:18 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:26:18 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:26:18 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:26:18 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:26:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:26:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:35 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:26:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:26:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:26:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:26:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:26:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:26:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:26:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Verify base images {{(pid=74669) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 08 17:26:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Image id ee6edaa4-6206-44ab-8497-fdbc2291f87f yields fingerprint 87106a141e68d5b6b33d8e32a1c862b7a80ef956 {{(pid=74669) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 17:26:35 user nova-compute[74669]: INFO nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] image ee6edaa4-6206-44ab-8497-fdbc2291f87f at (/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956): checking
Nov 08 17:26:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] image ee6edaa4-6206-44ab-8497-fdbc2291f87f at (/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956): image is in use {{(pid=74669) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 08 17:26:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74669) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 17:26:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] fa8c4d88-8b6c-4ef6-9876-62597ace9c37 is a valid instance name {{(pid=74669) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 17:26:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] 0796133c-71d6-4d64-94af-49028a6603ea is a valid instance name {{(pid=74669) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 17:26:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] 0796133c-71d6-4d64-94af-49028a6603ea has a disk file {{(pid=74669) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 08 17:26:35 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:26:35 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:26:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0796133c-71d6-4d64-94af-49028a6603ea is backed by 87106a141e68d5b6b33d8e32a1c862b7a80ef956 {{(pid=74669) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 08 17:26:35 user nova-compute[74669]: WARNING nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Unknown base file: /opt/stack/data/nova/instances/_base/628cf2431239f3d66297ec42212b020eb83182fd
Nov 08 17:26:35 user nova-compute[74669]: WARNING nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Unknown base file: /opt/stack/data/nova/instances/_base/77f42b4b9d8a55c61f5c6daafa24b193b585b71c
Nov 08 17:26:35 user nova-compute[74669]: WARNING nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Unknown base file: /opt/stack/data/nova/instances/_base/20e54b946f4cf7dc92eadf332bdf6be8df44c361
Nov 08 17:26:35 user nova-compute[74669]: WARNING nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9a07d57e344ec80286b298c4f319568ce0a5732a
Nov 08 17:26:35 user nova-compute[74669]: WARNING nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e
Nov 08 17:26:35 user nova-compute[74669]: WARNING nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Unknown base file: /opt/stack/data/nova/instances/_base/571637caf9d73ed6f84bf3b2d80cf4f3d9549016
Nov 08 17:26:35 user nova-compute[74669]: WARNING nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bd32695172ba57e1ed00545e770a3d8ad7a865fd
Nov 08 17:26:35 user nova-compute[74669]: WARNING nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Unknown base file: /opt/stack/data/nova/instances/_base/35f27fb980af7249e7cb681d1414dc30f8c46045
Nov 08 17:26:35 user nova-compute[74669]: INFO nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Active base files: /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956
Nov 08 17:26:35 user nova-compute[74669]: INFO nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Removable base files: /opt/stack/data/nova/instances/_base/628cf2431239f3d66297ec42212b020eb83182fd /opt/stack/data/nova/instances/_base/77f42b4b9d8a55c61f5c6daafa24b193b585b71c /opt/stack/data/nova/instances/_base/20e54b946f4cf7dc92eadf332bdf6be8df44c361 /opt/stack/data/nova/instances/_base/9a07d57e344ec80286b298c4f319568ce0a5732a /opt/stack/data/nova/instances/_base/ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e /opt/stack/data/nova/instances/_base/571637caf9d73ed6f84bf3b2d80cf4f3d9549016 /opt/stack/data/nova/instances/_base/bd32695172ba57e1ed00545e770a3d8ad7a865fd /opt/stack/data/nova/instances/_base/35f27fb980af7249e7cb681d1414dc30f8c46045
Nov 08 17:26:35 user nova-compute[74669]: INFO nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/628cf2431239f3d66297ec42212b020eb83182fd
Nov 08 17:26:35 user nova-compute[74669]: INFO nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/77f42b4b9d8a55c61f5c6daafa24b193b585b71c
Nov 08 17:26:35 user nova-compute[74669]: INFO nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/20e54b946f4cf7dc92eadf332bdf6be8df44c361
Nov 08 17:26:35 user nova-compute[74669]: INFO nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9a07d57e344ec80286b298c4f319568ce0a5732a
Nov 08 17:26:35 user nova-compute[74669]: INFO nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ee62c1a4029da7b21fe0655d6bc9e5aaf5b2cf1e
Nov 08 17:26:35 user nova-compute[74669]: INFO nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/571637caf9d73ed6f84bf3b2d80cf4f3d9549016
Nov 08 17:26:35 user nova-compute[74669]: INFO nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bd32695172ba57e1ed00545e770a3d8ad7a865fd
Nov 08 17:26:35 user nova-compute[74669]: INFO nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/35f27fb980af7249e7cb681d1414dc30f8c46045
Nov 08 17:26:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Verification complete {{(pid=74669) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 08 17:26:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Verify swap images {{(pid=74669) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 08 17:26:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.imagecache [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Verify ephemeral images {{(pid=74669) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 08 17:26:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "976336a5-8eb7-4cad-ae54-7153781f93d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:26:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "976336a5-8eb7-4cad-ae54-7153781f93d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:26:53 user nova-compute[74669]: DEBUG nova.compute.manager [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:26:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:26:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:26:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:26:53 user nova-compute[74669]: INFO nova.compute.claims [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Claim successful on node user
Nov 08 17:26:53 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:26:53 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:26:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:26:53 user nova-compute[74669]: DEBUG nova.compute.manager [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:26:53 user nova-compute[74669]: DEBUG nova.compute.manager [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:26:53 user nova-compute[74669]: DEBUG nova.network.neutron [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:26:53 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:26:53 user nova-compute[74669]: DEBUG nova.compute.manager [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:26:54 user nova-compute[74669]: INFO nova.virt.block_device [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Booting with volume snapshot e40ce96c-acb6-4cc5-a6bb-ca2919a019ae at /dev/vda
Nov 08 17:26:54 user nova-compute[74669]: DEBUG nova.policy [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0907ddd682244b7db3c2a10726fffb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be63fa80aa24b1e9c8d84e5f54c4270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:26:54 user nova-compute[74669]: DEBUG nova.network.neutron [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Successfully created port: 18405fa7-35c2-4c55-80c9-fbe427ab2e76 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:26:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:26:55 user nova-compute[74669]: DEBUG nova.network.neutron [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Successfully updated port: 18405fa7-35c2-4c55-80c9-fbe427ab2e76 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:26:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "refresh_cache-976336a5-8eb7-4cad-ae54-7153781f93d9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:26:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquired lock "refresh_cache-976336a5-8eb7-4cad-ae54-7153781f93d9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:26:55 user nova-compute[74669]: DEBUG nova.network.neutron [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:26:55 user nova-compute[74669]: DEBUG nova.compute.manager [req-2e1dd7f4-f4d2-4ee4-a2a0-0a615e0c50fe req-2f0d25b7-1375-40e9-b4ae-fead46c932f3 service nova] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Received event network-changed-18405fa7-35c2-4c55-80c9-fbe427ab2e76 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:26:55 user nova-compute[74669]: DEBUG nova.compute.manager [req-2e1dd7f4-f4d2-4ee4-a2a0-0a615e0c50fe req-2f0d25b7-1375-40e9-b4ae-fead46c932f3 service nova] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Refreshing instance network info cache due to event network-changed-18405fa7-35c2-4c55-80c9-fbe427ab2e76. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:26:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2e1dd7f4-f4d2-4ee4-a2a0-0a615e0c50fe req-2f0d25b7-1375-40e9-b4ae-fead46c932f3 service nova] Acquiring lock "refresh_cache-976336a5-8eb7-4cad-ae54-7153781f93d9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:26:55 user nova-compute[74669]: DEBUG nova.network.neutron [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:26:56 user nova-compute[74669]: DEBUG nova.network.neutron [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Updating instance_info_cache with network_info: [{"id": "18405fa7-35c2-4c55-80c9-fbe427ab2e76", "address": "fa:16:3e:fa:bf:30", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18405fa7-35", "ovs_interfaceid": "18405fa7-35c2-4c55-80c9-fbe427ab2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:26:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Releasing lock "refresh_cache-976336a5-8eb7-4cad-ae54-7153781f93d9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:26:56 user nova-compute[74669]: DEBUG nova.compute.manager [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Instance network_info: |[{"id": "18405fa7-35c2-4c55-80c9-fbe427ab2e76", "address": "fa:16:3e:fa:bf:30", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18405fa7-35", "ovs_interfaceid": "18405fa7-35c2-4c55-80c9-fbe427ab2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:26:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2e1dd7f4-f4d2-4ee4-a2a0-0a615e0c50fe req-2f0d25b7-1375-40e9-b4ae-fead46c932f3 service nova] Acquired lock "refresh_cache-976336a5-8eb7-4cad-ae54-7153781f93d9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:26:56 user nova-compute[74669]: DEBUG nova.network.neutron [req-2e1dd7f4-f4d2-4ee4-a2a0-0a615e0c50fe req-2f0d25b7-1375-40e9-b4ae-fead46c932f3 service nova] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Refreshing network info cache for port 18405fa7-35c2-4c55-80c9-fbe427ab2e76 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:26:56 user nova-compute[74669]: DEBUG nova.network.neutron [req-2e1dd7f4-f4d2-4ee4-a2a0-0a615e0c50fe req-2f0d25b7-1375-40e9-b4ae-fead46c932f3 service nova] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Updated VIF entry in instance network info cache for port 18405fa7-35c2-4c55-80c9-fbe427ab2e76. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:26:56 user nova-compute[74669]: DEBUG nova.network.neutron [req-2e1dd7f4-f4d2-4ee4-a2a0-0a615e0c50fe req-2f0d25b7-1375-40e9-b4ae-fead46c932f3 service nova] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Updating instance_info_cache with network_info: [{"id": "18405fa7-35c2-4c55-80c9-fbe427ab2e76", "address": "fa:16:3e:fa:bf:30", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18405fa7-35", "ovs_interfaceid": "18405fa7-35c2-4c55-80c9-fbe427ab2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:26:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2e1dd7f4-f4d2-4ee4-a2a0-0a615e0c50fe req-2f0d25b7-1375-40e9-b4ae-fead46c932f3 service nova] Releasing lock "refresh_cache-976336a5-8eb7-4cad-ae54-7153781f93d9" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:26:59 user nova-compute[74669]: DEBUG os_brick.utils [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:26:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:26:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:26:59 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0020b35-8e7b-455f-9602-9719fad751f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:26:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:26:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:26:59 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d9171f-dac7-4b92-9cf1-75344f3fa88b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:26:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:26:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:26:59 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[534fb7b9-d976-4d05-9996-9ee94080840c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:26:59 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[16200194-bb11-4b88-bd40-8f89a585216b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:26:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:26:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:26:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:26:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:26:59 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:26:59 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:26:59 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0440624-6069-481f-aaff-2e27837833cc]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:26:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:26:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:26:59 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:26:59 user nova-compute[74669]: DEBUG os_brick.utils [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:26:59 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Updating existing volume attachment record: 966d43ab-148d-4409-992f-d86c0eaed43d {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:27:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Acquiring lock "da037005-cd13-4276-83a8-68ba02a57350" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:27:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "da037005-cd13-4276-83a8-68ba02a57350" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:27:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:27:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:27:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:27:06 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:27:06 user nova-compute[74669]: INFO nova.compute.claims [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Claim successful on node user
Nov 08 17:27:06 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:27:06 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:27:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:27:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:27:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:27:06 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:27:06 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:27:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG nova.policy [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8c915ea3a094ac9b2766df66945880d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863682646f70460aa388b2715796755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG nova.compute.manager [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:27:07 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Creating image(s)
Nov 08 17:27:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Acquiring lock "/opt/stack/data/nova/instances/da037005-cd13-4276-83a8-68ba02a57350/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "/opt/stack/data/nova/instances/da037005-cd13-4276-83a8-68ba02a57350/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "/opt/stack/data/nova/instances/da037005-cd13-4276-83a8-68ba02a57350/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.196s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.197s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/da037005-cd13-4276-83a8-68ba02a57350/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/da037005-cd13-4276-83a8-68ba02a57350/disk 1073741824" returned: 0 in 0.047s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.190s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Successfully created port: 06908d1e-2a7c-4811-b616-782fb2e87075 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da037005-cd13-4276-83a8-68ba02a57350/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da037005-cd13-4276-83a8-68ba02a57350/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da037005-cd13-4276-83a8-68ba02a57350/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Cannot resize image /opt/stack/data/nova/instances/da037005-cd13-4276-83a8-68ba02a57350/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Ensure instance console log exists: /opt/stack/data/nova/instances/da037005-cd13-4276-83a8-68ba02a57350/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:27:07 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Successfully updated port: 06908d1e-2a7c-4811-b616-782fb2e87075 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Acquiring lock "refresh_cache-da037005-cd13-4276-83a8-68ba02a57350" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Acquired lock "refresh_cache-da037005-cd13-4276-83a8-68ba02a57350" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.compute.manager [req-19d60a4b-5374-4921-b851-4fb5f37388a5 req-01790dfc-8e73-4447-ab97-6e3bb4e329aa service nova] [instance: da037005-cd13-4276-83a8-68ba02a57350] Received event network-changed-06908d1e-2a7c-4811-b616-782fb2e87075 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.compute.manager [req-19d60a4b-5374-4921-b851-4fb5f37388a5 req-01790dfc-8e73-4447-ab97-6e3bb4e329aa service nova] [instance: da037005-cd13-4276-83a8-68ba02a57350] Refreshing instance network info cache due to event network-changed-06908d1e-2a7c-4811-b616-782fb2e87075. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-19d60a4b-5374-4921-b851-4fb5f37388a5 req-01790dfc-8e73-4447-ab97-6e3bb4e329aa service nova] Acquiring lock "refresh_cache-da037005-cd13-4276-83a8-68ba02a57350" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.network.neutron [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Updating instance_info_cache with network_info: [{"id": "06908d1e-2a7c-4811-b616-782fb2e87075", "address": "fa:16:3e:c2:71:02", "network": {"id": "300cee8e-ea32-456f-8ba3-c7c377e3c068", "bridge": "br-int", "label": "tempest-VolumesActionsTest-456444300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863682646f70460aa388b2715796755e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06908d1e-2a", "ovs_interfaceid": "06908d1e-2a7c-4811-b616-782fb2e87075", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Releasing lock "refresh_cache-da037005-cd13-4276-83a8-68ba02a57350" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.compute.manager [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Instance network_info: |[{"id": "06908d1e-2a7c-4811-b616-782fb2e87075", "address": "fa:16:3e:c2:71:02", "network": {"id": "300cee8e-ea32-456f-8ba3-c7c377e3c068", "bridge": "br-int", "label": "tempest-VolumesActionsTest-456444300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863682646f70460aa388b2715796755e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06908d1e-2a", "ovs_interfaceid": "06908d1e-2a7c-4811-b616-782fb2e87075", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-19d60a4b-5374-4921-b851-4fb5f37388a5 req-01790dfc-8e73-4447-ab97-6e3bb4e329aa service nova] Acquired lock "refresh_cache-da037005-cd13-4276-83a8-68ba02a57350" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.network.neutron [req-19d60a4b-5374-4921-b851-4fb5f37388a5 req-01790dfc-8e73-4447-ab97-6e3bb4e329aa service nova] [instance: da037005-cd13-4276-83a8-68ba02a57350] Refreshing network info cache for port 06908d1e-2a7c-4811-b616-782fb2e87075 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Start _get_guest_xml network_info=[{"id": "06908d1e-2a7c-4811-b616-782fb2e87075", "address": "fa:16:3e:c2:71:02", "network": {"id": "300cee8e-ea32-456f-8ba3-c7c377e3c068", "bridge": "br-int", "label": "tempest-VolumesActionsTest-456444300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863682646f70460aa388b2715796755e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06908d1e-2a", "ovs_interfaceid": "06908d1e-2a7c-4811-b616-782fb2e87075", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:27:08 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:27:08 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:27:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-629631651',display_name='tempest-VolumesActionsTest-instance-629631651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-629631651',id=44,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='863682646f70460aa388b2715796755e',ramdisk_id='',reservation_id='r-kthbnp54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-733585185',owner_user_name='tempest-VolumesActionsTest-733585185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:27:07Z,user_data=None,user_id='d8c915ea3a094ac9b2766df66945880d',uuid=da037005-cd13-4276-83a8-68ba02a57350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06908d1e-2a7c-4811-b616-782fb2e87075", "address": "fa:16:3e:c2:71:02", "network": {"id": "300cee8e-ea32-456f-8ba3-c7c377e3c068", "bridge": "br-int", "label": "tempest-VolumesActionsTest-456444300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863682646f70460aa388b2715796755e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06908d1e-2a", "ovs_interfaceid": "06908d1e-2a7c-4811-b616-782fb2e87075", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Converting VIF {"id": "06908d1e-2a7c-4811-b616-782fb2e87075", "address": "fa:16:3e:c2:71:02", "network": {"id": "300cee8e-ea32-456f-8ba3-c7c377e3c068", "bridge": "br-int", "label": "tempest-VolumesActionsTest-456444300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863682646f70460aa388b2715796755e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06908d1e-2a", "ovs_interfaceid": "06908d1e-2a7c-4811-b616-782fb2e87075", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:71:02,bridge_name='br-int',has_traffic_filtering=True,id=06908d1e-2a7c-4811-b616-782fb2e87075,network=Network(300cee8e-ea32-456f-8ba3-c7c377e3c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06908d1e-2a') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.objects.instance [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lazy-loading 'pci_devices' on Instance uuid da037005-cd13-4276-83a8-68ba02a57350 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:27:08 user nova-compute[74669]:   <uuid>da037005-cd13-4276-83a8-68ba02a57350</uuid>
Nov 08 17:27:08 user nova-compute[74669]:   <name>instance-0000002c</name>
Nov 08 17:27:08 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:27:08 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:27:08 user nova-compute[74669]:   <metadata>
Nov 08 17:27:08 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:27:08 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:27:08 user nova-compute[74669]:       <nova:name>tempest-VolumesActionsTest-instance-629631651</nova:name>
Nov 08 17:27:08 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:27:08</nova:creationTime>
Nov 08 17:27:08 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:27:08 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:27:08 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:27:08 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:27:08 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:27:08 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:27:08 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:27:08 user nova-compute[74669]:       <nova:owner>
Nov 08 17:27:08 user nova-compute[74669]:         <nova:user uuid="d8c915ea3a094ac9b2766df66945880d">tempest-VolumesActionsTest-733585185-project-member</nova:user>
Nov 08 17:27:08 user nova-compute[74669]:         <nova:project uuid="863682646f70460aa388b2715796755e">tempest-VolumesActionsTest-733585185</nova:project>
Nov 08 17:27:08 user nova-compute[74669]:       </nova:owner>
Nov 08 17:27:08 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:27:08 user nova-compute[74669]:       <nova:ports>
Nov 08 17:27:08 user nova-compute[74669]:         <nova:port uuid="06908d1e-2a7c-4811-b616-782fb2e87075">
Nov 08 17:27:08 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 17:27:08 user nova-compute[74669]:         </nova:port>
Nov 08 17:27:08 user nova-compute[74669]:       </nova:ports>
Nov 08 17:27:08 user nova-compute[74669]:     </nova:instance>
Nov 08 17:27:08 user nova-compute[74669]:   </metadata>
Nov 08 17:27:08 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:27:08 user nova-compute[74669]:     <system>
Nov 08 17:27:08 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:27:08 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:27:08 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:27:08 user nova-compute[74669]:       <entry name="serial">da037005-cd13-4276-83a8-68ba02a57350</entry>
Nov 08 17:27:08 user nova-compute[74669]:       <entry name="uuid">da037005-cd13-4276-83a8-68ba02a57350</entry>
Nov 08 17:27:08 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:27:08 user nova-compute[74669]:     </system>
Nov 08 17:27:08 user nova-compute[74669]:   </sysinfo>
Nov 08 17:27:08 user nova-compute[74669]:   <os>
Nov 08 17:27:08 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:27:08 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:27:08 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:27:08 user nova-compute[74669]:   </os>
Nov 08 17:27:08 user nova-compute[74669]:   <features>
Nov 08 17:27:08 user nova-compute[74669]:     <acpi/>
Nov 08 17:27:08 user nova-compute[74669]:     <apic/>
Nov 08 17:27:08 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:27:08 user nova-compute[74669]:   </features>
Nov 08 17:27:08 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:27:08 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:27:08 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:27:08 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:27:08 user nova-compute[74669]:   </clock>
Nov 08 17:27:08 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:27:08 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:27:08 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:27:08 user nova-compute[74669]:   </cpu>
Nov 08 17:27:08 user nova-compute[74669]:   <devices>
Nov 08 17:27:08 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:27:08 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:27:08 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/da037005-cd13-4276-83a8-68ba02a57350/disk"/>
Nov 08 17:27:08 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:27:08 user nova-compute[74669]:     </disk>
Nov 08 17:27:08 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:27:08 user nova-compute[74669]:       <mac address="fa:16:3e:c2:71:02"/>
Nov 08 17:27:08 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:27:08 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:27:08 user nova-compute[74669]:       <target dev="tap06908d1e-2a"/>
Nov 08 17:27:08 user nova-compute[74669]:     </interface>
Nov 08 17:27:08 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:27:08 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/da037005-cd13-4276-83a8-68ba02a57350/console.log" append="off"/>
Nov 08 17:27:08 user nova-compute[74669]:     </serial>
Nov 08 17:27:08 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:27:08 user nova-compute[74669]:     <video>
Nov 08 17:27:08 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:27:08 user nova-compute[74669]:     </video>
Nov 08 17:27:08 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:27:08 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:27:08 user nova-compute[74669]:     </rng>
Nov 08 17:27:08 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:27:08 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:27:08 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:27:08 user nova-compute[74669]:     </memballoon>
Nov 08 17:27:08 user nova-compute[74669]:   </devices>
Nov 08 17:27:08 user nova-compute[74669]: </domain>
Nov 08 17:27:08 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:27:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-629631651',display_name='tempest-VolumesActionsTest-instance-629631651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-629631651',id=44,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='863682646f70460aa388b2715796755e',ramdisk_id='',reservation_id='r-kthbnp54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-733585185',owner_user_name='tempest-VolumesActionsTest-733585185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:27:07Z,user_data=None,user_id='d8c915ea3a094ac9b2766df66945880d',uuid=da037005-cd13-4276-83a8-68ba02a57350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06908d1e-2a7c-4811-b616-782fb2e87075", "address": "fa:16:3e:c2:71:02", "network": {"id": "300cee8e-ea32-456f-8ba3-c7c377e3c068", "bridge": "br-int", "label": "tempest-VolumesActionsTest-456444300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863682646f70460aa388b2715796755e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06908d1e-2a", "ovs_interfaceid": "06908d1e-2a7c-4811-b616-782fb2e87075", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Converting VIF {"id": "06908d1e-2a7c-4811-b616-782fb2e87075", "address": "fa:16:3e:c2:71:02", "network": {"id": "300cee8e-ea32-456f-8ba3-c7c377e3c068", "bridge": "br-int", "label": "tempest-VolumesActionsTest-456444300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863682646f70460aa388b2715796755e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06908d1e-2a", "ovs_interfaceid": "06908d1e-2a7c-4811-b616-782fb2e87075", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:71:02,bridge_name='br-int',has_traffic_filtering=True,id=06908d1e-2a7c-4811-b616-782fb2e87075,network=Network(300cee8e-ea32-456f-8ba3-c7c377e3c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06908d1e-2a') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG os_vif [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:71:02,bridge_name='br-int',has_traffic_filtering=True,id=06908d1e-2a7c-4811-b616-782fb2e87075,network=Network(300cee8e-ea32-456f-8ba3-c7c377e3c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06908d1e-2a') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40ae778d-9ea4-537a-b023-8256ff9b4f64', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06908d1e-2a, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap06908d1e-2a, col_values=(('qos', UUID('f53f1838-7239-4bc1-aa40-23fd559893f3')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap06908d1e-2a, col_values=(('external_ids', {'iface-id': '06908d1e-2a7c-4811-b616-782fb2e87075', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:71:02', 'vm-uuid': 'da037005-cd13-4276-83a8-68ba02a57350'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:08 user nova-compute[74669]: INFO os_vif [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:71:02,bridge_name='br-int',has_traffic_filtering=True,id=06908d1e-2a7c-4811-b616-782fb2e87075,network=Network(300cee8e-ea32-456f-8ba3-c7c377e3c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06908d1e-2a')
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:27:08 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] No VIF found with MAC fa:16:3e:c2:71:02, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:27:09 user nova-compute[74669]: DEBUG nova.network.neutron [req-19d60a4b-5374-4921-b851-4fb5f37388a5 req-01790dfc-8e73-4447-ab97-6e3bb4e329aa service nova] [instance: da037005-cd13-4276-83a8-68ba02a57350] Updated VIF entry in instance network info cache for port 06908d1e-2a7c-4811-b616-782fb2e87075. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:27:09 user nova-compute[74669]: DEBUG nova.network.neutron [req-19d60a4b-5374-4921-b851-4fb5f37388a5 req-01790dfc-8e73-4447-ab97-6e3bb4e329aa service nova] [instance: da037005-cd13-4276-83a8-68ba02a57350] Updating instance_info_cache with network_info: [{"id": "06908d1e-2a7c-4811-b616-782fb2e87075", "address": "fa:16:3e:c2:71:02", "network": {"id": "300cee8e-ea32-456f-8ba3-c7c377e3c068", "bridge": "br-int", "label": "tempest-VolumesActionsTest-456444300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863682646f70460aa388b2715796755e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06908d1e-2a", "ovs_interfaceid": "06908d1e-2a7c-4811-b616-782fb2e87075", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:27:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-19d60a4b-5374-4921-b851-4fb5f37388a5 req-01790dfc-8e73-4447-ab97-6e3bb4e329aa service nova] Releasing lock "refresh_cache-da037005-cd13-4276-83a8-68ba02a57350" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:27:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:10 user nova-compute[74669]: DEBUG nova.compute.manager [req-ec8e61c2-666e-4a77-ad42-5ec88b648454 req-b32cc6ca-d66d-4084-9899-de0ea19312a9 service nova] [instance: da037005-cd13-4276-83a8-68ba02a57350] Received event network-vif-plugged-06908d1e-2a7c-4811-b616-782fb2e87075 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:27:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ec8e61c2-666e-4a77-ad42-5ec88b648454 req-b32cc6ca-d66d-4084-9899-de0ea19312a9 service nova] Acquiring lock "da037005-cd13-4276-83a8-68ba02a57350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:27:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ec8e61c2-666e-4a77-ad42-5ec88b648454 req-b32cc6ca-d66d-4084-9899-de0ea19312a9 service nova] Lock "da037005-cd13-4276-83a8-68ba02a57350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:27:10 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ec8e61c2-666e-4a77-ad42-5ec88b648454 req-b32cc6ca-d66d-4084-9899-de0ea19312a9 service nova] Lock "da037005-cd13-4276-83a8-68ba02a57350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:27:10 user nova-compute[74669]: DEBUG nova.compute.manager [req-ec8e61c2-666e-4a77-ad42-5ec88b648454 req-b32cc6ca-d66d-4084-9899-de0ea19312a9 service nova] [instance: da037005-cd13-4276-83a8-68ba02a57350] No waiting events found dispatching network-vif-plugged-06908d1e-2a7c-4811-b616-782fb2e87075 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:27:10 user nova-compute[74669]: WARNING nova.compute.manager [req-ec8e61c2-666e-4a77-ad42-5ec88b648454 req-b32cc6ca-d66d-4084-9899-de0ea19312a9 service nova] [instance: da037005-cd13-4276-83a8-68ba02a57350] Received unexpected event network-vif-plugged-06908d1e-2a7c-4811-b616-782fb2e87075 for instance with vm_state building and task_state spawning.
Nov 08 17:27:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:12 user nova-compute[74669]: DEBUG nova.compute.manager [req-f3ef340f-2a7a-449b-ae0a-204e9ec71f95 req-ca5195c9-2929-4583-8cbd-18f99095c59b service nova] [instance: da037005-cd13-4276-83a8-68ba02a57350] Received event network-vif-plugged-06908d1e-2a7c-4811-b616-782fb2e87075 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:27:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f3ef340f-2a7a-449b-ae0a-204e9ec71f95 req-ca5195c9-2929-4583-8cbd-18f99095c59b service nova] Acquiring lock "da037005-cd13-4276-83a8-68ba02a57350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:27:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f3ef340f-2a7a-449b-ae0a-204e9ec71f95 req-ca5195c9-2929-4583-8cbd-18f99095c59b service nova] Lock "da037005-cd13-4276-83a8-68ba02a57350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:27:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f3ef340f-2a7a-449b-ae0a-204e9ec71f95 req-ca5195c9-2929-4583-8cbd-18f99095c59b service nova] Lock "da037005-cd13-4276-83a8-68ba02a57350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:27:12 user nova-compute[74669]: DEBUG nova.compute.manager [req-f3ef340f-2a7a-449b-ae0a-204e9ec71f95 req-ca5195c9-2929-4583-8cbd-18f99095c59b service nova] [instance: da037005-cd13-4276-83a8-68ba02a57350] No waiting events found dispatching network-vif-plugged-06908d1e-2a7c-4811-b616-782fb2e87075 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:27:12 user nova-compute[74669]: WARNING nova.compute.manager [req-f3ef340f-2a7a-449b-ae0a-204e9ec71f95 req-ca5195c9-2929-4583-8cbd-18f99095c59b service nova] [instance: da037005-cd13-4276-83a8-68ba02a57350] Received unexpected event network-vif-plugged-06908d1e-2a7c-4811-b616-782fb2e87075 for instance with vm_state building and task_state spawning.
Nov 08 17:27:12 user nova-compute[74669]: DEBUG nova.compute.manager [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:27:12 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:27:12 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: da037005-cd13-4276-83a8-68ba02a57350] Instance spawned successfully.
Nov 08 17:27:12 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:27:12 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:27:12 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:27:12 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:27:12 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:27:12 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:27:12 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:27:12 user nova-compute[74669]: INFO nova.compute.manager [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Took 5.64 seconds to spawn the instance on the hypervisor.
Nov 08 17:27:12 user nova-compute[74669]: DEBUG nova.compute.manager [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:27:12 user nova-compute[74669]: INFO nova.compute.manager [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Took 6.22 seconds to build instance.
Nov 08 17:27:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-f65423a6-7c43-43ac-b023-c3e47baa36a9 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "da037005-cd13-4276-83a8-68ba02a57350" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.334s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:27:12 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:27:12 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:27:12 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:27:13 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:27:13 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:27:13 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74669) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 17:27:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:15 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:27:15 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:27:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:27:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:27:15 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:27:16 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Updating instance_info_cache with network_info: [{"id": "a4820eb9-3a23-479e-b429-47171c75f100", "address": "fa:16:3e:12:b9:b1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4820eb9-3a", "ovs_interfaceid": "a4820eb9-3a23-479e-b429-47171c75f100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:27:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:27:16 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:27:16 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:27:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:27:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:27:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:27:16 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:27:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:27:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da037005-cd13-4276-83a8-68ba02a57350/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:27:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da037005-cd13-4276-83a8-68ba02a57350/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:27:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da037005-cd13-4276-83a8-68ba02a57350/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:27:17 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da037005-cd13-4276-83a8-68ba02a57350/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:27:17 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:27:17 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:27:17 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:27:17 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:27:17 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:27:17 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:27:17 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8695MB free_disk=25.15615463256836GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:27:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:27:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:27:18 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0796133c-71d6-4d64-94af-49028a6603ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:27:18 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance fa8c4d88-8b6c-4ef6-9876-62597ace9c37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:27:18 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 976336a5-8eb7-4cad-ae54-7153781f93d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:27:18 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance da037005-cd13-4276-83a8-68ba02a57350 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:27:18 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:27:18 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:27:18 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing inventories for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 17:27:18 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Updating ProviderTree inventory for provider ce26964b-e55b-43d2-801a-7221ff1fe64b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 17:27:18 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Updating inventory in ProviderTree for provider ce26964b-e55b-43d2-801a-7221ff1fe64b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 17:27:18 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing aggregate associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, aggregates: None {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 17:27:18 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing trait associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, traits: HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 17:27:18 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:27:18 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:27:18 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:27:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.597s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:27:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:20 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:27:20 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:27:20 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:27:20 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG nova.compute.manager [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:27:23 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Creating image(s)
Nov 08 17:27:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Did not create local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Ensure instance console log exists: /opt/stack/data/nova/instances/976336a5-8eb7-4cad-ae54-7153781f93d9/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Start _get_guest_xml network_info=[{"id": "18405fa7-35c2-4c55-80c9-fbe427ab2e76", "address": "fa:16:3e:fa:bf:30", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18405fa7-35", "ovs_interfaceid": "18405fa7-35c2-4c55-80c9-fbe427ab2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '966d43ab-148d-4409-992f-d86c0eaed43d', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AauMVebh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '976336a5-8eb7-4cad-ae54-7153781f93d9', 'attached_at': '', 'detached_at': '', 'volume_id': 'b7e48e29-0284-45fd-911f-99e810278d50', 'serial': 'b7e48e29-0284-45fd-911f-99e810278d50'}, 'guest_format': None, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:27:23 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:27:23 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:27:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AauMVebh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:27:23 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:27:23 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:27:23 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cf5c82-2da9-4c4c-b5e3-37b66c24744b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:27:23 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9f1a73-2193-409f-8f3c-ad3cad5ca0e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50] added
Nov 08 17:27:23 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a266eb-c60d-4040-946b-4f3cf6dd19c7]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eccdf7-cb4c-4388-925a-9740dd14dd70]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AauMVebh {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AauMVebh" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae9c80c-1bbd-4838-ac81-c1be09d6b5df]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AauMVebh'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee07168-4251-457a-8ee3-a21d2ea1336f]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c429b60f-cab3-4451-babc-e04318c7258c]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:27:23 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:27:23 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d306f64-ff13-44a2-80f0-146efcc73b7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50, portal: 172.16.0.220,3260]
Nov 08 17:27:23 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50, portal: 172.16.0.220,3260] successful.
Nov 08 17:27:23 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ee0c08-bba1-4781-b2cc-f1e96ff1c02e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f241f8-8209-4a16-aaaa-134fe2a4244d]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:27:23 user nova-compute[74669]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 (non-flash)
Nov 08 17:27:23 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:27:23 user nova-compute[74669]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 (non-flash)
Nov 08 17:27:23 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d3f0e0-1480-4dc9-8fe0-0fe61552cdb6]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AauMVebh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:27:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23237396631383939', 'path': '/dev/sdc'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237396631383939', 'path': '/dev/sdc'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-69028233',display_name='tempest-TestVolumeBootPattern-server-69028233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-69028233',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5be63fa80aa24b1e9c8d84e5f54c4270',ramdisk_id='',reservation_id='r-du7t14vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-632748264',owner_user_name='tempest-TestVolumeBootPattern-632748264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:26:54Z,user_data=None,user_id='0907ddd682244b7db3c2a10726fffb46',uuid=976336a5-8eb7-4cad-ae54-7153781f93d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18405fa7-35c2-4c55-80c9-fbe427ab2e76", "address": "fa:16:3e:fa:bf:30", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18405fa7-35", "ovs_interfaceid": "18405fa7-35c2-4c55-80c9-fbe427ab2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converting VIF {"id": "18405fa7-35c2-4c55-80c9-fbe427ab2e76", "address": "fa:16:3e:fa:bf:30", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18405fa7-35", "ovs_interfaceid": "18405fa7-35c2-4c55-80c9-fbe427ab2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:bf:30,bridge_name='br-int',has_traffic_filtering=True,id=18405fa7-35c2-4c55-80c9-fbe427ab2e76,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18405fa7-35') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG nova.objects.instance [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lazy-loading 'pci_devices' on Instance uuid 976336a5-8eb7-4cad-ae54-7153781f93d9 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:27:24 user nova-compute[74669]:   <uuid>976336a5-8eb7-4cad-ae54-7153781f93d9</uuid>
Nov 08 17:27:24 user nova-compute[74669]:   <name>instance-0000002b</name>
Nov 08 17:27:24 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:27:24 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:27:24 user nova-compute[74669]:   <metadata>
Nov 08 17:27:24 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:27:24 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:27:24 user nova-compute[74669]:       <nova:name>tempest-TestVolumeBootPattern-server-69028233</nova:name>
Nov 08 17:27:24 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:27:23</nova:creationTime>
Nov 08 17:27:24 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:27:24 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:27:24 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:27:24 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:27:24 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:27:24 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:27:24 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:27:24 user nova-compute[74669]:       <nova:owner>
Nov 08 17:27:24 user nova-compute[74669]:         <nova:user uuid="0907ddd682244b7db3c2a10726fffb46">tempest-TestVolumeBootPattern-632748264-project-member</nova:user>
Nov 08 17:27:24 user nova-compute[74669]:         <nova:project uuid="5be63fa80aa24b1e9c8d84e5f54c4270">tempest-TestVolumeBootPattern-632748264</nova:project>
Nov 08 17:27:24 user nova-compute[74669]:       </nova:owner>
Nov 08 17:27:24 user nova-compute[74669]:       <nova:ports>
Nov 08 17:27:24 user nova-compute[74669]:         <nova:port uuid="18405fa7-35c2-4c55-80c9-fbe427ab2e76">
Nov 08 17:27:24 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 17:27:24 user nova-compute[74669]:         </nova:port>
Nov 08 17:27:24 user nova-compute[74669]:       </nova:ports>
Nov 08 17:27:24 user nova-compute[74669]:     </nova:instance>
Nov 08 17:27:24 user nova-compute[74669]:   </metadata>
Nov 08 17:27:24 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:27:24 user nova-compute[74669]:     <system>
Nov 08 17:27:24 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:27:24 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:27:24 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:27:24 user nova-compute[74669]:       <entry name="serial">976336a5-8eb7-4cad-ae54-7153781f93d9</entry>
Nov 08 17:27:24 user nova-compute[74669]:       <entry name="uuid">976336a5-8eb7-4cad-ae54-7153781f93d9</entry>
Nov 08 17:27:24 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:27:24 user nova-compute[74669]:     </system>
Nov 08 17:27:24 user nova-compute[74669]:   </sysinfo>
Nov 08 17:27:24 user nova-compute[74669]:   <os>
Nov 08 17:27:24 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:27:24 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:27:24 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:27:24 user nova-compute[74669]:   </os>
Nov 08 17:27:24 user nova-compute[74669]:   <features>
Nov 08 17:27:24 user nova-compute[74669]:     <acpi/>
Nov 08 17:27:24 user nova-compute[74669]:     <apic/>
Nov 08 17:27:24 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:27:24 user nova-compute[74669]:   </features>
Nov 08 17:27:24 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:27:24 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:27:24 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:27:24 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:27:24 user nova-compute[74669]:   </clock>
Nov 08 17:27:24 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:27:24 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:27:24 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:27:24 user nova-compute[74669]:   </cpu>
Nov 08 17:27:24 user nova-compute[74669]:   <devices>
Nov 08 17:27:24 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 17:27:24 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:27:24 user nova-compute[74669]:       <source dev="/dev/sdc"/>
Nov 08 17:27:24 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:27:24 user nova-compute[74669]:       <serial>b7e48e29-0284-45fd-911f-99e810278d50</serial>
Nov 08 17:27:24 user nova-compute[74669]:     </disk>
Nov 08 17:27:24 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:27:24 user nova-compute[74669]:       <mac address="fa:16:3e:fa:bf:30"/>
Nov 08 17:27:24 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:27:24 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:27:24 user nova-compute[74669]:       <target dev="tap18405fa7-35"/>
Nov 08 17:27:24 user nova-compute[74669]:     </interface>
Nov 08 17:27:24 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:27:24 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/976336a5-8eb7-4cad-ae54-7153781f93d9/console.log" append="off"/>
Nov 08 17:27:24 user nova-compute[74669]:     </serial>
Nov 08 17:27:24 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:27:24 user nova-compute[74669]:     <video>
Nov 08 17:27:24 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:27:24 user nova-compute[74669]:     </video>
Nov 08 17:27:24 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:27:24 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:27:24 user nova-compute[74669]:     </rng>
Nov 08 17:27:24 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:27:24 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:27:24 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:27:24 user nova-compute[74669]:     </memballoon>
Nov 08 17:27:24 user nova-compute[74669]:   </devices>
Nov 08 17:27:24 user nova-compute[74669]: </domain>
Nov 08 17:27:24 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-69028233',display_name='tempest-TestVolumeBootPattern-server-69028233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-69028233',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5be63fa80aa24b1e9c8d84e5f54c4270',ramdisk_id='',reservation_id='r-du7t14vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-632748264',owner_user_name='tempest-TestVolumeBootPattern-632748264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:26:54Z,user_data=None,user_id='0907ddd682244b7db3c2a10726fffb46',uuid=976336a5-8eb7-4cad-ae54-7153781f93d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18405fa7-35c2-4c55-80c9-fbe427ab2e76", "address": "fa:16:3e:fa:bf:30", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18405fa7-35", "ovs_interfaceid": "18405fa7-35c2-4c55-80c9-fbe427ab2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converting VIF {"id": "18405fa7-35c2-4c55-80c9-fbe427ab2e76", "address": "fa:16:3e:fa:bf:30", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18405fa7-35", "ovs_interfaceid": "18405fa7-35c2-4c55-80c9-fbe427ab2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:bf:30,bridge_name='br-int',has_traffic_filtering=True,id=18405fa7-35c2-4c55-80c9-fbe427ab2e76,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18405fa7-35') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG os_vif [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:bf:30,bridge_name='br-int',has_traffic_filtering=True,id=18405fa7-35c2-4c55-80c9-fbe427ab2e76,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18405fa7-35') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f1387bf-a866-5d8f-ad60-afe5772c1c28', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18405fa7-35, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18405fa7-35, col_values=(('qos', UUID('61be9be7-eda5-4dd1-9bc4-bdca361772ce')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18405fa7-35, col_values=(('external_ids', {'iface-id': '18405fa7-35c2-4c55-80c9-fbe427ab2e76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:bf:30', 'vm-uuid': '976336a5-8eb7-4cad-ae54-7153781f93d9'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:27:24 user nova-compute[74669]: INFO os_vif [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:bf:30,bridge_name='br-int',has_traffic_filtering=True,id=18405fa7-35c2-4c55-80c9-fbe427ab2e76,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18405fa7-35')
Nov 08 17:27:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:27:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] No VIF found with MAC fa:16:3e:fa:bf:30, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:27:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-d336cdad-586e-4500-a071-55de8a311eb2 req-62cc05b1-885a-421d-b884-8804d6263447 service nova] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Received event network-vif-plugged-18405fa7-35c2-4c55-80c9-fbe427ab2e76 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:27:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d336cdad-586e-4500-a071-55de8a311eb2 req-62cc05b1-885a-421d-b884-8804d6263447 service nova] Acquiring lock "976336a5-8eb7-4cad-ae54-7153781f93d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:27:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d336cdad-586e-4500-a071-55de8a311eb2 req-62cc05b1-885a-421d-b884-8804d6263447 service nova] Lock "976336a5-8eb7-4cad-ae54-7153781f93d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:27:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d336cdad-586e-4500-a071-55de8a311eb2 req-62cc05b1-885a-421d-b884-8804d6263447 service nova] Lock "976336a5-8eb7-4cad-ae54-7153781f93d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:27:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-d336cdad-586e-4500-a071-55de8a311eb2 req-62cc05b1-885a-421d-b884-8804d6263447 service nova] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] No waiting events found dispatching network-vif-plugged-18405fa7-35c2-4c55-80c9-fbe427ab2e76 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:27:26 user nova-compute[74669]: WARNING nova.compute.manager [req-d336cdad-586e-4500-a071-55de8a311eb2 req-62cc05b1-885a-421d-b884-8804d6263447 service nova] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Received unexpected event network-vif-plugged-18405fa7-35c2-4c55-80c9-fbe427ab2e76 for instance with vm_state building and task_state spawning.
Nov 08 17:27:26 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:27:26 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 17:27:26 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] There are 0 instances to clean {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 17:27:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:26 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:28 user nova-compute[74669]: DEBUG nova.compute.manager [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:27:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:27:28 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Instance spawned successfully.
Nov 08 17:27:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:27:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:27:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:27:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:27:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:27:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:27:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:27:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-ab447188-65dc-447d-b4a9-83c63d1786ad req-431f38d6-3548-45b8-abdf-8b6e88c5944e service nova] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Received event network-vif-plugged-18405fa7-35c2-4c55-80c9-fbe427ab2e76 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:27:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ab447188-65dc-447d-b4a9-83c63d1786ad req-431f38d6-3548-45b8-abdf-8b6e88c5944e service nova] Acquiring lock "976336a5-8eb7-4cad-ae54-7153781f93d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:27:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ab447188-65dc-447d-b4a9-83c63d1786ad req-431f38d6-3548-45b8-abdf-8b6e88c5944e service nova] Lock "976336a5-8eb7-4cad-ae54-7153781f93d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:27:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ab447188-65dc-447d-b4a9-83c63d1786ad req-431f38d6-3548-45b8-abdf-8b6e88c5944e service nova] Lock "976336a5-8eb7-4cad-ae54-7153781f93d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:27:28 user nova-compute[74669]: DEBUG nova.compute.manager [req-ab447188-65dc-447d-b4a9-83c63d1786ad req-431f38d6-3548-45b8-abdf-8b6e88c5944e service nova] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] No waiting events found dispatching network-vif-plugged-18405fa7-35c2-4c55-80c9-fbe427ab2e76 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:27:28 user nova-compute[74669]: WARNING nova.compute.manager [req-ab447188-65dc-447d-b4a9-83c63d1786ad req-431f38d6-3548-45b8-abdf-8b6e88c5944e service nova] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Received unexpected event network-vif-plugged-18405fa7-35c2-4c55-80c9-fbe427ab2e76 for instance with vm_state building and task_state spawning.
Nov 08 17:27:28 user nova-compute[74669]: INFO nova.compute.manager [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 08 17:27:28 user nova-compute[74669]: DEBUG nova.compute.manager [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:27:28 user nova-compute[74669]: INFO nova.compute.manager [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Took 35.08 seconds to build instance.
Nov 08 17:27:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-eab882eb-5353-4be7-8f00-ad6494b8b0c4 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "976336a5-8eb7-4cad-ae54-7153781f93d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.175s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:27:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:29 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:27:30 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:27:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:27:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:27:59 user nova-compute[74669]: DEBUG nova.compute.manager [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:27:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:27:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:27:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:27:59 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:27:59 user nova-compute[74669]: INFO nova.compute.claims [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Claim successful on node user
Nov 08 17:27:59 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:27:59 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG nova.compute.manager [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG nova.compute.manager [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG nova.network.neutron [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:28:00 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:28:00 user nova-compute[74669]: DEBUG nova.compute.manager [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG nova.policy [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1fcd1d4cf714f62aa8648b27a04c04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08551815597744d89e3a61d190a9b8a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG nova.compute.manager [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:28:00 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Creating image(s)
Nov 08 17:28:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "/opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "/opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "/opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.190s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.173s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk 1073741824" returned: 0 in 0.061s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "87106a141e68d5b6b33d8e32a1c862b7a80ef956" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.173s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk. size=1073741824 {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:28:00 user nova-compute[74669]: DEBUG nova.network.neutron [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Successfully created port: f021aef7-a8e3-4f01-8825-378de286cdbb {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:28:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:28:01 user nova-compute[74669]: DEBUG nova.virt.disk.api [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Cannot resize image /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk to a smaller size. {{(pid=74669) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 17:28:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:28:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Ensure instance console log exists: /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:28:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:28:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:28:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Successfully updated port: f021aef7-a8e3-4f01-8825-378de286cdbb {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:28:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "refresh_cache-49657a40-5c34-43d3-9bb5-b78dab52d2ff" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:28:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquired lock "refresh_cache-49657a40-5c34-43d3-9bb5-b78dab52d2ff" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:28:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:28:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:28:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-cf78ad3f-239f-4e7c-b558-803b03508c0d req-3e2a61b5-17f1-4007-9d83-47f8ff28b2ac service nova] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Received event network-changed-f021aef7-a8e3-4f01-8825-378de286cdbb {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:28:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-cf78ad3f-239f-4e7c-b558-803b03508c0d req-3e2a61b5-17f1-4007-9d83-47f8ff28b2ac service nova] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Refreshing instance network info cache due to event network-changed-f021aef7-a8e3-4f01-8825-378de286cdbb. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:28:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-cf78ad3f-239f-4e7c-b558-803b03508c0d req-3e2a61b5-17f1-4007-9d83-47f8ff28b2ac service nova] Acquiring lock "refresh_cache-49657a40-5c34-43d3-9bb5-b78dab52d2ff" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.network.neutron [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Updating instance_info_cache with network_info: [{"id": "f021aef7-a8e3-4f01-8825-378de286cdbb", "address": "fa:16:3e:37:64:f1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf021aef7-a8", "ovs_interfaceid": "f021aef7-a8e3-4f01-8825-378de286cdbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Releasing lock "refresh_cache-49657a40-5c34-43d3-9bb5-b78dab52d2ff" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.compute.manager [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Instance network_info: |[{"id": "f021aef7-a8e3-4f01-8825-378de286cdbb", "address": "fa:16:3e:37:64:f1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf021aef7-a8", "ovs_interfaceid": "f021aef7-a8e3-4f01-8825-378de286cdbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-cf78ad3f-239f-4e7c-b558-803b03508c0d req-3e2a61b5-17f1-4007-9d83-47f8ff28b2ac service nova] Acquired lock "refresh_cache-49657a40-5c34-43d3-9bb5-b78dab52d2ff" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.network.neutron [req-cf78ad3f-239f-4e7c-b558-803b03508c0d req-3e2a61b5-17f1-4007-9d83-47f8ff28b2ac service nova] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Refreshing network info cache for port f021aef7-a8e3-4f01-8825-378de286cdbb {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Start _get_guest_xml network_info=[{"id": "f021aef7-a8e3-4f01-8825-378de286cdbb", "address": "fa:16:3e:37:64:f1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf021aef7-a8", "ovs_interfaceid": "f021aef7-a8e3-4f01-8825-378de286cdbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'boot_index': 0, 'size': 0, 'guest_format': None, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'ee6edaa4-6206-44ab-8497-fdbc2291f87f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:28:02 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:28:02 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1455283578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1455283578',id=45,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08551815597744d89e3a61d190a9b8a7',ramdisk_id='',reservation_id='r-1hdsfeqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293450045',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:28:00Z,user_data=None,user_id='b1fcd1d4cf714f62aa8648b27a04c04e',uuid=49657a40-5c34-43d3-9bb5-b78dab52d2ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f021aef7-a8e3-4f01-8825-378de286cdbb", "address": "fa:16:3e:37:64:f1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf021aef7-a8", "ovs_interfaceid": "f021aef7-a8e3-4f01-8825-378de286cdbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converting VIF {"id": "f021aef7-a8e3-4f01-8825-378de286cdbb", "address": "fa:16:3e:37:64:f1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf021aef7-a8", "ovs_interfaceid": "f021aef7-a8e3-4f01-8825-378de286cdbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:64:f1,bridge_name='br-int',has_traffic_filtering=True,id=f021aef7-a8e3-4f01-8825-378de286cdbb,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf021aef7-a8') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.objects.instance [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lazy-loading 'pci_devices' on Instance uuid 49657a40-5c34-43d3-9bb5-b78dab52d2ff {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:28:02 user nova-compute[74669]:   <uuid>49657a40-5c34-43d3-9bb5-b78dab52d2ff</uuid>
Nov 08 17:28:02 user nova-compute[74669]:   <name>instance-0000002d</name>
Nov 08 17:28:02 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:28:02 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:28:02 user nova-compute[74669]:   <metadata>
Nov 08 17:28:02 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:28:02 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:28:02 user nova-compute[74669]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1455283578</nova:name>
Nov 08 17:28:02 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:28:02</nova:creationTime>
Nov 08 17:28:02 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:28:02 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:28:02 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:28:02 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:28:02 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:28:02 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:28:02 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:28:02 user nova-compute[74669]:       <nova:owner>
Nov 08 17:28:02 user nova-compute[74669]:         <nova:user uuid="b1fcd1d4cf714f62aa8648b27a04c04e">tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member</nova:user>
Nov 08 17:28:02 user nova-compute[74669]:         <nova:project uuid="08551815597744d89e3a61d190a9b8a7">tempest-ServerBootFromVolumeStableRescueTest-293450045</nova:project>
Nov 08 17:28:02 user nova-compute[74669]:       </nova:owner>
Nov 08 17:28:02 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:28:02 user nova-compute[74669]:       <nova:ports>
Nov 08 17:28:02 user nova-compute[74669]:         <nova:port uuid="f021aef7-a8e3-4f01-8825-378de286cdbb">
Nov 08 17:28:02 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 17:28:02 user nova-compute[74669]:         </nova:port>
Nov 08 17:28:02 user nova-compute[74669]:       </nova:ports>
Nov 08 17:28:02 user nova-compute[74669]:     </nova:instance>
Nov 08 17:28:02 user nova-compute[74669]:   </metadata>
Nov 08 17:28:02 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:28:02 user nova-compute[74669]:     <system>
Nov 08 17:28:02 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:28:02 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:28:02 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:28:02 user nova-compute[74669]:       <entry name="serial">49657a40-5c34-43d3-9bb5-b78dab52d2ff</entry>
Nov 08 17:28:02 user nova-compute[74669]:       <entry name="uuid">49657a40-5c34-43d3-9bb5-b78dab52d2ff</entry>
Nov 08 17:28:02 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:28:02 user nova-compute[74669]:     </system>
Nov 08 17:28:02 user nova-compute[74669]:   </sysinfo>
Nov 08 17:28:02 user nova-compute[74669]:   <os>
Nov 08 17:28:02 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:28:02 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:28:02 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:28:02 user nova-compute[74669]:   </os>
Nov 08 17:28:02 user nova-compute[74669]:   <features>
Nov 08 17:28:02 user nova-compute[74669]:     <acpi/>
Nov 08 17:28:02 user nova-compute[74669]:     <apic/>
Nov 08 17:28:02 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:28:02 user nova-compute[74669]:   </features>
Nov 08 17:28:02 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:28:02 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:28:02 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:28:02 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:28:02 user nova-compute[74669]:   </clock>
Nov 08 17:28:02 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:28:02 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:28:02 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:28:02 user nova-compute[74669]:   </cpu>
Nov 08 17:28:02 user nova-compute[74669]:   <devices>
Nov 08 17:28:02 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:28:02 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:28:02 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk"/>
Nov 08 17:28:02 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:28:02 user nova-compute[74669]:     </disk>
Nov 08 17:28:02 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:28:02 user nova-compute[74669]:       <mac address="fa:16:3e:37:64:f1"/>
Nov 08 17:28:02 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:28:02 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:28:02 user nova-compute[74669]:       <target dev="tapf021aef7-a8"/>
Nov 08 17:28:02 user nova-compute[74669]:     </interface>
Nov 08 17:28:02 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:28:02 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/console.log" append="off"/>
Nov 08 17:28:02 user nova-compute[74669]:     </serial>
Nov 08 17:28:02 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:28:02 user nova-compute[74669]:     <video>
Nov 08 17:28:02 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:28:02 user nova-compute[74669]:     </video>
Nov 08 17:28:02 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:28:02 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:28:02 user nova-compute[74669]:     </rng>
Nov 08 17:28:02 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:28:02 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:28:02 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:28:02 user nova-compute[74669]:     </memballoon>
Nov 08 17:28:02 user nova-compute[74669]:   </devices>
Nov 08 17:28:02 user nova-compute[74669]: </domain>
Nov 08 17:28:02 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1455283578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1455283578',id=45,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08551815597744d89e3a61d190a9b8a7',ramdisk_id='',reservation_id='r-1hdsfeqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293450045',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:28:00Z,user_data=None,user_id='b1fcd1d4cf714f62aa8648b27a04c04e',uuid=49657a40-5c34-43d3-9bb5-b78dab52d2ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f021aef7-a8e3-4f01-8825-378de286cdbb", "address": "fa:16:3e:37:64:f1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf021aef7-a8", "ovs_interfaceid": "f021aef7-a8e3-4f01-8825-378de286cdbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converting VIF {"id": "f021aef7-a8e3-4f01-8825-378de286cdbb", "address": "fa:16:3e:37:64:f1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf021aef7-a8", "ovs_interfaceid": "f021aef7-a8e3-4f01-8825-378de286cdbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:64:f1,bridge_name='br-int',has_traffic_filtering=True,id=f021aef7-a8e3-4f01-8825-378de286cdbb,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf021aef7-a8') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG os_vif [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:64:f1,bridge_name='br-int',has_traffic_filtering=True,id=f021aef7-a8e3-4f01-8825-378de286cdbb,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf021aef7-a8') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0504a203-8654-5de9-ba63-8900ee84efc8', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf021aef7-a8, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf021aef7-a8, col_values=(('qos', UUID('d462e175-4ecc-4702-be6a-0664b90ab09b')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf021aef7-a8, col_values=(('external_ids', {'iface-id': 'f021aef7-a8e3-4f01-8825-378de286cdbb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:64:f1', 'vm-uuid': '49657a40-5c34-43d3-9bb5-b78dab52d2ff'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:02 user nova-compute[74669]: INFO os_vif [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:64:f1,bridge_name='br-int',has_traffic_filtering=True,id=f021aef7-a8e3-4f01-8825-378de286cdbb,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf021aef7-a8')
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] No VIF found with MAC fa:16:3e:37:64:f1, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.network.neutron [req-cf78ad3f-239f-4e7c-b558-803b03508c0d req-3e2a61b5-17f1-4007-9d83-47f8ff28b2ac service nova] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Updated VIF entry in instance network info cache for port f021aef7-a8e3-4f01-8825-378de286cdbb. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG nova.network.neutron [req-cf78ad3f-239f-4e7c-b558-803b03508c0d req-3e2a61b5-17f1-4007-9d83-47f8ff28b2ac service nova] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Updating instance_info_cache with network_info: [{"id": "f021aef7-a8e3-4f01-8825-378de286cdbb", "address": "fa:16:3e:37:64:f1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf021aef7-a8", "ovs_interfaceid": "f021aef7-a8e3-4f01-8825-378de286cdbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:28:02 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-cf78ad3f-239f-4e7c-b558-803b03508c0d req-3e2a61b5-17f1-4007-9d83-47f8ff28b2ac service nova] Releasing lock "refresh_cache-49657a40-5c34-43d3-9bb5-b78dab52d2ff" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:28:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:03 user nova-compute[74669]: DEBUG nova.compute.manager [req-28db6792-b07f-496a-88dc-4543ab7fba7d req-09501d5e-18d3-4a05-aae7-c5992cde0d7f service nova] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Received event network-vif-plugged-f021aef7-a8e3-4f01-8825-378de286cdbb {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:28:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-28db6792-b07f-496a-88dc-4543ab7fba7d req-09501d5e-18d3-4a05-aae7-c5992cde0d7f service nova] Acquiring lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:28:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-28db6792-b07f-496a-88dc-4543ab7fba7d req-09501d5e-18d3-4a05-aae7-c5992cde0d7f service nova] Lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:28:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-28db6792-b07f-496a-88dc-4543ab7fba7d req-09501d5e-18d3-4a05-aae7-c5992cde0d7f service nova] Lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:03 user nova-compute[74669]: DEBUG nova.compute.manager [req-28db6792-b07f-496a-88dc-4543ab7fba7d req-09501d5e-18d3-4a05-aae7-c5992cde0d7f service nova] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] No waiting events found dispatching network-vif-plugged-f021aef7-a8e3-4f01-8825-378de286cdbb {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:28:04 user nova-compute[74669]: WARNING nova.compute.manager [req-28db6792-b07f-496a-88dc-4543ab7fba7d req-09501d5e-18d3-4a05-aae7-c5992cde0d7f service nova] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Received unexpected event network-vif-plugged-f021aef7-a8e3-4f01-8825-378de286cdbb for instance with vm_state building and task_state spawning.
Nov 08 17:28:04 user nova-compute[74669]: DEBUG nova.compute.manager [req-28db6792-b07f-496a-88dc-4543ab7fba7d req-09501d5e-18d3-4a05-aae7-c5992cde0d7f service nova] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Received event network-vif-plugged-f021aef7-a8e3-4f01-8825-378de286cdbb {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-28db6792-b07f-496a-88dc-4543ab7fba7d req-09501d5e-18d3-4a05-aae7-c5992cde0d7f service nova] Acquiring lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-28db6792-b07f-496a-88dc-4543ab7fba7d req-09501d5e-18d3-4a05-aae7-c5992cde0d7f service nova] Lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-28db6792-b07f-496a-88dc-4543ab7fba7d req-09501d5e-18d3-4a05-aae7-c5992cde0d7f service nova] Lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG nova.compute.manager [req-28db6792-b07f-496a-88dc-4543ab7fba7d req-09501d5e-18d3-4a05-aae7-c5992cde0d7f service nova] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] No waiting events found dispatching network-vif-plugged-f021aef7-a8e3-4f01-8825-378de286cdbb {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:28:04 user nova-compute[74669]: WARNING nova.compute.manager [req-28db6792-b07f-496a-88dc-4543ab7fba7d req-09501d5e-18d3-4a05-aae7-c5992cde0d7f service nova] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Received unexpected event network-vif-plugged-f021aef7-a8e3-4f01-8825-378de286cdbb for instance with vm_state building and task_state spawning.
Nov 08 17:28:04 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid 0796133c-71d6-4d64-94af-49028a6603ea {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid fa8c4d88-8b6c-4ef6-9876-62597ace9c37 {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid 976336a5-8eb7-4cad-ae54-7153781f93d9 {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid da037005-cd13-4276-83a8-68ba02a57350 {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid 49657a40-5c34-43d3-9bb5-b78dab52d2ff {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "0796133c-71d6-4d64-94af-49028a6603ea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "0796133c-71d6-4d64-94af-49028a6603ea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "976336a5-8eb7-4cad-ae54-7153781f93d9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "976336a5-8eb7-4cad-ae54-7153781f93d9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "da037005-cd13-4276-83a8-68ba02a57350" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "da037005-cd13-4276-83a8-68ba02a57350" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "976336a5-8eb7-4cad-ae54-7153781f93d9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "0796133c-71d6-4d64-94af-49028a6603ea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "da037005-cd13-4276-83a8-68ba02a57350" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:05 user nova-compute[74669]: DEBUG nova.compute.manager [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:28:05 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:28:05 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Instance spawned successfully.
Nov 08 17:28:05 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:28:05 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:28:05 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:28:05 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:28:05 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:28:05 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:28:05 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:28:05 user nova-compute[74669]: INFO nova.compute.manager [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 08 17:28:05 user nova-compute[74669]: DEBUG nova.compute.manager [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:28:06 user nova-compute[74669]: INFO nova.compute.manager [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Took 6.29 seconds to build instance.
Nov 08 17:28:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-c533f620-2c57-4bd4-9d19-499deb6f9c23 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.393s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.948s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:28:06 user nova-compute[74669]: INFO nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 08 17:28:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:28:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:28:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:28:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:28:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:12 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:28:12 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:28:13 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:28:14 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:28:15 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:28:15 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:28:15 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Didn't find any instances for network info cache update. {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 17:28:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:28:17 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:28:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:28:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:28:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:17 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:28:17 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:28:17 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da037005-cd13-4276-83a8-68ba02a57350/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:28:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da037005-cd13-4276-83a8-68ba02a57350/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:28:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da037005-cd13-4276-83a8-68ba02a57350/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:28:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da037005-cd13-4276-83a8-68ba02a57350/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:28:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:28:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:28:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:28:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:28:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:28:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:28:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:28:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:28:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:28:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:19 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:28:19 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:28:19 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8367MB free_disk=25.124740600585938GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:28:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:28:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:28:19 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0796133c-71d6-4d64-94af-49028a6603ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:28:19 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance fa8c4d88-8b6c-4ef6-9876-62597ace9c37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:28:19 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 976336a5-8eb7-4cad-ae54-7153781f93d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:28:19 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance da037005-cd13-4276-83a8-68ba02a57350 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:28:19 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 49657a40-5c34-43d3-9bb5-b78dab52d2ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:28:19 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:28:19 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:28:19 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:28:19 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:28:19 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:28:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:21 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:28:21 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:28:21 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:28:21 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:28:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "976336a5-8eb7-4cad-ae54-7153781f93d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:28:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "976336a5-8eb7-4cad-ae54-7153781f93d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:28:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "976336a5-8eb7-4cad-ae54-7153781f93d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:28:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "976336a5-8eb7-4cad-ae54-7153781f93d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:28:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "976336a5-8eb7-4cad-ae54-7153781f93d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:44 user nova-compute[74669]: INFO nova.compute.manager [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Terminating instance
Nov 08 17:28:44 user nova-compute[74669]: DEBUG nova.compute.manager [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:28:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-ffb02530-0afd-42e2-86b5-aef214d5a0e2 req-f82e7792-004a-4eca-a5e2-30b2f7f48145 service nova] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Received event network-vif-unplugged-18405fa7-35c2-4c55-80c9-fbe427ab2e76 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:28:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ffb02530-0afd-42e2-86b5-aef214d5a0e2 req-f82e7792-004a-4eca-a5e2-30b2f7f48145 service nova] Acquiring lock "976336a5-8eb7-4cad-ae54-7153781f93d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:28:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ffb02530-0afd-42e2-86b5-aef214d5a0e2 req-f82e7792-004a-4eca-a5e2-30b2f7f48145 service nova] Lock "976336a5-8eb7-4cad-ae54-7153781f93d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:28:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ffb02530-0afd-42e2-86b5-aef214d5a0e2 req-f82e7792-004a-4eca-a5e2-30b2f7f48145 service nova] Lock "976336a5-8eb7-4cad-ae54-7153781f93d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-ffb02530-0afd-42e2-86b5-aef214d5a0e2 req-f82e7792-004a-4eca-a5e2-30b2f7f48145 service nova] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] No waiting events found dispatching network-vif-unplugged-18405fa7-35c2-4c55-80c9-fbe427ab2e76 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:28:44 user nova-compute[74669]: DEBUG nova.compute.manager [req-ffb02530-0afd-42e2-86b5-aef214d5a0e2 req-f82e7792-004a-4eca-a5e2-30b2f7f48145 service nova] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Received event network-vif-unplugged-18405fa7-35c2-4c55-80c9-fbe427ab2e76 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:28:45 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Instance destroyed successfully.
Nov 08 17:28:45 user nova-compute[74669]: DEBUG nova.objects.instance [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lazy-loading 'resources' on Instance uuid 976336a5-8eb7-4cad-ae54-7153781f93d9 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-69028233',display_name='tempest-TestVolumeBootPattern-server-69028233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-69028233',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:27:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5be63fa80aa24b1e9c8d84e5f54c4270',ramdisk_id='',reservation_id='r-du7t14vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-632748264',owner_user_name='tempest-TestVolumeBootPattern-632748264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:27:29Z,user_data=None,user_id='0907ddd682244b7db3c2a10726fffb46',uuid=976336a5-8eb7-4cad-ae54-7153781f93d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18405fa7-35c2-4c55-80c9-fbe427ab2e76", "address": "fa:16:3e:fa:bf:30", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18405fa7-35", "ovs_interfaceid": "18405fa7-35c2-4c55-80c9-fbe427ab2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converting VIF {"id": "18405fa7-35c2-4c55-80c9-fbe427ab2e76", "address": "fa:16:3e:fa:bf:30", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18405fa7-35", "ovs_interfaceid": "18405fa7-35c2-4c55-80c9-fbe427ab2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:bf:30,bridge_name='br-int',has_traffic_filtering=True,id=18405fa7-35c2-4c55-80c9-fbe427ab2e76,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18405fa7-35') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG os_vif [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:bf:30,bridge_name='br-int',has_traffic_filtering=True,id=18405fa7-35c2-4c55-80c9-fbe427ab2e76,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18405fa7-35') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18405fa7-35, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61be9be7-eda5-4dd1-9bc4-bdca361772ce) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:28:45 user nova-compute[74669]: INFO os_vif [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:bf:30,bridge_name='br-int',has_traffic_filtering=True,id=18405fa7-35c2-4c55-80c9-fbe427ab2e76,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18405fa7-35')
Nov 08 17:28:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AauMVebh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:28:45 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:28:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1393c80c-bf63-43b0-8882-a92eb519000c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:28:45 user nova-compute[74669]: No targets found.
Nov 08 17:28:45 user nova-compute[74669]: iSNS:
Nov 08 17:28:45 user nova-compute[74669]: No targets found.
Nov 08 17:28:45 user nova-compute[74669]: STATIC:
Nov 08 17:28:45 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50
Nov 08 17:28:45 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:28:45 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:28:45 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c
Nov 08 17:28:45 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:28:45 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:28:45 user nova-compute[74669]: FIRMWARE:
Nov 08 17:28:45 user nova-compute[74669]: No targets found.
Nov 08 17:28:45 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:28:45 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:28:45 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[80639635-a0a5-45e7-a951-c491aa602057]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f92a82-81ae-4bcd-bc8e-3c87a76abb22]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:28:45 user nova-compute[74669]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 (non-flash)
Nov 08 17:28:45 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:28:45 user nova-compute[74669]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 (non-flash)
Nov 08 17:28:45 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9846bd1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50'): ({'sdc'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Removing single pathed devices sdc {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[99863aa6-21a0-4dc2-952b-8bc2429d109a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[858193a7-5e89-4153-9ec4-92cee69dd2f1]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Flushing IO for device /dev/sdc {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb14fec-5dd8-4950-9f33-a42f407fc439]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ead19f-fe80-4c99-a90a-4e15aa62d3c1]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e7276e93',) {{(pid=86107) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bdcfc4-f360-4645-8245-267eec4fa5da]: (4, None) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ee59cb-88b6-4e94-b994-47f2be45b653]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0193d329-4fb7-40ce-bec2-c661c298138c]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50, portal: 172.16.0.220,3260]
Nov 08 17:28:45 user nova-compute[74669]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50, portal: 172.16.0.220,3260] successful.
Nov 08 17:28:45 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e48e29-0284-45fd-911f-99e810278d50 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c689ab4d-a5cd-4441-8b7f-bcbe4dbe0651]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] <== disconnect_volume: return (320ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:28:45 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Deleting instance files /opt/stack/data/nova/instances/976336a5-8eb7-4cad-ae54-7153781f93d9_del
Nov 08 17:28:45 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Deletion of /opt/stack/data/nova/instances/976336a5-8eb7-4cad-ae54-7153781f93d9_del complete
Nov 08 17:28:45 user nova-compute[74669]: INFO nova.compute.manager [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 08 17:28:45 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:28:45 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Took 0.44 seconds to deallocate network for instance.
Nov 08 17:28:45 user nova-compute[74669]: DEBUG nova.compute.manager [req-3bcb8112-b912-48dd-9035-b7afa37b1904 req-53c89c4b-8ba5-453c-afea-39aa3d2644f3 service nova] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Received event network-vif-deleted-18405fa7-35c2-4c55-80c9-fbe427ab2e76 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:28:45 user nova-compute[74669]: INFO nova.compute.manager [req-3bcb8112-b912-48dd-9035-b7afa37b1904 req-53c89c4b-8ba5-453c-afea-39aa3d2644f3 service nova] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Neutron deleted interface 18405fa7-35c2-4c55-80c9-fbe427ab2e76; detaching it from the instance and deleting it from the info cache
Nov 08 17:28:45 user nova-compute[74669]: DEBUG nova.network.neutron [req-3bcb8112-b912-48dd-9035-b7afa37b1904 req-53c89c4b-8ba5-453c-afea-39aa3d2644f3 service nova] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:28:45 user nova-compute[74669]: DEBUG nova.compute.manager [req-3bcb8112-b912-48dd-9035-b7afa37b1904 req-53c89c4b-8ba5-453c-afea-39aa3d2644f3 service nova] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Detach interface failed, port_id=18405fa7-35c2-4c55-80c9-fbe427ab2e76, reason: Instance 976336a5-8eb7-4cad-ae54-7153781f93d9 could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 17:28:46 user nova-compute[74669]: DEBUG nova.compute.manager [req-1874e557-f155-4fc6-be58-5186fa9263b3 req-043fc24f-6196-404d-9a3c-f2bbaec478c9 service nova] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Received event network-vif-plugged-18405fa7-35c2-4c55-80c9-fbe427ab2e76 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:28:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1874e557-f155-4fc6-be58-5186fa9263b3 req-043fc24f-6196-404d-9a3c-f2bbaec478c9 service nova] Acquiring lock "976336a5-8eb7-4cad-ae54-7153781f93d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:28:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1874e557-f155-4fc6-be58-5186fa9263b3 req-043fc24f-6196-404d-9a3c-f2bbaec478c9 service nova] Lock "976336a5-8eb7-4cad-ae54-7153781f93d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:28:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-1874e557-f155-4fc6-be58-5186fa9263b3 req-043fc24f-6196-404d-9a3c-f2bbaec478c9 service nova] Lock "976336a5-8eb7-4cad-ae54-7153781f93d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:46 user nova-compute[74669]: DEBUG nova.compute.manager [req-1874e557-f155-4fc6-be58-5186fa9263b3 req-043fc24f-6196-404d-9a3c-f2bbaec478c9 service nova] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] No waiting events found dispatching network-vif-plugged-18405fa7-35c2-4c55-80c9-fbe427ab2e76 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:28:46 user nova-compute[74669]: WARNING nova.compute.manager [req-1874e557-f155-4fc6-be58-5186fa9263b3 req-043fc24f-6196-404d-9a3c-f2bbaec478c9 service nova] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Received unexpected event network-vif-plugged-18405fa7-35c2-4c55-80c9-fbe427ab2e76 for instance with vm_state active and task_state deleting.
Nov 08 17:28:47 user nova-compute[74669]: INFO nova.compute.manager [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Took 1.12 seconds to detach 1 volumes for instance.
Nov 08 17:28:47 user nova-compute[74669]: DEBUG nova.compute.manager [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 976336a5-8eb7-4cad-ae54-7153781f93d9] Deleting volume: b7e48e29-0284-45fd-911f-99e810278d50 {{(pid=74669) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 17:28:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:28:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:28:47 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:28:47 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:28:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:47 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Deleted allocations for instance 976336a5-8eb7-4cad-ae54-7153781f93d9
Nov 08 17:28:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2af46ce4-893e-4449-8cf8-7644710c67ac tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "976336a5-8eb7-4cad-ae54-7153781f93d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.222s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Acquiring lock "da037005-cd13-4276-83a8-68ba02a57350" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:28:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "da037005-cd13-4276-83a8-68ba02a57350" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:28:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Acquiring lock "da037005-cd13-4276-83a8-68ba02a57350-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:28:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "da037005-cd13-4276-83a8-68ba02a57350-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:28:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "da037005-cd13-4276-83a8-68ba02a57350-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:57 user nova-compute[74669]: INFO nova.compute.manager [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Terminating instance
Nov 08 17:28:57 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:28:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-68628d9f-92f9-48ee-a2e3-c7e7d771cc8f req-c6eee206-9655-4fcf-8136-aa4b9491a490 service nova] [instance: da037005-cd13-4276-83a8-68ba02a57350] Received event network-vif-unplugged-06908d1e-2a7c-4811-b616-782fb2e87075 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:28:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-68628d9f-92f9-48ee-a2e3-c7e7d771cc8f req-c6eee206-9655-4fcf-8136-aa4b9491a490 service nova] Acquiring lock "da037005-cd13-4276-83a8-68ba02a57350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:28:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-68628d9f-92f9-48ee-a2e3-c7e7d771cc8f req-c6eee206-9655-4fcf-8136-aa4b9491a490 service nova] Lock "da037005-cd13-4276-83a8-68ba02a57350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:28:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-68628d9f-92f9-48ee-a2e3-c7e7d771cc8f req-c6eee206-9655-4fcf-8136-aa4b9491a490 service nova] Lock "da037005-cd13-4276-83a8-68ba02a57350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-68628d9f-92f9-48ee-a2e3-c7e7d771cc8f req-c6eee206-9655-4fcf-8136-aa4b9491a490 service nova] [instance: da037005-cd13-4276-83a8-68ba02a57350] No waiting events found dispatching network-vif-unplugged-06908d1e-2a7c-4811-b616-782fb2e87075 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:28:57 user nova-compute[74669]: DEBUG nova.compute.manager [req-68628d9f-92f9-48ee-a2e3-c7e7d771cc8f req-c6eee206-9655-4fcf-8136-aa4b9491a490 service nova] [instance: da037005-cd13-4276-83a8-68ba02a57350] Received event network-vif-unplugged-06908d1e-2a7c-4811-b616-782fb2e87075 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:28:58 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: da037005-cd13-4276-83a8-68ba02a57350] Instance destroyed successfully.
Nov 08 17:28:58 user nova-compute[74669]: DEBUG nova.objects.instance [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lazy-loading 'resources' on Instance uuid da037005-cd13-4276-83a8-68ba02a57350 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:28:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:27:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-629631651',display_name='tempest-VolumesActionsTest-instance-629631651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-629631651',id=44,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:27:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='863682646f70460aa388b2715796755e',ramdisk_id='',reservation_id='r-kthbnp54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-733585185',owner_user_name='tempest-VolumesActionsTest-733585185-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:27:13Z,user_data=None,user_id='d8c915ea3a094ac9b2766df66945880d',uuid=da037005-cd13-4276-83a8-68ba02a57350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06908d1e-2a7c-4811-b616-782fb2e87075", "address": "fa:16:3e:c2:71:02", "network": {"id": "300cee8e-ea32-456f-8ba3-c7c377e3c068", "bridge": "br-int", "label": "tempest-VolumesActionsTest-456444300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863682646f70460aa388b2715796755e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06908d1e-2a", "ovs_interfaceid": "06908d1e-2a7c-4811-b616-782fb2e87075", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:28:58 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Converting VIF {"id": "06908d1e-2a7c-4811-b616-782fb2e87075", "address": "fa:16:3e:c2:71:02", "network": {"id": "300cee8e-ea32-456f-8ba3-c7c377e3c068", "bridge": "br-int", "label": "tempest-VolumesActionsTest-456444300-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863682646f70460aa388b2715796755e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06908d1e-2a", "ovs_interfaceid": "06908d1e-2a7c-4811-b616-782fb2e87075", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:28:58 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:71:02,bridge_name='br-int',has_traffic_filtering=True,id=06908d1e-2a7c-4811-b616-782fb2e87075,network=Network(300cee8e-ea32-456f-8ba3-c7c377e3c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06908d1e-2a') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:28:58 user nova-compute[74669]: DEBUG os_vif [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:71:02,bridge_name='br-int',has_traffic_filtering=True,id=06908d1e-2a7c-4811-b616-782fb2e87075,network=Network(300cee8e-ea32-456f-8ba3-c7c377e3c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06908d1e-2a') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:28:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06908d1e-2a, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:28:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f53f1838-7239-4bc1-aa40-23fd559893f3) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:28:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:28:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:28:58 user nova-compute[74669]: INFO os_vif [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:71:02,bridge_name='br-int',has_traffic_filtering=True,id=06908d1e-2a7c-4811-b616-782fb2e87075,network=Network(300cee8e-ea32-456f-8ba3-c7c377e3c068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06908d1e-2a')
Nov 08 17:28:58 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Deleting instance files /opt/stack/data/nova/instances/da037005-cd13-4276-83a8-68ba02a57350_del
Nov 08 17:28:58 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Deletion of /opt/stack/data/nova/instances/da037005-cd13-4276-83a8-68ba02a57350_del complete
Nov 08 17:28:58 user nova-compute[74669]: INFO nova.compute.manager [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] [instance: da037005-cd13-4276-83a8-68ba02a57350] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 08 17:28:58 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:28:58 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: da037005-cd13-4276-83a8-68ba02a57350] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:28:58 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: da037005-cd13-4276-83a8-68ba02a57350] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:28:58 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: da037005-cd13-4276-83a8-68ba02a57350] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:28:58 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: da037005-cd13-4276-83a8-68ba02a57350] Took 0.47 seconds to deallocate network for instance.
Nov 08 17:28:58 user nova-compute[74669]: DEBUG nova.compute.manager [req-bde376ed-7ab6-4bd3-ad00-87b8d6f338e0 req-d52f7bf2-1b3c-4a0a-bd38-b7a9d01d753f service nova] [instance: da037005-cd13-4276-83a8-68ba02a57350] Received event network-vif-deleted-06908d1e-2a7c-4811-b616-782fb2e87075 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:28:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:28:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:28:58 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:28:58 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:28:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:58 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Deleted allocations for instance da037005-cd13-4276-83a8-68ba02a57350
Nov 08 17:28:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5b4a0ba3-7956-4e98-9c2b-429165197e79 tempest-VolumesActionsTest-733585185 tempest-VolumesActionsTest-733585185-project-member] Lock "da037005-cd13-4276-83a8-68ba02a57350" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.843s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-5b815232-6b93-4124-bdce-e9d389f047c0 req-08beb6a6-2b52-414d-bb30-d7d5f7203dc3 service nova] [instance: da037005-cd13-4276-83a8-68ba02a57350] Received event network-vif-plugged-06908d1e-2a7c-4811-b616-782fb2e87075 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:28:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5b815232-6b93-4124-bdce-e9d389f047c0 req-08beb6a6-2b52-414d-bb30-d7d5f7203dc3 service nova] Acquiring lock "da037005-cd13-4276-83a8-68ba02a57350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:28:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5b815232-6b93-4124-bdce-e9d389f047c0 req-08beb6a6-2b52-414d-bb30-d7d5f7203dc3 service nova] Lock "da037005-cd13-4276-83a8-68ba02a57350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:28:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5b815232-6b93-4124-bdce-e9d389f047c0 req-08beb6a6-2b52-414d-bb30-d7d5f7203dc3 service nova] Lock "da037005-cd13-4276-83a8-68ba02a57350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:28:59 user nova-compute[74669]: DEBUG nova.compute.manager [req-5b815232-6b93-4124-bdce-e9d389f047c0 req-08beb6a6-2b52-414d-bb30-d7d5f7203dc3 service nova] [instance: da037005-cd13-4276-83a8-68ba02a57350] No waiting events found dispatching network-vif-plugged-06908d1e-2a7c-4811-b616-782fb2e87075 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:28:59 user nova-compute[74669]: WARNING nova.compute.manager [req-5b815232-6b93-4124-bdce-e9d389f047c0 req-08beb6a6-2b52-414d-bb30-d7d5f7203dc3 service nova] [instance: da037005-cd13-4276-83a8-68ba02a57350] Received unexpected event network-vif-plugged-06908d1e-2a7c-4811-b616-782fb2e87075 for instance with vm_state deleted and task_state None.
Nov 08 17:29:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:29:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:29:12 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:29:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:29:13 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:29:14 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:29:15 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:29:17 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:29:17 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:29:17 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 17:29:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:29:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:29:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:29:18 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:29:18 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lazy-loading 'info_cache' on Instance uuid 0796133c-71d6-4d64-94af-49028a6603ea {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:29:18 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Updating instance_info_cache with network_info: [{"id": "1fa691c0-3473-4f34-a504-3778913558ab", "address": "fa:16:3e:2f:15:d7", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa691c0-34", "ovs_interfaceid": "1fa691c0-3473-4f34-a504-3778913558ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:29:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:29:18 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:29:19 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:29:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:29:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:29:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:29:19 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:29:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:29:19 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:29:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:29:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:29:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:29:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:29:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:29:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:29:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:29:21 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:29:21 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:29:21 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8679MB free_disk=25.11508560180664GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:29:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:29:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:29:21 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0796133c-71d6-4d64-94af-49028a6603ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:29:21 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance fa8c4d88-8b6c-4ef6-9876-62597ace9c37 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:29:21 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 49657a40-5c34-43d3-9bb5-b78dab52d2ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:29:21 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:29:21 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:29:21 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:29:21 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:29:21 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:29:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:29:22 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:29:22 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:29:22 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:29:22 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:29:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:29:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:29:29 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:29:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:29:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:29:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:29:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:29:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:29:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:29:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:29:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:29:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:29:50 user nova-compute[74669]: DEBUG nova.compute.manager [None req-17f9d18f-7c80-45d0-adfa-9e4fe7d97287 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:29:50 user nova-compute[74669]: INFO nova.compute.manager [None req-17f9d18f-7c80-45d0-adfa-9e4fe7d97287 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] instance snapshotting
Nov 08 17:29:51 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-17f9d18f-7c80-45d0-adfa-9e4fe7d97287 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Beginning live snapshot process
Nov 08 17:29:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-17f9d18f-7c80-45d0-adfa-9e4fe7d97287 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json -f qcow2 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:29:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-17f9d18f-7c80-45d0-adfa-9e4fe7d97287 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:29:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-17f9d18f-7c80-45d0-adfa-9e4fe7d97287 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json -f qcow2 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:29:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-17f9d18f-7c80-45d0-adfa-9e4fe7d97287 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json -f qcow2" returned: 0 in 0.228s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:29:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-17f9d18f-7c80-45d0-adfa-9e4fe7d97287 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:29:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-17f9d18f-7c80-45d0-adfa-9e4fe7d97287 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956 --force-share --output=json" returned: 0 in 0.212s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:29:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-17f9d18f-7c80-45d0-adfa-9e4fe7d97287 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp057fhg55/ecabe39a9cfc480db50154b842fdbf66.delta 1073741824 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:29:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-17f9d18f-7c80-45d0-adfa-9e4fe7d97287 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87106a141e68d5b6b33d8e32a1c862b7a80ef956,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp057fhg55/ecabe39a9cfc480db50154b842fdbf66.delta 1073741824" returned: 0 in 0.060s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:29:51 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-17f9d18f-7c80-45d0-adfa-9e4fe7d97287 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 17:29:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-17f9d18f-7c80-45d0-adfa-9e4fe7d97287 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74669) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 17:29:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:29:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.guest [None req-17f9d18f-7c80-45d0-adfa-9e4fe7d97287 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74669) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 17:29:53 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-17f9d18f-7c80-45d0-adfa-9e4fe7d97287 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 17:29:53 user nova-compute[74669]: DEBUG nova.privsep.utils [None req-17f9d18f-7c80-45d0-adfa-9e4fe7d97287 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74669) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 17:29:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-17f9d18f-7c80-45d0-adfa-9e4fe7d97287 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp057fhg55/ecabe39a9cfc480db50154b842fdbf66.delta /opt/stack/data/nova/instances/snapshots/tmp057fhg55/ecabe39a9cfc480db50154b842fdbf66 {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:29:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-17f9d18f-7c80-45d0-adfa-9e4fe7d97287 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp057fhg55/ecabe39a9cfc480db50154b842fdbf66.delta /opt/stack/data/nova/instances/snapshots/tmp057fhg55/ecabe39a9cfc480db50154b842fdbf66" returned: 0 in 0.385s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:29:53 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-17f9d18f-7c80-45d0-adfa-9e4fe7d97287 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Snapshot extracted, beginning image upload
Nov 08 17:29:57 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-17f9d18f-7c80-45d0-adfa-9e4fe7d97287 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Snapshot image upload complete
Nov 08 17:29:57 user nova-compute[74669]: INFO nova.compute.manager [None req-17f9d18f-7c80-45d0-adfa-9e4fe7d97287 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Took 6.02 seconds to snapshot the instance on the hypervisor.
Nov 08 17:29:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:30:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:14 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:30:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:15 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:30:15 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:30:16 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:30:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "c96ab1f6-7aaa-4f48-9371-61dcad72f35a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:30:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "c96ab1f6-7aaa-4f48-9371-61dcad72f35a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:30:17 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:30:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:30:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:30:17 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:30:17 user nova-compute[74669]: INFO nova.compute.claims [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Claim successful on node user
Nov 08 17:30:17 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:30:17 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:30:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:30:17 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:30:17 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:30:17 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:30:18 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:30:18 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG nova.policy [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0907ddd682244b7db3c2a10726fffb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be63fa80aa24b1e9c8d84e5f54c4270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:30:18 user nova-compute[74669]: INFO nova.virt.block_device [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Booting with volume 201cd928-bb9e-4ecb-9328-8e487f21d01d at /dev/vda
Nov 08 17:30:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG os_brick.utils [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c112fe5-6497-4673-a137-5fc96661a8c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a811c6d1-546b-461a-b159-17ef759c0755]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dabf8de-61cf-489d-b119-96777b7ca2c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a60869-239c-4647-8e41-60aab215942f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:30:18 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:30:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[744bd64f-e61c-4ae5-b49c-6b2ad03765ac]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG os_brick.utils [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Updating existing volume attachment record: 8646bcd0-bbcd-40ca-88b1-7226e6dbb186 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:30:18 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Successfully created port: 8ee1430a-0a17-4c5d-b284-cd09f88f2b05 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:30:19 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Updating instance_info_cache with network_info: [{"id": "a4820eb9-3a23-479e-b429-47171c75f100", "address": "fa:16:3e:12:b9:b1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4820eb9-3a", "ovs_interfaceid": "a4820eb9-3a23-479e-b429-47171c75f100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:30:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:30:19 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:30:19 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Successfully updated port: 8ee1430a-0a17-4c5d-b284-cd09f88f2b05 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:30:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "refresh_cache-c96ab1f6-7aaa-4f48-9371-61dcad72f35a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:30:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquired lock "refresh_cache-c96ab1f6-7aaa-4f48-9371-61dcad72f35a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:30:19 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:30:19 user nova-compute[74669]: DEBUG nova.compute.manager [req-fbd5ab3f-f968-4ca8-afeb-bce4a1a3ecd1 req-2624a180-7069-40c5-a584-c6018eca3cd3 service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Received event network-changed-8ee1430a-0a17-4c5d-b284-cd09f88f2b05 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:30:19 user nova-compute[74669]: DEBUG nova.compute.manager [req-fbd5ab3f-f968-4ca8-afeb-bce4a1a3ecd1 req-2624a180-7069-40c5-a584-c6018eca3cd3 service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Refreshing instance network info cache due to event network-changed-8ee1430a-0a17-4c5d-b284-cd09f88f2b05. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:30:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-fbd5ab3f-f968-4ca8-afeb-bce4a1a3ecd1 req-2624a180-7069-40c5-a584-c6018eca3cd3 service nova] Acquiring lock "refresh_cache-c96ab1f6-7aaa-4f48-9371-61dcad72f35a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:30:19 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:30:20 user nova-compute[74669]: DEBUG nova.network.neutron [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Updating instance_info_cache with network_info: [{"id": "8ee1430a-0a17-4c5d-b284-cd09f88f2b05", "address": "fa:16:3e:9b:31:48", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee1430a-0a", "ovs_interfaceid": "8ee1430a-0a17-4c5d-b284-cd09f88f2b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:30:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Releasing lock "refresh_cache-c96ab1f6-7aaa-4f48-9371-61dcad72f35a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:30:20 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Instance network_info: |[{"id": "8ee1430a-0a17-4c5d-b284-cd09f88f2b05", "address": "fa:16:3e:9b:31:48", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee1430a-0a", "ovs_interfaceid": "8ee1430a-0a17-4c5d-b284-cd09f88f2b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:30:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-fbd5ab3f-f968-4ca8-afeb-bce4a1a3ecd1 req-2624a180-7069-40c5-a584-c6018eca3cd3 service nova] Acquired lock "refresh_cache-c96ab1f6-7aaa-4f48-9371-61dcad72f35a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:30:20 user nova-compute[74669]: DEBUG nova.network.neutron [req-fbd5ab3f-f968-4ca8-afeb-bce4a1a3ecd1 req-2624a180-7069-40c5-a584-c6018eca3cd3 service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Refreshing network info cache for port 8ee1430a-0a17-4c5d-b284-cd09f88f2b05 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:30:20 user nova-compute[74669]: DEBUG nova.network.neutron [req-fbd5ab3f-f968-4ca8-afeb-bce4a1a3ecd1 req-2624a180-7069-40c5-a584-c6018eca3cd3 service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Updated VIF entry in instance network info cache for port 8ee1430a-0a17-4c5d-b284-cd09f88f2b05. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:30:20 user nova-compute[74669]: DEBUG nova.network.neutron [req-fbd5ab3f-f968-4ca8-afeb-bce4a1a3ecd1 req-2624a180-7069-40c5-a584-c6018eca3cd3 service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Updating instance_info_cache with network_info: [{"id": "8ee1430a-0a17-4c5d-b284-cd09f88f2b05", "address": "fa:16:3e:9b:31:48", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee1430a-0a", "ovs_interfaceid": "8ee1430a-0a17-4c5d-b284-cd09f88f2b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:30:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-fbd5ab3f-f968-4ca8-afeb-bce4a1a3ecd1 req-2624a180-7069-40c5-a584-c6018eca3cd3 service nova] Releasing lock "refresh_cache-c96ab1f6-7aaa-4f48-9371-61dcad72f35a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:30:20 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:30:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:30:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:30:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:30:20 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:30:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:30:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:30:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:30:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:30:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:30:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:30:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:30:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:30:21 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:30:22 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:30:22 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:30:22 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8597MB free_disk=24.694194793701172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:30:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:30:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:30:22 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0796133c-71d6-4d64-94af-49028a6603ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:30:22 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance fa8c4d88-8b6c-4ef6-9876-62597ace9c37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:30:22 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 49657a40-5c34-43d3-9bb5-b78dab52d2ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:30:22 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance c96ab1f6-7aaa-4f48-9371-61dcad72f35a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:30:22 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:30:22 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:30:22 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:30:22 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:30:22 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:30:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.386s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:30:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:23 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:30:23 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:30:23 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:30:23 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:30:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:30:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:30:43 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Creating image(s)
Nov 08 17:30:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Did not create local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Ensure instance console log exists: /opt/stack/data/nova/instances/c96ab1f6-7aaa-4f48-9371-61dcad72f35a/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Start _get_guest_xml network_info=[{"id": "8ee1430a-0a17-4c5d-b284-cd09f88f2b05", "address": "fa:16:3e:9b:31:48", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee1430a-0a", "ovs_interfaceid": "8ee1430a-0a17-4c5d-b284-cd09f88f2b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '8646bcd0-bbcd-40ca-88b1-7226e6dbb186', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHetvquV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c96ab1f6-7aaa-4f48-9371-61dcad72f35a', 'attached_at': '', 'detached_at': '', 'volume_id': '201cd928-bb9e-4ecb-9328-8e487f21d01d', 'serial': '201cd928-bb9e-4ecb-9328-8e487f21d01d'}, 'guest_format': None, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:30:43 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:30:43 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:30:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHetvquV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:30:43 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:30:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:30:43 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:30:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:30:43 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:30:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd033838-5f74-490d-8269-bb6a950815a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:30:43 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4111d88f-18f0-49fb-8d92-7819ff51de53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d] added
Nov 08 17:30:43 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.041s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d614b4-8791-475b-9293-4fcf2b41e1fc]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d5f581-bdca-40fc-82ad-f5b862e91759]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LHetvquV {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LHetvquV" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e908d0-bdcc-452d-a260-a27cc73ae63a]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LHetvquV'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19e5a57-d529-431f-b4f5-853495feb801]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4add34f5-4d04-4c13-9a9f-00c724a7e26e]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:30:43 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:30:43 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6da89f9-767f-4553-88d8-28e57e871377]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d, portal: 172.16.0.220,3260]
Nov 08 17:30:43 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d, portal: 172.16.0.220,3260] successful.
Nov 08 17:30:43 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[229957ef-15d6-44a6-8333-be62517200ea]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0ab254-0a9a-4b89-ac03-31fd22dea5fd]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:30:43 user nova-compute[74669]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)
Nov 08 17:30:43 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:30:43 user nova-compute[74669]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)
Nov 08 17:30:43 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3995d1bc-d05e-4b23-a515-01e136ef4dca]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:30:43 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: None {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHetvquV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23864646536366531', 'path': '/dev/sdc'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864646536366531', 'path': '/dev/sdc'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:30:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-709532451',display_name='tempest-TestVolumeBootPattern-volume-backed-server-709532451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-709532451',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBP8DpXfCSnM4VCnefc5PDiD0xhBhJgEPwATc4bY0Y8nJLbHH53+yX1eeHCpEBMvY+uBbXf82gq1mid190ej4oQJ8O24dnIzVeulb4/z+gT1tZdI75IkF5nGptKMsoG6JQ==',key_name='tempest-keypair-1409039907',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5be63fa80aa24b1e9c8d84e5f54c4270',ramdisk_id='',reservation_id='r-e3p24w8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-632748264',owner_user_name='tempest-TestVolumeBootPattern-632748264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:30:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0907ddd682244b7db3c2a10726fffb46',uuid=c96ab1f6-7aaa-4f48-9371-61dcad72f35a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ee1430a-0a17-4c5d-b284-cd09f88f2b05", "address": "fa:16:3e:9b:31:48", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee1430a-0a", "ovs_interfaceid": "8ee1430a-0a17-4c5d-b284-cd09f88f2b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converting VIF {"id": "8ee1430a-0a17-4c5d-b284-cd09f88f2b05", "address": "fa:16:3e:9b:31:48", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee1430a-0a", "ovs_interfaceid": "8ee1430a-0a17-4c5d-b284-cd09f88f2b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:31:48,bridge_name='br-int',has_traffic_filtering=True,id=8ee1430a-0a17-4c5d-b284-cd09f88f2b05,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee1430a-0a') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG nova.objects.instance [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lazy-loading 'pci_devices' on Instance uuid c96ab1f6-7aaa-4f48-9371-61dcad72f35a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:30:44 user nova-compute[74669]:   <uuid>c96ab1f6-7aaa-4f48-9371-61dcad72f35a</uuid>
Nov 08 17:30:44 user nova-compute[74669]:   <name>instance-0000002e</name>
Nov 08 17:30:44 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:30:44 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:30:44 user nova-compute[74669]:   <metadata>
Nov 08 17:30:44 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:30:44 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:30:44 user nova-compute[74669]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-709532451</nova:name>
Nov 08 17:30:44 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:30:43</nova:creationTime>
Nov 08 17:30:44 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:30:44 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:30:44 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:30:44 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:30:44 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:30:44 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:30:44 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:30:44 user nova-compute[74669]:       <nova:owner>
Nov 08 17:30:44 user nova-compute[74669]:         <nova:user uuid="0907ddd682244b7db3c2a10726fffb46">tempest-TestVolumeBootPattern-632748264-project-member</nova:user>
Nov 08 17:30:44 user nova-compute[74669]:         <nova:project uuid="5be63fa80aa24b1e9c8d84e5f54c4270">tempest-TestVolumeBootPattern-632748264</nova:project>
Nov 08 17:30:44 user nova-compute[74669]:       </nova:owner>
Nov 08 17:30:44 user nova-compute[74669]:       <nova:ports>
Nov 08 17:30:44 user nova-compute[74669]:         <nova:port uuid="8ee1430a-0a17-4c5d-b284-cd09f88f2b05">
Nov 08 17:30:44 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 17:30:44 user nova-compute[74669]:         </nova:port>
Nov 08 17:30:44 user nova-compute[74669]:       </nova:ports>
Nov 08 17:30:44 user nova-compute[74669]:     </nova:instance>
Nov 08 17:30:44 user nova-compute[74669]:   </metadata>
Nov 08 17:30:44 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:30:44 user nova-compute[74669]:     <system>
Nov 08 17:30:44 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:30:44 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:30:44 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:30:44 user nova-compute[74669]:       <entry name="serial">c96ab1f6-7aaa-4f48-9371-61dcad72f35a</entry>
Nov 08 17:30:44 user nova-compute[74669]:       <entry name="uuid">c96ab1f6-7aaa-4f48-9371-61dcad72f35a</entry>
Nov 08 17:30:44 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:30:44 user nova-compute[74669]:     </system>
Nov 08 17:30:44 user nova-compute[74669]:   </sysinfo>
Nov 08 17:30:44 user nova-compute[74669]:   <os>
Nov 08 17:30:44 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:30:44 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:30:44 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:30:44 user nova-compute[74669]:   </os>
Nov 08 17:30:44 user nova-compute[74669]:   <features>
Nov 08 17:30:44 user nova-compute[74669]:     <acpi/>
Nov 08 17:30:44 user nova-compute[74669]:     <apic/>
Nov 08 17:30:44 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:30:44 user nova-compute[74669]:   </features>
Nov 08 17:30:44 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:30:44 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:30:44 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:30:44 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:30:44 user nova-compute[74669]:   </clock>
Nov 08 17:30:44 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:30:44 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:30:44 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:30:44 user nova-compute[74669]:   </cpu>
Nov 08 17:30:44 user nova-compute[74669]:   <devices>
Nov 08 17:30:44 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 17:30:44 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:30:44 user nova-compute[74669]:       <source dev="/dev/sdc"/>
Nov 08 17:30:44 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:30:44 user nova-compute[74669]:       <serial>201cd928-bb9e-4ecb-9328-8e487f21d01d</serial>
Nov 08 17:30:44 user nova-compute[74669]:     </disk>
Nov 08 17:30:44 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:30:44 user nova-compute[74669]:       <mac address="fa:16:3e:9b:31:48"/>
Nov 08 17:30:44 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:30:44 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:30:44 user nova-compute[74669]:       <target dev="tap8ee1430a-0a"/>
Nov 08 17:30:44 user nova-compute[74669]:     </interface>
Nov 08 17:30:44 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:30:44 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/c96ab1f6-7aaa-4f48-9371-61dcad72f35a/console.log" append="off"/>
Nov 08 17:30:44 user nova-compute[74669]:     </serial>
Nov 08 17:30:44 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:30:44 user nova-compute[74669]:     <video>
Nov 08 17:30:44 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:30:44 user nova-compute[74669]:     </video>
Nov 08 17:30:44 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:30:44 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:30:44 user nova-compute[74669]:     </rng>
Nov 08 17:30:44 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:30:44 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:30:44 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:30:44 user nova-compute[74669]:     </memballoon>
Nov 08 17:30:44 user nova-compute[74669]:   </devices>
Nov 08 17:30:44 user nova-compute[74669]: </domain>
Nov 08 17:30:44 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:30:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-709532451',display_name='tempest-TestVolumeBootPattern-volume-backed-server-709532451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-709532451',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBP8DpXfCSnM4VCnefc5PDiD0xhBhJgEPwATc4bY0Y8nJLbHH53+yX1eeHCpEBMvY+uBbXf82gq1mid190ej4oQJ8O24dnIzVeulb4/z+gT1tZdI75IkF5nGptKMsoG6JQ==',key_name='tempest-keypair-1409039907',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5be63fa80aa24b1e9c8d84e5f54c4270',ramdisk_id='',reservation_id='r-e3p24w8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-632748264',owner_user_name='tempest-TestVolumeBootPattern-632748264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:30:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0907ddd682244b7db3c2a10726fffb46',uuid=c96ab1f6-7aaa-4f48-9371-61dcad72f35a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ee1430a-0a17-4c5d-b284-cd09f88f2b05", "address": "fa:16:3e:9b:31:48", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee1430a-0a", "ovs_interfaceid": "8ee1430a-0a17-4c5d-b284-cd09f88f2b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converting VIF {"id": "8ee1430a-0a17-4c5d-b284-cd09f88f2b05", "address": "fa:16:3e:9b:31:48", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee1430a-0a", "ovs_interfaceid": "8ee1430a-0a17-4c5d-b284-cd09f88f2b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:31:48,bridge_name='br-int',has_traffic_filtering=True,id=8ee1430a-0a17-4c5d-b284-cd09f88f2b05,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee1430a-0a') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG os_vif [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:31:48,bridge_name='br-int',has_traffic_filtering=True,id=8ee1430a-0a17-4c5d-b284-cd09f88f2b05,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee1430a-0a') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2f795a1-00f3-5e33-86ca-8254ec0e0e91', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ee1430a-0a, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ee1430a-0a, col_values=(('qos', UUID('55318b33-56a4-4088-a643-95ddd0145a14')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ee1430a-0a, col_values=(('external_ids', {'iface-id': '8ee1430a-0a17-4c5d-b284-cd09f88f2b05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:31:48', 'vm-uuid': 'c96ab1f6-7aaa-4f48-9371-61dcad72f35a'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:44 user nova-compute[74669]: INFO os_vif [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:31:48,bridge_name='br-int',has_traffic_filtering=True,id=8ee1430a-0a17-4c5d-b284-cd09f88f2b05,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee1430a-0a')
Nov 08 17:30:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:30:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] No VIF found with MAC fa:16:3e:9b:31:48, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:30:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:46 user nova-compute[74669]: DEBUG nova.compute.manager [req-fc1bdf4f-c7b5-4f62-930c-57c77dc9de2d req-b36d6d98-bf77-4e0f-b2db-5bd6ce0da30e service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Received event network-vif-plugged-8ee1430a-0a17-4c5d-b284-cd09f88f2b05 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:30:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-fc1bdf4f-c7b5-4f62-930c-57c77dc9de2d req-b36d6d98-bf77-4e0f-b2db-5bd6ce0da30e service nova] Acquiring lock "c96ab1f6-7aaa-4f48-9371-61dcad72f35a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:30:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-fc1bdf4f-c7b5-4f62-930c-57c77dc9de2d req-b36d6d98-bf77-4e0f-b2db-5bd6ce0da30e service nova] Lock "c96ab1f6-7aaa-4f48-9371-61dcad72f35a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:30:46 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-fc1bdf4f-c7b5-4f62-930c-57c77dc9de2d req-b36d6d98-bf77-4e0f-b2db-5bd6ce0da30e service nova] Lock "c96ab1f6-7aaa-4f48-9371-61dcad72f35a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:30:46 user nova-compute[74669]: DEBUG nova.compute.manager [req-fc1bdf4f-c7b5-4f62-930c-57c77dc9de2d req-b36d6d98-bf77-4e0f-b2db-5bd6ce0da30e service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] No waiting events found dispatching network-vif-plugged-8ee1430a-0a17-4c5d-b284-cd09f88f2b05 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:30:46 user nova-compute[74669]: WARNING nova.compute.manager [req-fc1bdf4f-c7b5-4f62-930c-57c77dc9de2d req-b36d6d98-bf77-4e0f-b2db-5bd6ce0da30e service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Received unexpected event network-vif-plugged-8ee1430a-0a17-4c5d-b284-cd09f88f2b05 for instance with vm_state building and task_state spawning.
Nov 08 17:30:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:48 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:30:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:30:48 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Instance spawned successfully.
Nov 08 17:30:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:30:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:30:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:30:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:30:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:30:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:30:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:30:48 user nova-compute[74669]: INFO nova.compute.manager [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 08 17:30:48 user nova-compute[74669]: DEBUG nova.compute.manager [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:30:48 user nova-compute[74669]: INFO nova.compute.manager [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Took 30.89 seconds to build instance.
Nov 08 17:30:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-a635f5fa-2cd8-4bbe-88a8-be49ae342ccb tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "c96ab1f6-7aaa-4f48-9371-61dcad72f35a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:30:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-8e8e3aba-54c5-4333-946b-ab77cde44270 req-e8c684f8-ba05-4e56-ad4b-1bab7021e013 service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Received event network-vif-plugged-8ee1430a-0a17-4c5d-b284-cd09f88f2b05 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:30:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8e8e3aba-54c5-4333-946b-ab77cde44270 req-e8c684f8-ba05-4e56-ad4b-1bab7021e013 service nova] Acquiring lock "c96ab1f6-7aaa-4f48-9371-61dcad72f35a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:30:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8e8e3aba-54c5-4333-946b-ab77cde44270 req-e8c684f8-ba05-4e56-ad4b-1bab7021e013 service nova] Lock "c96ab1f6-7aaa-4f48-9371-61dcad72f35a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:30:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8e8e3aba-54c5-4333-946b-ab77cde44270 req-e8c684f8-ba05-4e56-ad4b-1bab7021e013 service nova] Lock "c96ab1f6-7aaa-4f48-9371-61dcad72f35a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:30:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-8e8e3aba-54c5-4333-946b-ab77cde44270 req-e8c684f8-ba05-4e56-ad4b-1bab7021e013 service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] No waiting events found dispatching network-vif-plugged-8ee1430a-0a17-4c5d-b284-cd09f88f2b05 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:30:48 user nova-compute[74669]: WARNING nova.compute.manager [req-8e8e3aba-54c5-4333-946b-ab77cde44270 req-e8c684f8-ba05-4e56-ad4b-1bab7021e013 service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Received unexpected event network-vif-plugged-8ee1430a-0a17-4c5d-b284-cd09f88f2b05 for instance with vm_state active and task_state None.
Nov 08 17:30:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:30:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:30:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:30:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:30:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:30:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "6fd1fa42-b054-4c40-9260-7aef326f97ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:30:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:30:58 user nova-compute[74669]: DEBUG nova.compute.manager [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:30:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:30:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:30:59 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:30:59 user nova-compute[74669]: INFO nova.compute.claims [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Claim successful on node user
Nov 08 17:30:59 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:30:59 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:30:59 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:30:59 user nova-compute[74669]: DEBUG nova.compute.manager [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:30:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:30:59 user nova-compute[74669]: DEBUG nova.compute.manager [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:30:59 user nova-compute[74669]: DEBUG nova.network.neutron [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:30:59 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:30:59 user nova-compute[74669]: DEBUG nova.compute.manager [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:30:59 user nova-compute[74669]: INFO nova.virt.block_device [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Booting with volume-backed-image ee6edaa4-6206-44ab-8497-fdbc2291f87f at /dev/vda
Nov 08 17:30:59 user nova-compute[74669]: DEBUG nova.policy [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1fcd1d4cf714f62aa8648b27a04c04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08551815597744d89e3a61d190a9b8a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:31:00 user nova-compute[74669]: DEBUG nova.network.neutron [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Successfully created port: 3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:31:00 user nova-compute[74669]: DEBUG nova.network.neutron [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Successfully updated port: 3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:31:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "refresh_cache-6fd1fa42-b054-4c40-9260-7aef326f97ae" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:31:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquired lock "refresh_cache-6fd1fa42-b054-4c40-9260-7aef326f97ae" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:31:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:31:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-7a3b2d99-7a29-48d0-8fcd-38e4e443cb48 req-ebf82b25-0865-499d-8f99-24fbaffce7f9 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received event network-changed-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:31:01 user nova-compute[74669]: DEBUG nova.compute.manager [req-7a3b2d99-7a29-48d0-8fcd-38e4e443cb48 req-ebf82b25-0865-499d-8f99-24fbaffce7f9 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Refreshing instance network info cache due to event network-changed-3906eb94-933f-43ff-8be2-04f2c4205320. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:31:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-7a3b2d99-7a29-48d0-8fcd-38e4e443cb48 req-ebf82b25-0865-499d-8f99-24fbaffce7f9 service nova] Acquiring lock "refresh_cache-6fd1fa42-b054-4c40-9260-7aef326f97ae" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:31:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:31:01 user nova-compute[74669]: DEBUG nova.network.neutron [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Updating instance_info_cache with network_info: [{"id": "3906eb94-933f-43ff-8be2-04f2c4205320", "address": "fa:16:3e:23:e3:66", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3906eb94-93", "ovs_interfaceid": "3906eb94-933f-43ff-8be2-04f2c4205320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:31:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Releasing lock "refresh_cache-6fd1fa42-b054-4c40-9260-7aef326f97ae" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:31:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Instance network_info: |[{"id": "3906eb94-933f-43ff-8be2-04f2c4205320", "address": "fa:16:3e:23:e3:66", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3906eb94-93", "ovs_interfaceid": "3906eb94-933f-43ff-8be2-04f2c4205320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:31:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-7a3b2d99-7a29-48d0-8fcd-38e4e443cb48 req-ebf82b25-0865-499d-8f99-24fbaffce7f9 service nova] Acquired lock "refresh_cache-6fd1fa42-b054-4c40-9260-7aef326f97ae" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:31:01 user nova-compute[74669]: DEBUG nova.network.neutron [req-7a3b2d99-7a29-48d0-8fcd-38e4e443cb48 req-ebf82b25-0865-499d-8f99-24fbaffce7f9 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Refreshing network info cache for port 3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:31:01 user nova-compute[74669]: DEBUG nova.network.neutron [req-7a3b2d99-7a29-48d0-8fcd-38e4e443cb48 req-ebf82b25-0865-499d-8f99-24fbaffce7f9 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Updated VIF entry in instance network info cache for port 3906eb94-933f-43ff-8be2-04f2c4205320. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:31:01 user nova-compute[74669]: DEBUG nova.network.neutron [req-7a3b2d99-7a29-48d0-8fcd-38e4e443cb48 req-ebf82b25-0865-499d-8f99-24fbaffce7f9 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Updating instance_info_cache with network_info: [{"id": "3906eb94-933f-43ff-8be2-04f2c4205320", "address": "fa:16:3e:23:e3:66", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3906eb94-93", "ovs_interfaceid": "3906eb94-933f-43ff-8be2-04f2c4205320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:31:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-7a3b2d99-7a29-48d0-8fcd-38e4e443cb48 req-ebf82b25-0865-499d-8f99-24fbaffce7f9 service nova] Releasing lock "refresh_cache-6fd1fa42-b054-4c40-9260-7aef326f97ae" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:31:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:31:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:31:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:31:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:31:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:31:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:31:16 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:31:17 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:31:17 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:31:17 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:31:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:31:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:31:20 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:31:20 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:31:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-49657a40-5c34-43d3-9bb5-b78dab52d2ff" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:31:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-49657a40-5c34-43d3-9bb5-b78dab52d2ff" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:31:20 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:31:21 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Updating instance_info_cache with network_info: [{"id": "f021aef7-a8e3-4f01-8825-378de286cdbb", "address": "fa:16:3e:37:64:f1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf021aef7-a8", "ovs_interfaceid": "f021aef7-a8e3-4f01-8825-378de286cdbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:31:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-49657a40-5c34-43d3-9bb5-b78dab52d2ff" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:31:21 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:31:22 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:31:22 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:31:22 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:31:22 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:31:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:31:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:31:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:31:22 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:31:22 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:31:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:31:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:31:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:31:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:31:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:31:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:31:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:31:23 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:31:23 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:31:23 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:31:23 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:31:23 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8605MB free_disk=25.06073760986328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:31:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:31:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:31:24 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0796133c-71d6-4d64-94af-49028a6603ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:31:24 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance fa8c4d88-8b6c-4ef6-9876-62597ace9c37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:31:24 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 49657a40-5c34-43d3-9bb5-b78dab52d2ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:31:24 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance c96ab1f6-7aaa-4f48-9371-61dcad72f35a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:31:24 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 6fd1fa42-b054-4c40-9260-7aef326f97ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:31:24 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:31:24 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:31:24 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:31:24 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:31:24 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:31:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.320s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:31:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:31:25 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:31:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:31:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:31:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:31:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:31:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:31:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:31:30 user nova-compute[74669]: DEBUG os_brick.utils [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:31:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:31:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:31:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[308d0e91-9d8c-440c-9461-3debeeb1609b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:31:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:31:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:31:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e77b8b7-8bef-43b6-ad97-133ce9611aa8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:31:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:31:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.045s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:31:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe8e740-ed77-4ab5-92d4-2dd14d86457a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:31:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf4c2a6-0105-4e7e-8faf-f38b15684e31]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:31:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:31:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:31:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:31:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:31:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:31:30 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:31:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b714cd2f-2ebb-4cd8-b0b4-2853a6b23bac]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:31:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:31:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:31:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:31:30 user nova-compute[74669]: DEBUG os_brick.utils [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:31:30 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Updating existing volume attachment record: 48901188-a107-4c61-a607-2166c21198a6 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:31:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:31:34 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:31:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:31:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:31:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:31:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:31:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:31:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:31:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:31:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:31:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:31:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:31:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG nova.compute.manager [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:32:01 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Creating image(s)
Nov 08 17:32:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Did not create local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Ensure instance console log exists: /opt/stack/data/nova/instances/6fd1fa42-b054-4c40-9260-7aef326f97ae/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Start _get_guest_xml network_info=[{"id": "3906eb94-933f-43ff-8be2-04f2c4205320", "address": "fa:16:3e:23:e3:66", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3906eb94-93", "ovs_interfaceid": "3906eb94-933f-43ff-8be2-04f2c4205320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '48901188-a107-4c61-a607-2166c21198a6', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkDuTyBU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6fd1fa42-b054-4c40-9260-7aef326f97ae', 'attached_at': '', 'detached_at': '', 'volume_id': '2d84cfa4-9889-4d49-92ea-53b45d2d3912', 'serial': '2d84cfa4-9889-4d49-92ea-53b45d2d3912'}, 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:32:01 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:32:01 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:32:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkDuTyBU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:32:01 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:32:01 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:32:01 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e476430-a1e9-4cef-9736-d776aa6d0331]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:32:01 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fec615b-12ad-4bf5-bbff-f7b3e9892f36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912] added
Nov 08 17:32:01 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fc2ad7-5fac-4e8a-b68b-74a37ef46bee]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea8b6a8-537b-48bb-ab3e-8004f1749c1c]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fkDuTyBU {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fkDuTyBU" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8498fd-17e8-4413-9ff5-3f21807d6d66]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fkDuTyBU'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b54c25-971c-4699-b38b-658764cdc180]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f182986-58c4-4182-92a8-b6135c1c5e66]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:32:01 user nova-compute[74669]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)
Nov 08 17:32:01 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:32:01 user nova-compute[74669]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)
Nov 08 17:32:01 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8523f079-51ce-4c97-bd16-919c3d1b4fff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912, portal: 172.16.0.220,3260]
Nov 08 17:32:01 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912, portal: 172.16.0.220,3260] successful.
Nov 08 17:32:01 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d4cb0a-5d5b-48ba-af30-ad799cd6da48]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5373aa-bfb2-4d33-8327-1f358b437e2e]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:32:01 user nova-compute[74669]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)
Nov 08 17:32:01 user nova-compute[74669]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)
Nov 08 17:32:01 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:32:01 user nova-compute[74669]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)
Nov 08 17:32:01 user nova-compute[74669]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)
Nov 08 17:32:01 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede01f85-d90d-4f67-b08c-95457e8b8935]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:32:01 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkDuTyBU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23038343636336138', 'path': '/dev/sdd'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038343636336138', 'path': '/dev/sdd'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-593154799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-593154799',id=47,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08551815597744d89e3a61d190a9b8a7',ramdisk_id='',reservation_id='r-8yv89pes',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293450045',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:31:00Z,user_data=None,user_id='b1fcd1d4cf714f62aa8648b27a04c04e',uuid=6fd1fa42-b054-4c40-9260-7aef326f97ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3906eb94-933f-43ff-8be2-04f2c4205320", "address": "fa:16:3e:23:e3:66", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3906eb94-93", "ovs_interfaceid": "3906eb94-933f-43ff-8be2-04f2c4205320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converting VIF {"id": "3906eb94-933f-43ff-8be2-04f2c4205320", "address": "fa:16:3e:23:e3:66", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3906eb94-93", "ovs_interfaceid": "3906eb94-933f-43ff-8be2-04f2c4205320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:e3:66,bridge_name='br-int',has_traffic_filtering=True,id=3906eb94-933f-43ff-8be2-04f2c4205320,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3906eb94-93') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG nova.objects.instance [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fd1fa42-b054-4c40-9260-7aef326f97ae {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:32:02 user nova-compute[74669]:   <uuid>6fd1fa42-b054-4c40-9260-7aef326f97ae</uuid>
Nov 08 17:32:02 user nova-compute[74669]:   <name>instance-0000002f</name>
Nov 08 17:32:02 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:32:02 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:32:02 user nova-compute[74669]:   <metadata>
Nov 08 17:32:02 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:32:02 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:32:02 user nova-compute[74669]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-593154799</nova:name>
Nov 08 17:32:02 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:32:01</nova:creationTime>
Nov 08 17:32:02 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:32:02 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:32:02 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:32:02 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:32:02 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:32:02 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:32:02 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:32:02 user nova-compute[74669]:       <nova:owner>
Nov 08 17:32:02 user nova-compute[74669]:         <nova:user uuid="b1fcd1d4cf714f62aa8648b27a04c04e">tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member</nova:user>
Nov 08 17:32:02 user nova-compute[74669]:         <nova:project uuid="08551815597744d89e3a61d190a9b8a7">tempest-ServerBootFromVolumeStableRescueTest-293450045</nova:project>
Nov 08 17:32:02 user nova-compute[74669]:       </nova:owner>
Nov 08 17:32:02 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:32:02 user nova-compute[74669]:       <nova:ports>
Nov 08 17:32:02 user nova-compute[74669]:         <nova:port uuid="3906eb94-933f-43ff-8be2-04f2c4205320">
Nov 08 17:32:02 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 17:32:02 user nova-compute[74669]:         </nova:port>
Nov 08 17:32:02 user nova-compute[74669]:       </nova:ports>
Nov 08 17:32:02 user nova-compute[74669]:     </nova:instance>
Nov 08 17:32:02 user nova-compute[74669]:   </metadata>
Nov 08 17:32:02 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:32:02 user nova-compute[74669]:     <system>
Nov 08 17:32:02 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:32:02 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:32:02 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:32:02 user nova-compute[74669]:       <entry name="serial">6fd1fa42-b054-4c40-9260-7aef326f97ae</entry>
Nov 08 17:32:02 user nova-compute[74669]:       <entry name="uuid">6fd1fa42-b054-4c40-9260-7aef326f97ae</entry>
Nov 08 17:32:02 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:32:02 user nova-compute[74669]:     </system>
Nov 08 17:32:02 user nova-compute[74669]:   </sysinfo>
Nov 08 17:32:02 user nova-compute[74669]:   <os>
Nov 08 17:32:02 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:32:02 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:32:02 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:32:02 user nova-compute[74669]:   </os>
Nov 08 17:32:02 user nova-compute[74669]:   <features>
Nov 08 17:32:02 user nova-compute[74669]:     <acpi/>
Nov 08 17:32:02 user nova-compute[74669]:     <apic/>
Nov 08 17:32:02 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:32:02 user nova-compute[74669]:   </features>
Nov 08 17:32:02 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:32:02 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:32:02 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:32:02 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:32:02 user nova-compute[74669]:   </clock>
Nov 08 17:32:02 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:32:02 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:32:02 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:32:02 user nova-compute[74669]:   </cpu>
Nov 08 17:32:02 user nova-compute[74669]:   <devices>
Nov 08 17:32:02 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 17:32:02 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:32:02 user nova-compute[74669]:       <source dev="/dev/sdd"/>
Nov 08 17:32:02 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:32:02 user nova-compute[74669]:       <serial>2d84cfa4-9889-4d49-92ea-53b45d2d3912</serial>
Nov 08 17:32:02 user nova-compute[74669]:     </disk>
Nov 08 17:32:02 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:32:02 user nova-compute[74669]:       <mac address="fa:16:3e:23:e3:66"/>
Nov 08 17:32:02 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:32:02 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:32:02 user nova-compute[74669]:       <target dev="tap3906eb94-93"/>
Nov 08 17:32:02 user nova-compute[74669]:     </interface>
Nov 08 17:32:02 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:32:02 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/6fd1fa42-b054-4c40-9260-7aef326f97ae/console.log" append="off"/>
Nov 08 17:32:02 user nova-compute[74669]:     </serial>
Nov 08 17:32:02 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:32:02 user nova-compute[74669]:     <video>
Nov 08 17:32:02 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:32:02 user nova-compute[74669]:     </video>
Nov 08 17:32:02 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:32:02 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:32:02 user nova-compute[74669]:     </rng>
Nov 08 17:32:02 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:32:02 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:32:02 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:32:02 user nova-compute[74669]:     </memballoon>
Nov 08 17:32:02 user nova-compute[74669]:   </devices>
Nov 08 17:32:02 user nova-compute[74669]: </domain>
Nov 08 17:32:02 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-593154799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-593154799',id=47,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08551815597744d89e3a61d190a9b8a7',ramdisk_id='',reservation_id='r-8yv89pes',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293450045',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:31:00Z,user_data=None,user_id='b1fcd1d4cf714f62aa8648b27a04c04e',uuid=6fd1fa42-b054-4c40-9260-7aef326f97ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3906eb94-933f-43ff-8be2-04f2c4205320", "address": "fa:16:3e:23:e3:66", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3906eb94-93", "ovs_interfaceid": "3906eb94-933f-43ff-8be2-04f2c4205320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converting VIF {"id": "3906eb94-933f-43ff-8be2-04f2c4205320", "address": "fa:16:3e:23:e3:66", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3906eb94-93", "ovs_interfaceid": "3906eb94-933f-43ff-8be2-04f2c4205320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:e3:66,bridge_name='br-int',has_traffic_filtering=True,id=3906eb94-933f-43ff-8be2-04f2c4205320,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3906eb94-93') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG os_vif [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:e3:66,bridge_name='br-int',has_traffic_filtering=True,id=3906eb94-933f-43ff-8be2-04f2c4205320,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3906eb94-93') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df78e308-aae4-551e-8f4d-54b93e4c5c01', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3906eb94-93, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3906eb94-93, col_values=(('qos', UUID('01b658d7-28bd-4b63-9b5f-8840ff4912d6')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3906eb94-93, col_values=(('external_ids', {'iface-id': '3906eb94-933f-43ff-8be2-04f2c4205320', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:e3:66', 'vm-uuid': '6fd1fa42-b054-4c40-9260-7aef326f97ae'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:02 user nova-compute[74669]: INFO os_vif [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:e3:66,bridge_name='br-int',has_traffic_filtering=True,id=3906eb94-933f-43ff-8be2-04f2c4205320,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3906eb94-93')
Nov 08 17:32:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:32:02 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] No VIF found with MAC fa:16:3e:23:e3:66, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:32:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:04 user nova-compute[74669]: DEBUG nova.compute.manager [req-df607298-aeb4-40f0-bf93-6d95681ded30 req-d32c56fc-e54f-4af7-ad2f-0d959bcb5565 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received event network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:32:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-df607298-aeb4-40f0-bf93-6d95681ded30 req-d32c56fc-e54f-4af7-ad2f-0d959bcb5565 service nova] Acquiring lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:32:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-df607298-aeb4-40f0-bf93-6d95681ded30 req-d32c56fc-e54f-4af7-ad2f-0d959bcb5565 service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:32:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-df607298-aeb4-40f0-bf93-6d95681ded30 req-d32c56fc-e54f-4af7-ad2f-0d959bcb5565 service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:32:04 user nova-compute[74669]: DEBUG nova.compute.manager [req-df607298-aeb4-40f0-bf93-6d95681ded30 req-d32c56fc-e54f-4af7-ad2f-0d959bcb5565 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] No waiting events found dispatching network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:32:04 user nova-compute[74669]: WARNING nova.compute.manager [req-df607298-aeb4-40f0-bf93-6d95681ded30 req-d32c56fc-e54f-4af7-ad2f-0d959bcb5565 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received unexpected event network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 for instance with vm_state building and task_state spawning.
Nov 08 17:32:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:32:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:32:06 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Instance spawned successfully.
Nov 08 17:32:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:32:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:32:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:32:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:32:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:32:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:32:06 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:32:06 user nova-compute[74669]: INFO nova.compute.manager [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Took 4.91 seconds to spawn the instance on the hypervisor.
Nov 08 17:32:06 user nova-compute[74669]: DEBUG nova.compute.manager [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:32:06 user nova-compute[74669]: INFO nova.compute.manager [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Took 67.41 seconds to build instance.
Nov 08 17:32:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2242057f-616d-477f-9eec-b2382561c864 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 67.532s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:32:06 user nova-compute[74669]: DEBUG nova.compute.manager [req-13bc364a-f97a-49e6-97bc-0191920bb9b0 req-cf6bfad0-e0d0-40a2-a5ce-0d4a4073e0b5 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received event network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:32:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-13bc364a-f97a-49e6-97bc-0191920bb9b0 req-cf6bfad0-e0d0-40a2-a5ce-0d4a4073e0b5 service nova] Acquiring lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:32:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-13bc364a-f97a-49e6-97bc-0191920bb9b0 req-cf6bfad0-e0d0-40a2-a5ce-0d4a4073e0b5 service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:32:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-13bc364a-f97a-49e6-97bc-0191920bb9b0 req-cf6bfad0-e0d0-40a2-a5ce-0d4a4073e0b5 service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:32:06 user nova-compute[74669]: DEBUG nova.compute.manager [req-13bc364a-f97a-49e6-97bc-0191920bb9b0 req-cf6bfad0-e0d0-40a2-a5ce-0d4a4073e0b5 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] No waiting events found dispatching network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:32:06 user nova-compute[74669]: WARNING nova.compute.manager [req-13bc364a-f97a-49e6-97bc-0191920bb9b0 req-cf6bfad0-e0d0-40a2-a5ce-0d4a4073e0b5 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received unexpected event network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 for instance with vm_state active and task_state None.
Nov 08 17:32:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:08 user nova-compute[74669]: DEBUG nova.compute.manager [req-58aaac58-3d0b-4948-ae14-e41ba6b696b8 req-c226d306-93c9-4f83-a1e0-028046c42d86 service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Received event network-changed-8ee1430a-0a17-4c5d-b284-cd09f88f2b05 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:32:08 user nova-compute[74669]: DEBUG nova.compute.manager [req-58aaac58-3d0b-4948-ae14-e41ba6b696b8 req-c226d306-93c9-4f83-a1e0-028046c42d86 service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Refreshing instance network info cache due to event network-changed-8ee1430a-0a17-4c5d-b284-cd09f88f2b05. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:32:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-58aaac58-3d0b-4948-ae14-e41ba6b696b8 req-c226d306-93c9-4f83-a1e0-028046c42d86 service nova] Acquiring lock "refresh_cache-c96ab1f6-7aaa-4f48-9371-61dcad72f35a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:32:08 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-58aaac58-3d0b-4948-ae14-e41ba6b696b8 req-c226d306-93c9-4f83-a1e0-028046c42d86 service nova] Acquired lock "refresh_cache-c96ab1f6-7aaa-4f48-9371-61dcad72f35a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:32:08 user nova-compute[74669]: DEBUG nova.network.neutron [req-58aaac58-3d0b-4948-ae14-e41ba6b696b8 req-c226d306-93c9-4f83-a1e0-028046c42d86 service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Refreshing network info cache for port 8ee1430a-0a17-4c5d-b284-cd09f88f2b05 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:32:09 user nova-compute[74669]: DEBUG nova.network.neutron [req-58aaac58-3d0b-4948-ae14-e41ba6b696b8 req-c226d306-93c9-4f83-a1e0-028046c42d86 service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Updated VIF entry in instance network info cache for port 8ee1430a-0a17-4c5d-b284-cd09f88f2b05. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:32:09 user nova-compute[74669]: DEBUG nova.network.neutron [req-58aaac58-3d0b-4948-ae14-e41ba6b696b8 req-c226d306-93c9-4f83-a1e0-028046c42d86 service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Updating instance_info_cache with network_info: [{"id": "8ee1430a-0a17-4c5d-b284-cd09f88f2b05", "address": "fa:16:3e:9b:31:48", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee1430a-0a", "ovs_interfaceid": "8ee1430a-0a17-4c5d-b284-cd09f88f2b05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:32:09 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-58aaac58-3d0b-4948-ae14-e41ba6b696b8 req-c226d306-93c9-4f83-a1e0-028046c42d86 service nova] Releasing lock "refresh_cache-c96ab1f6-7aaa-4f48-9371-61dcad72f35a" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:32:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:16 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:32:17 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:32:17 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:32:17 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:32:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:20 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:32:20 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:32:20 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 17:32:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:32:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:32:20 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:32:20 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lazy-loading 'info_cache' on Instance uuid 0796133c-71d6-4d64-94af-49028a6603ea {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:32:21 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Updating instance_info_cache with network_info: [{"id": "1fa691c0-3473-4f34-a504-3778913558ab", "address": "fa:16:3e:2f:15:d7", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa691c0-34", "ovs_interfaceid": "1fa691c0-3473-4f34-a504-3778913558ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:32:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:32:21 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:32:21 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:32:21 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74669) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 17:32:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:23 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:32:23 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:32:23 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:32:23 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "2a7fa806-b84f-4e7e-a6cd-14be375a8c9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "2a7fa806-b84f-4e7e-a6cd-14be375a8c9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG nova.compute.manager [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:32:24 user nova-compute[74669]: INFO nova.compute.claims [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Claim successful on node user
Nov 08 17:32:24 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Refreshing inventories for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Updating ProviderTree inventory for provider ce26964b-e55b-43d2-801a-7221ff1fe64b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Updating inventory in ProviderTree for provider ce26964b-e55b-43d2-801a-7221ff1fe64b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Refreshing aggregate associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, aggregates: None {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Refreshing trait associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, traits: HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG nova.compute.manager [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:32:24 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:32:24 user nova-compute[74669]: DEBUG nova.compute.manager [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG nova.network.neutron [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG nova.compute.manager [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG nova.policy [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0907ddd682244b7db3c2a10726fffb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be63fa80aa24b1e9c8d84e5f54c4270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:32:24 user nova-compute[74669]: INFO nova.virt.block_device [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Booting with volume snapshot 60104cef-ee3b-4331-8cbf-f62a6faf9894 at /dev/vda
Nov 08 17:32:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:32:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:25 user nova-compute[74669]: DEBUG nova.network.neutron [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Successfully created port: 8ce2281d-5d42-4567-8483-a1c66d97db24 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:32:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:32:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG nova.network.neutron [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Successfully updated port: 8ce2281d-5d42-4567-8483-a1c66d97db24 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:32:26 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:32:26 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:32:26 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8523MB free_disk=25.058635711669922GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "refresh_cache-2a7fa806-b84f-4e7e-a6cd-14be375a8c9b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquired lock "refresh_cache-2a7fa806-b84f-4e7e-a6cd-14be375a8c9b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG nova.network.neutron [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-c7bcab2e-a26d-425b-a981-3a5d7ce931f0 req-6513042a-17fd-467d-89a9-6cf5fc413ef3 service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Received event network-changed-8ce2281d-5d42-4567-8483-a1c66d97db24 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-c7bcab2e-a26d-425b-a981-3a5d7ce931f0 req-6513042a-17fd-467d-89a9-6cf5fc413ef3 service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Refreshing instance network info cache due to event network-changed-8ce2281d-5d42-4567-8483-a1c66d97db24. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c7bcab2e-a26d-425b-a981-3a5d7ce931f0 req-6513042a-17fd-467d-89a9-6cf5fc413ef3 service nova] Acquiring lock "refresh_cache-2a7fa806-b84f-4e7e-a6cd-14be375a8c9b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG nova.network.neutron [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0796133c-71d6-4d64-94af-49028a6603ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance fa8c4d88-8b6c-4ef6-9876-62597ace9c37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 49657a40-5c34-43d3-9bb5-b78dab52d2ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance c96ab1f6-7aaa-4f48-9371-61dcad72f35a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 6fd1fa42-b054-4c40-9260-7aef326f97ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG nova.network.neutron [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Updating instance_info_cache with network_info: [{"id": "8ce2281d-5d42-4567-8483-a1c66d97db24", "address": "fa:16:3e:99:dc:9b", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ce2281d-5d", "ovs_interfaceid": "8ce2281d-5d42-4567-8483-a1c66d97db24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Releasing lock "refresh_cache-2a7fa806-b84f-4e7e-a6cd-14be375a8c9b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG nova.compute.manager [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Instance network_info: |[{"id": "8ce2281d-5d42-4567-8483-a1c66d97db24", "address": "fa:16:3e:99:dc:9b", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ce2281d-5d", "ovs_interfaceid": "8ce2281d-5d42-4567-8483-a1c66d97db24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c7bcab2e-a26d-425b-a981-3a5d7ce931f0 req-6513042a-17fd-467d-89a9-6cf5fc413ef3 service nova] Acquired lock "refresh_cache-2a7fa806-b84f-4e7e-a6cd-14be375a8c9b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG nova.network.neutron [req-c7bcab2e-a26d-425b-a981-3a5d7ce931f0 req-6513042a-17fd-467d-89a9-6cf5fc413ef3 service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Refreshing network info cache for port 8ce2281d-5d42-4567-8483-a1c66d97db24 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:32:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.579s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:32:27 user nova-compute[74669]: DEBUG nova.network.neutron [req-c7bcab2e-a26d-425b-a981-3a5d7ce931f0 req-6513042a-17fd-467d-89a9-6cf5fc413ef3 service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Updated VIF entry in instance network info cache for port 8ce2281d-5d42-4567-8483-a1c66d97db24. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:32:27 user nova-compute[74669]: DEBUG nova.network.neutron [req-c7bcab2e-a26d-425b-a981-3a5d7ce931f0 req-6513042a-17fd-467d-89a9-6cf5fc413ef3 service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Updating instance_info_cache with network_info: [{"id": "8ce2281d-5d42-4567-8483-a1c66d97db24", "address": "fa:16:3e:99:dc:9b", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ce2281d-5d", "ovs_interfaceid": "8ce2281d-5d42-4567-8483-a1c66d97db24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:32:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c7bcab2e-a26d-425b-a981-3a5d7ce931f0 req-6513042a-17fd-467d-89a9-6cf5fc413ef3 service nova] Releasing lock "refresh_cache-2a7fa806-b84f-4e7e-a6cd-14be375a8c9b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:32:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:30 user nova-compute[74669]: DEBUG os_brick.utils [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:32:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec6c18c-5fca-4eb3-9fb5-aca6e309b9db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f5fcea-ddce-443a-874e-938fbbd41683]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7594cb-7214-4205-b0e4-22a305fbaa3d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[798f9727-4fe7-4d36-8167-b4dc091e31b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:32:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:32:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:32:30 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:32:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eeb8d59-5ef5-4072-95d9-f9ff5406a128]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:32:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:32:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:32:30 user nova-compute[74669]: DEBUG os_brick.utils [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:32:30 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Updating existing volume attachment record: 0202e68f-841e-4cac-9d8b-846bb88f4902 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:32:32 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:32:32 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 17:32:32 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] There are 0 instances to clean {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 17:32:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:32:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:32:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:32:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:32:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:32:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:32:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG nova.compute.manager [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:32:53 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Creating image(s)
Nov 08 17:32:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Did not create local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Ensure instance console log exists: /opt/stack/data/nova/instances/2a7fa806-b84f-4e7e-a6cd-14be375a8c9b/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Start _get_guest_xml network_info=[{"id": "8ce2281d-5d42-4567-8483-a1c66d97db24", "address": "fa:16:3e:99:dc:9b", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ce2281d-5d", "ovs_interfaceid": "8ce2281d-5d42-4567-8483-a1c66d97db24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-08T17:32:10Z,direct_url=<?>,disk_format='qcow2',id=156ae9cb-4678-4b54-a48d-502435f41e88,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-541240993',owner='5be63fa80aa24b1e9c8d84e5f54c4270',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-08T17:32:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '0202e68f-841e-4cac-9d8b-846bb88f4902', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tansVEpk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2a7fa806-b84f-4e7e-a6cd-14be375a8c9b', 'attached_at': '', 'detached_at': '', 'volume_id': '07217c55-6253-4b52-818f-28d7ceda77a9', 'serial': '07217c55-6253-4b52-818f-28d7ceda77a9'}, 'guest_format': None, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:32:53 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:32:53 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:32:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-08T17:32:10Z,direct_url=<?>,disk_format='qcow2',id=156ae9cb-4678-4b54-a48d-502435f41e88,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-541240993',owner='5be63fa80aa24b1e9c8d84e5f54c4270',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-08T17:32:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tansVEpk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:32:53 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:32:53 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:32:53 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6542c5f-2d03-4285-94f2-171f5b0be63f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:32:53 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcad71d-760c-45a1-a896-ae12e3d2293c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9] added
Nov 08 17:32:53 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbacdb9-2ecf-42a1-a42b-5260cd1f6319]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a61f40-7027-4c58-b0f4-dbdf8edd4ea3]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tansVEpk {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tansVEpk" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b6ae36-0b1f-4f47-9da3-4bbac85da7da]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tansVEpk'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a694a5-584f-42fa-8873-dfa5595444a4]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9e1562-755d-4290-a05c-eee134e53c2e]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:32:53 user nova-compute[74669]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)
Nov 08 17:32:53 user nova-compute[74669]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)
Nov 08 17:32:53 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:32:53 user nova-compute[74669]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)
Nov 08 17:32:53 user nova-compute[74669]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)
Nov 08 17:32:53 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2906028e-868d-4a7f-a02b-2ac9ecc2c711]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9, portal: 172.16.0.220,3260]
Nov 08 17:32:53 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9, portal: 172.16.0.220,3260] successful.
Nov 08 17:32:53 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3d2131-aa0d-41a2-abd6-391f949e297a]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1049a5-b3c5-49ff-b0e4-524135c799d4]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:32:53 user nova-compute[74669]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)
Nov 08 17:32:53 user nova-compute[74669]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)
Nov 08 17:32:53 user nova-compute[74669]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 (non-flash)
Nov 08 17:32:53 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:32:53 user nova-compute[74669]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)
Nov 08 17:32:53 user nova-compute[74669]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)
Nov 08 17:32:53 user nova-compute[74669]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 (non-flash)
Nov 08 17:32:53 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad34e006-2b9b-40e1-a2fa-bd5b77736937]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:32:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tansVEpk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23339346163376564', 'path': '/dev/sde'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339346163376564', 'path': '/dev/sde'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:32:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1161654116',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1161654116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1161654116',id=48,image_ref='156ae9cb-4678-4b54-a48d-502435f41e88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3dWA+1BgJnt+M5COhI798uK8+Uf0Y9lvtprwi7VrgTACd5D64ZEUzAmMUOzbIQy5hjSP2TDAS8LZvGYvGwMFKhgmR9o7Ly0eih/hJaYIh+Wnos/etWWL+kxAXJ5aIPSw==',key_name='tempest-keypair-2003638166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5be63fa80aa24b1e9c8d84e5f54c4270',ramdisk_id='',reservation_id='r-o4qql0z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-632748264',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-632748264-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-632748264',owner_user_name='tempest-TestVolumeBootPattern-632748264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:32:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0907ddd682244b7db3c2a10726fffb46',uuid=2a7fa806-b84f-4e7e-a6cd-14be375a8c9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ce2281d-5d42-4567-8483-a1c66d97db24", "address": "fa:16:3e:99:dc:9b", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ce2281d-5d", "ovs_interfaceid": "8ce2281d-5d42-4567-8483-a1c66d97db24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converting VIF {"id": "8ce2281d-5d42-4567-8483-a1c66d97db24", "address": "fa:16:3e:99:dc:9b", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ce2281d-5d", "ovs_interfaceid": "8ce2281d-5d42-4567-8483-a1c66d97db24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:dc:9b,bridge_name='br-int',has_traffic_filtering=True,id=8ce2281d-5d42-4567-8483-a1c66d97db24,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ce2281d-5d') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG nova.objects.instance [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:32:54 user nova-compute[74669]:   <uuid>2a7fa806-b84f-4e7e-a6cd-14be375a8c9b</uuid>
Nov 08 17:32:54 user nova-compute[74669]:   <name>instance-00000030</name>
Nov 08 17:32:54 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:32:54 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:32:54 user nova-compute[74669]:   <metadata>
Nov 08 17:32:54 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:32:54 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:32:54 user nova-compute[74669]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1161654116</nova:name>
Nov 08 17:32:54 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:32:53</nova:creationTime>
Nov 08 17:32:54 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:32:54 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:32:54 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:32:54 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:32:54 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:32:54 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:32:54 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:32:54 user nova-compute[74669]:       <nova:owner>
Nov 08 17:32:54 user nova-compute[74669]:         <nova:user uuid="0907ddd682244b7db3c2a10726fffb46">tempest-TestVolumeBootPattern-632748264-project-member</nova:user>
Nov 08 17:32:54 user nova-compute[74669]:         <nova:project uuid="5be63fa80aa24b1e9c8d84e5f54c4270">tempest-TestVolumeBootPattern-632748264</nova:project>
Nov 08 17:32:54 user nova-compute[74669]:       </nova:owner>
Nov 08 17:32:54 user nova-compute[74669]:       <nova:root type="image" uuid="156ae9cb-4678-4b54-a48d-502435f41e88"/>
Nov 08 17:32:54 user nova-compute[74669]:       <nova:ports>
Nov 08 17:32:54 user nova-compute[74669]:         <nova:port uuid="8ce2281d-5d42-4567-8483-a1c66d97db24">
Nov 08 17:32:54 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 17:32:54 user nova-compute[74669]:         </nova:port>
Nov 08 17:32:54 user nova-compute[74669]:       </nova:ports>
Nov 08 17:32:54 user nova-compute[74669]:     </nova:instance>
Nov 08 17:32:54 user nova-compute[74669]:   </metadata>
Nov 08 17:32:54 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:32:54 user nova-compute[74669]:     <system>
Nov 08 17:32:54 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:32:54 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:32:54 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:32:54 user nova-compute[74669]:       <entry name="serial">2a7fa806-b84f-4e7e-a6cd-14be375a8c9b</entry>
Nov 08 17:32:54 user nova-compute[74669]:       <entry name="uuid">2a7fa806-b84f-4e7e-a6cd-14be375a8c9b</entry>
Nov 08 17:32:54 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:32:54 user nova-compute[74669]:     </system>
Nov 08 17:32:54 user nova-compute[74669]:   </sysinfo>
Nov 08 17:32:54 user nova-compute[74669]:   <os>
Nov 08 17:32:54 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:32:54 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:32:54 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:32:54 user nova-compute[74669]:   </os>
Nov 08 17:32:54 user nova-compute[74669]:   <features>
Nov 08 17:32:54 user nova-compute[74669]:     <acpi/>
Nov 08 17:32:54 user nova-compute[74669]:     <apic/>
Nov 08 17:32:54 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:32:54 user nova-compute[74669]:   </features>
Nov 08 17:32:54 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:32:54 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:32:54 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:32:54 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:32:54 user nova-compute[74669]:   </clock>
Nov 08 17:32:54 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:32:54 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:32:54 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:32:54 user nova-compute[74669]:   </cpu>
Nov 08 17:32:54 user nova-compute[74669]:   <devices>
Nov 08 17:32:54 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 17:32:54 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:32:54 user nova-compute[74669]:       <source dev="/dev/sde"/>
Nov 08 17:32:54 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:32:54 user nova-compute[74669]:       <serial>07217c55-6253-4b52-818f-28d7ceda77a9</serial>
Nov 08 17:32:54 user nova-compute[74669]:     </disk>
Nov 08 17:32:54 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:32:54 user nova-compute[74669]:       <mac address="fa:16:3e:99:dc:9b"/>
Nov 08 17:32:54 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:32:54 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:32:54 user nova-compute[74669]:       <target dev="tap8ce2281d-5d"/>
Nov 08 17:32:54 user nova-compute[74669]:     </interface>
Nov 08 17:32:54 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:32:54 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/2a7fa806-b84f-4e7e-a6cd-14be375a8c9b/console.log" append="off"/>
Nov 08 17:32:54 user nova-compute[74669]:     </serial>
Nov 08 17:32:54 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:32:54 user nova-compute[74669]:     <video>
Nov 08 17:32:54 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:32:54 user nova-compute[74669]:     </video>
Nov 08 17:32:54 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:32:54 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:32:54 user nova-compute[74669]:     </rng>
Nov 08 17:32:54 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:32:54 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:32:54 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:32:54 user nova-compute[74669]:     </memballoon>
Nov 08 17:32:54 user nova-compute[74669]:   </devices>
Nov 08 17:32:54 user nova-compute[74669]: </domain>
Nov 08 17:32:54 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:32:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1161654116',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1161654116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1161654116',id=48,image_ref='156ae9cb-4678-4b54-a48d-502435f41e88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3dWA+1BgJnt+M5COhI798uK8+Uf0Y9lvtprwi7VrgTACd5D64ZEUzAmMUOzbIQy5hjSP2TDAS8LZvGYvGwMFKhgmR9o7Ly0eih/hJaYIh+Wnos/etWWL+kxAXJ5aIPSw==',key_name='tempest-keypair-2003638166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5be63fa80aa24b1e9c8d84e5f54c4270',ramdisk_id='',reservation_id='r-o4qql0z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-632748264',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-632748264-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-632748264',owner_user_name='tempest-TestVolumeBootPattern-632748264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:32:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0907ddd682244b7db3c2a10726fffb46',uuid=2a7fa806-b84f-4e7e-a6cd-14be375a8c9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ce2281d-5d42-4567-8483-a1c66d97db24", "address": "fa:16:3e:99:dc:9b", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ce2281d-5d", "ovs_interfaceid": "8ce2281d-5d42-4567-8483-a1c66d97db24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converting VIF {"id": "8ce2281d-5d42-4567-8483-a1c66d97db24", "address": "fa:16:3e:99:dc:9b", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ce2281d-5d", "ovs_interfaceid": "8ce2281d-5d42-4567-8483-a1c66d97db24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:dc:9b,bridge_name='br-int',has_traffic_filtering=True,id=8ce2281d-5d42-4567-8483-a1c66d97db24,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ce2281d-5d') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG os_vif [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:dc:9b,bridge_name='br-int',has_traffic_filtering=True,id=8ce2281d-5d42-4567-8483-a1c66d97db24,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ce2281d-5d') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a3fc75ad-6dea-59bd-81ba-626a8e88158b', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ce2281d-5d, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ce2281d-5d, col_values=(('qos', UUID('1bfde97f-269a-4a29-b45f-c6a5eb18b049')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ce2281d-5d, col_values=(('external_ids', {'iface-id': '8ce2281d-5d42-4567-8483-a1c66d97db24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:dc:9b', 'vm-uuid': '2a7fa806-b84f-4e7e-a6cd-14be375a8c9b'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:54 user nova-compute[74669]: INFO os_vif [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:dc:9b,bridge_name='br-int',has_traffic_filtering=True,id=8ce2281d-5d42-4567-8483-a1c66d97db24,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ce2281d-5d')
Nov 08 17:32:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:32:54 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] No VIF found with MAC fa:16:3e:99:dc:9b, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:32:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:56 user nova-compute[74669]: DEBUG nova.compute.manager [req-43cb79cb-7c8a-4707-84d7-2bd05fe93d97 req-2db29347-750b-47dd-806c-88aa02d8b7cc service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Received event network-vif-plugged-8ce2281d-5d42-4567-8483-a1c66d97db24 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:32:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-43cb79cb-7c8a-4707-84d7-2bd05fe93d97 req-2db29347-750b-47dd-806c-88aa02d8b7cc service nova] Acquiring lock "2a7fa806-b84f-4e7e-a6cd-14be375a8c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:32:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-43cb79cb-7c8a-4707-84d7-2bd05fe93d97 req-2db29347-750b-47dd-806c-88aa02d8b7cc service nova] Lock "2a7fa806-b84f-4e7e-a6cd-14be375a8c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:32:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-43cb79cb-7c8a-4707-84d7-2bd05fe93d97 req-2db29347-750b-47dd-806c-88aa02d8b7cc service nova] Lock "2a7fa806-b84f-4e7e-a6cd-14be375a8c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:32:56 user nova-compute[74669]: DEBUG nova.compute.manager [req-43cb79cb-7c8a-4707-84d7-2bd05fe93d97 req-2db29347-750b-47dd-806c-88aa02d8b7cc service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] No waiting events found dispatching network-vif-plugged-8ce2281d-5d42-4567-8483-a1c66d97db24 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:32:56 user nova-compute[74669]: WARNING nova.compute.manager [req-43cb79cb-7c8a-4707-84d7-2bd05fe93d97 req-2db29347-750b-47dd-806c-88aa02d8b7cc service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Received unexpected event network-vif-plugged-8ce2281d-5d42-4567-8483-a1c66d97db24 for instance with vm_state building and task_state spawning.
Nov 08 17:32:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:58 user nova-compute[74669]: DEBUG nova.compute.manager [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:32:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:32:58 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Instance spawned successfully.
Nov 08 17:32:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:32:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:32:58 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:32:58 user nova-compute[74669]: INFO nova.compute.manager [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 08 17:32:58 user nova-compute[74669]: DEBUG nova.compute.manager [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:32:58 user nova-compute[74669]: DEBUG nova.compute.manager [req-cf43e8eb-b595-46c3-8906-800ec61fadf0 req-0fbf19a1-454c-4ca9-b03b-5a5f9e51765c service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Received event network-vif-plugged-8ce2281d-5d42-4567-8483-a1c66d97db24 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:32:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-cf43e8eb-b595-46c3-8906-800ec61fadf0 req-0fbf19a1-454c-4ca9-b03b-5a5f9e51765c service nova] Acquiring lock "2a7fa806-b84f-4e7e-a6cd-14be375a8c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:32:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-cf43e8eb-b595-46c3-8906-800ec61fadf0 req-0fbf19a1-454c-4ca9-b03b-5a5f9e51765c service nova] Lock "2a7fa806-b84f-4e7e-a6cd-14be375a8c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:32:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-cf43e8eb-b595-46c3-8906-800ec61fadf0 req-0fbf19a1-454c-4ca9-b03b-5a5f9e51765c service nova] Lock "2a7fa806-b84f-4e7e-a6cd-14be375a8c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:32:58 user nova-compute[74669]: DEBUG nova.compute.manager [req-cf43e8eb-b595-46c3-8906-800ec61fadf0 req-0fbf19a1-454c-4ca9-b03b-5a5f9e51765c service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] No waiting events found dispatching network-vif-plugged-8ce2281d-5d42-4567-8483-a1c66d97db24 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:32:58 user nova-compute[74669]: WARNING nova.compute.manager [req-cf43e8eb-b595-46c3-8906-800ec61fadf0 req-0fbf19a1-454c-4ca9-b03b-5a5f9e51765c service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Received unexpected event network-vif-plugged-8ce2281d-5d42-4567-8483-a1c66d97db24 for instance with vm_state building and task_state spawning.
Nov 08 17:32:58 user nova-compute[74669]: INFO nova.compute.manager [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Took 34.36 seconds to build instance.
Nov 08 17:32:58 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-8e66e0bc-327f-4dc2-8c44-81c7794e7813 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "2a7fa806-b84f-4e7e-a6cd-14be375a8c9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.449s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:32:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:32:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:33:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:33:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:33:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:33:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:33:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:17 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:33:18 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:33:18 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:33:18 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:33:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:21 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:33:21 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:33:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:33:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:33:21 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:33:22 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Updating instance_info_cache with network_info: [{"id": "a4820eb9-3a23-479e-b429-47171c75f100", "address": "fa:16:3e:12:b9:b1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4820eb9-3a", "ovs_interfaceid": "a4820eb9-3a23-479e-b429-47171c75f100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:33:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:33:22 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:33:23 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:33:23 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:33:23 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:33:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:24 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:33:24 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:33:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:33:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:33:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:33:24 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:33:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:33:24 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:33:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:33:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:33:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:33:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:33:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:33:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:33:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:33:25 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:33:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:33:25 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:33:26 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:33:26 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:33:26 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8427MB free_disk=25.049156188964844GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:33:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:33:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:33:26 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0796133c-71d6-4d64-94af-49028a6603ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:33:26 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance fa8c4d88-8b6c-4ef6-9876-62597ace9c37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:33:26 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 49657a40-5c34-43d3-9bb5-b78dab52d2ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:33:26 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance c96ab1f6-7aaa-4f48-9371-61dcad72f35a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:33:26 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 6fd1fa42-b054-4c40-9260-7aef326f97ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:33:26 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:33:26 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:33:26 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:33:26 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:33:26 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:33:26 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:33:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.344s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:33:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:33:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:33:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:33:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:33:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:33:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:33:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:40 user nova-compute[74669]: INFO nova.compute.manager [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Rescuing
Nov 08 17:33:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "refresh_cache-6fd1fa42-b054-4c40-9260-7aef326f97ae" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:33:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquired lock "refresh_cache-6fd1fa42-b054-4c40-9260-7aef326f97ae" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:33:40 user nova-compute[74669]: DEBUG nova.network.neutron [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:33:40 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:33:40 user nova-compute[74669]: DEBUG nova.network.neutron [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Updating instance_info_cache with network_info: [{"id": "3906eb94-933f-43ff-8be2-04f2c4205320", "address": "fa:16:3e:23:e3:66", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3906eb94-93", "ovs_interfaceid": "3906eb94-933f-43ff-8be2-04f2c4205320", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:33:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Releasing lock "refresh_cache-6fd1fa42-b054-4c40-9260-7aef326f97ae" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:33:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-0ebc6b89-77f1-4e0b-acfc-531d071fc016 req-7bad5ec9-b119-4ec0-bca4-9f679a412372 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received event network-vif-unplugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:33:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0ebc6b89-77f1-4e0b-acfc-531d071fc016 req-7bad5ec9-b119-4ec0-bca4-9f679a412372 service nova] Acquiring lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:33:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0ebc6b89-77f1-4e0b-acfc-531d071fc016 req-7bad5ec9-b119-4ec0-bca4-9f679a412372 service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:33:40 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0ebc6b89-77f1-4e0b-acfc-531d071fc016 req-7bad5ec9-b119-4ec0-bca4-9f679a412372 service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:33:40 user nova-compute[74669]: DEBUG nova.compute.manager [req-0ebc6b89-77f1-4e0b-acfc-531d071fc016 req-7bad5ec9-b119-4ec0-bca4-9f679a412372 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] No waiting events found dispatching network-vif-unplugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:33:40 user nova-compute[74669]: WARNING nova.compute.manager [req-0ebc6b89-77f1-4e0b-acfc-531d071fc016 req-7bad5ec9-b119-4ec0-bca4-9f679a412372 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received unexpected event network-vif-unplugged-3906eb94-933f-43ff-8be2-04f2c4205320 for instance with vm_state active and task_state rescuing.
Nov 08 17:33:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:41 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Instance destroyed successfully.
Nov 08 17:33:41 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Attempting a stable device rescue
Nov 08 17:33:41 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74669) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 17:33:41 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Instance directory exists: not creating {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 17:33:41 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Creating image(s)
Nov 08 17:33:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "/opt/stack/data/nova/instances/6fd1fa42-b054-4c40-9260-7aef326f97ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:33:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "/opt/stack/data/nova/instances/6fd1fa42-b054-4c40-9260-7aef326f97ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:33:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "/opt/stack/data/nova/instances/6fd1fa42-b054-4c40-9260-7aef326f97ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:33:41 user nova-compute[74669]: DEBUG nova.objects.instance [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6fd1fa42-b054-4c40-9260-7aef326f97ae {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:33:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "50a547c24e586f24988fb6fad6fc6377630d3b4d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:33:41 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "50a547c24e586f24988fb6fad6fc6377630d3b4d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:33:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50a547c24e586f24988fb6fad6fc6377630d3b4d.part --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:33:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50a547c24e586f24988fb6fad6fc6377630d3b4d.part --force-share --output=json" returned: 0 in 0.181s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:33:42 user nova-compute[74669]: DEBUG nova.virt.images [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] ff199149-2ca4-4e6f-b34a-0d45f04fcf98 was qcow2, converting to raw {{(pid=74669) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 17:33:42 user nova-compute[74669]: DEBUG nova.privsep.utils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74669) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 17:33:42 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/50a547c24e586f24988fb6fad6fc6377630d3b4d.part /opt/stack/data/nova/instances/_base/50a547c24e586f24988fb6fad6fc6377630d3b4d.converted {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:33:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-45669756-fd4b-4b32-bc8a-55dcb9dcf4e1 req-55fc4937-324e-44f2-8f12-adec62c95cb5 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received event network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:33:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-45669756-fd4b-4b32-bc8a-55dcb9dcf4e1 req-55fc4937-324e-44f2-8f12-adec62c95cb5 service nova] Acquiring lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:33:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-45669756-fd4b-4b32-bc8a-55dcb9dcf4e1 req-55fc4937-324e-44f2-8f12-adec62c95cb5 service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:33:42 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-45669756-fd4b-4b32-bc8a-55dcb9dcf4e1 req-55fc4937-324e-44f2-8f12-adec62c95cb5 service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:33:42 user nova-compute[74669]: DEBUG nova.compute.manager [req-45669756-fd4b-4b32-bc8a-55dcb9dcf4e1 req-55fc4937-324e-44f2-8f12-adec62c95cb5 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] No waiting events found dispatching network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:33:42 user nova-compute[74669]: WARNING nova.compute.manager [req-45669756-fd4b-4b32-bc8a-55dcb9dcf4e1 req-55fc4937-324e-44f2-8f12-adec62c95cb5 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received unexpected event network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 for instance with vm_state active and task_state rescuing.
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/50a547c24e586f24988fb6fad6fc6377630d3b4d.part /opt/stack/data/nova/instances/_base/50a547c24e586f24988fb6fad6fc6377630d3b4d.converted" returned: 0 in 0.661s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50a547c24e586f24988fb6fad6fc6377630d3b4d.converted --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50a547c24e586f24988fb6fad6fc6377630d3b4d.converted --force-share --output=json" returned: 0 in 0.169s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "50a547c24e586f24988fb6fad6fc6377630d3b4d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.013s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "50a547c24e586f24988fb6fad6fc6377630d3b4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "50a547c24e586f24988fb6fad6fc6377630d3b4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50a547c24e586f24988fb6fad6fc6377630d3b4d --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50a547c24e586f24988fb6fad6fc6377630d3b4d --force-share --output=json" returned: 0 in 0.173s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50a547c24e586f24988fb6fad6fc6377630d3b4d,backing_fmt=raw /opt/stack/data/nova/instances/6fd1fa42-b054-4c40-9260-7aef326f97ae/disk.rescue {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50a547c24e586f24988fb6fad6fc6377630d3b4d,backing_fmt=raw /opt/stack/data/nova/instances/6fd1fa42-b054-4c40-9260-7aef326f97ae/disk.rescue" returned: 0 in 0.048s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "50a547c24e586f24988fb6fad6fc6377630d3b4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.objects.instance [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lazy-loading 'migration_context' on Instance uuid 6fd1fa42-b054-4c40-9260-7aef326f97ae {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.objects.base [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Object Instance<6fd1fa42-b054-4c40-9260-7aef326f97ae> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Created local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Start _get_guest_xml network_info=[{"id": "3906eb94-933f-43ff-8be2-04f2c4205320", "address": "fa:16:3e:23:e3:66", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "vif_mac": "fa:16:3e:23:e3:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3906eb94-93", "ovs_interfaceid": "3906eb94-933f-43ff-8be2-04f2c4205320", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ff199149-2ca4-4e6f-b34a-0d45f04fcf98', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '48901188-a107-4c61-a607-2166c21198a6', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkDuTyBU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '6fd1fa42-b054-4c40-9260-7aef326f97ae', 'attached_at': '', 'detached_at': '', 'volume_id': '2d84cfa4-9889-4d49-92ea-53b45d2d3912', 'serial': '2d84cfa4-9889-4d49-92ea-53b45d2d3912'}, 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.objects.instance [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lazy-loading 'resources' on Instance uuid 6fd1fa42-b054-4c40-9260-7aef326f97ae {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.objects.base [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Object Instance<6fd1fa42-b054-4c40-9260-7aef326f97ae> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.objects.instance [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lazy-loading 'numa_topology' on Instance uuid 6fd1fa42-b054-4c40-9260-7aef326f97ae {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.objects.base [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Object Instance<6fd1fa42-b054-4c40-9260-7aef326f97ae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:33:43 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:33:43 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T16:47:04Z,direct_url=<?>,disk_format='qcow2',id=ee6edaa4-6206-44ab-8497-fdbc2291f87f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79496da39fb84da59931e2879cd9367e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T16:47:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.objects.instance [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6fd1fa42-b054-4c40-9260-7aef326f97ae {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.objects.base [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Object Instance<6fd1fa42-b054-4c40-9260-7aef326f97ae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkDuTyBU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:33:43 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:33:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:33:43 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:33:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:33:43 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cd40b7-1ab5-4036-b7d3-484059a2dabc]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = fkDuTyBU\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 17:33:43 user nova-compute[74669]: node.name = iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912
Nov 08 17:33:43 user nova-compute[74669]: node.tpgt = -1
Nov 08 17:33:43 user nova-compute[74669]: node.startup = automatic
Nov 08 17:33:43 user nova-compute[74669]: node.leading_login = No
Nov 08 17:33:43 user nova-compute[74669]: iface.iscsi_ifacename = default
Nov 08 17:33:43 user nova-compute[74669]: iface.net_ifacename = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.ipaddress = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.prefix_len = 0
Nov 08 17:33:43 user nova-compute[74669]: iface.hwaddress = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.transport_name = tcp
Nov 08 17:33:43 user nova-compute[74669]: iface.initiatorname = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.state = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.vlan_id = 0
Nov 08 17:33:43 user nova-compute[74669]: iface.vlan_priority = 0
Nov 08 17:33:43 user nova-compute[74669]: iface.vlan_state = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.iface_num = 0
Nov 08 17:33:43 user nova-compute[74669]: iface.mtu = 0
Nov 08 17:33:43 user nova-compute[74669]: iface.port = 0
Nov 08 17:33:43 user nova-compute[74669]: iface.bootproto = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.subnet_mask = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.gateway = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.dhcp_alt_client_id = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.dhcp_dns = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.dhcp_learn_iqn = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.dhcp_vendor_id_state = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.dhcp_vendor_id = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.dhcp_slp_da = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.fragmentation = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.gratuitous_arp = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.incoming_forwarding = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.tos_state = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.tos = 0
Nov 08 17:33:43 user nova-compute[74669]: iface.ttl = 0
Nov 08 17:33:43 user nova-compute[74669]: iface.delayed_ack = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.tcp_nagle = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.tcp_wsf_state = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.tcp_wsf = 0
Nov 08 17:33:43 user nova-compute[74669]: iface.tcp_timer_scale = 0
Nov 08 17:33:43 user nova-compute[74669]: iface.tcp_timestamp = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.redirect = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.def_task_mgmt_timeout = 0
Nov 08 17:33:43 user nova-compute[74669]: iface.header_digest = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.data_digest = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.immediate_data = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.initial_r2t = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.data_seq_inorder = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.data_pdu_inorder = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.erl = 0
Nov 08 17:33:43 user nova-compute[74669]: iface.max_receive_data_len = 0
Nov 08 17:33:43 user nova-compute[74669]: iface.first_burst_len = 0
Nov 08 17:33:43 user nova-compute[74669]: iface.max_outstanding_r2t = 0
Nov 08 17:33:43 user nova-compute[74669]: iface.max_burst_len = 0
Nov 08 17:33:43 user nova-compute[74669]: iface.chap_auth = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.bidi_chap = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.strict_login_compliance = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.discovery_auth = <empty>
Nov 08 17:33:43 user nova-compute[74669]: iface.discovery_logout = <empty>
Nov 08 17:33:43 user nova-compute[74669]: node.discovery_address = <empty>
Nov 08 17:33:43 user nova-compute[74669]: node.discovery_port = 0
Nov 08 17:33:43 user nova-compute[74669]: node.discovery_type = static
Nov 08 17:33:43 user nova-compute[74669]: node.session.initial_cmdsn = 0
Nov 08 17:33:43 user nova-compute[74669]: node.session.initial_login_retry_max = 8
Nov 08 17:33:43 user nova-compute[74669]: node.session.xmit_thread_priority = -20
Nov 08 17:33:43 user nova-compute[74669]: node.session.cmds_max = 128
Nov 08 17:33:43 user nova-compute[74669]: node.session.queue_depth = 32
Nov 08 17:33:43 user nova-compute[74669]: node.session.nr_sessions = 1
Nov 08 17:33:43 user nova-compute[74669]: node.session.auth.authmethod = CHAP
Nov 08 17:33:43 user nova-compute[74669]: node.session.auth.username = fkDuTyBU
Nov 08 17:33:43 user nova-compute[74669]: node.session.auth.password = ***
Nov 08 17:33:43 user nova-compute[74669]: node.session.auth.username_in = <empty>
Nov 08 17:33:43 user nova-compute[74669]: node.session.auth.password_in = <empty>
Nov 08 17:33:43 user nova-compute[74669]: node.session.auth.chap_algs = MD5
Nov 08 17:33:43 user nova-compute[74669]: node.session.timeo.replacement_timeout = 120
Nov 08 17:33:43 user nova-compute[74669]: node.session.err_timeo.abort_timeout = 15
Nov 08 17:33:43 user nova-compute[74669]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 17:33:43 user nova-compute[74669]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 17:33:43 user nova-compute[74669]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 17:33:43 user nova-compute[74669]: node.session.iscsi.FastAbort = Yes
Nov 08 17:33:43 user nova-compute[74669]: node.session.iscsi.InitialR2T = No
Nov 08 17:33:43 user nova-compute[74669]: node.session.iscsi.ImmediateData = Yes
Nov 08 17:33:43 user nova-compute[74669]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 17:33:43 user nova-compute[74669]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 17:33:43 user nova-compute[74669]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 17:33:43 user nova-compute[74669]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 17:33:43 user nova-compute[74669]: node.session.iscsi.MaxConnections = 1
Nov 08 17:33:43 user nova-compute[74669]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 17:33:43 user nova-compute[74669]: node.session.iscsi.ERL = 0
Nov 08 17:33:43 user nova-compute[74669]: node.session.scan = manual
Nov 08 17:33:43 user nova-compute[74669]: node.session.reopen_max = 0
Nov 08 17:33:43 user nova-compute[74669]: node.conn[0].address = 172.16.0.220
Nov 08 17:33:43 user nova-compute[74669]: node.conn[0].port = 3260
Nov 08 17:33:43 user nova-compute[74669]: node.conn[0].startup = manual
Nov 08 17:33:43 user nova-compute[74669]: node.conn[0].tcp.window_size = 524288
Nov 08 17:33:43 user nova-compute[74669]: node.conn[0].tcp.type_of_service = 0
Nov 08 17:33:43 user nova-compute[74669]: node.conn[0].timeo.logout_timeout = 15
Nov 08 17:33:43 user nova-compute[74669]: node.conn[0].timeo.login_timeout = 15
Nov 08 17:33:43 user nova-compute[74669]: node.conn[0].timeo.auth_timeout = 45
Nov 08 17:33:43 user nova-compute[74669]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 17:33:43 user nova-compute[74669]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 17:33:43 user nova-compute[74669]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 17:33:43 user nova-compute[74669]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 17:33:43 user nova-compute[74669]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 17:33:43 user nova-compute[74669]: node.conn[0].iscsi.DataDigest = None
Nov 08 17:33:43 user nova-compute[74669]: node.conn[0].iscsi.IFMarker = No
Nov 08 17:33:43 user nova-compute[74669]: node.conn[0].iscsi.OFMarker = No
Nov 08 17:33:43 user nova-compute[74669]: # END RECORD
Nov 08 17:33:43 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56e93a7-315c-46af-8a43-6646674a4975]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78ba1b3-fc34-4114-ab3b-0b5d8cabf9e7]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fkDuTyBU {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fkDuTyBU" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[495ee87e-57b1-4b2f-9579-f7e368184307]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fkDuTyBU'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d53dcf-ca06-4c40-98c4-2de22909d772]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1581f6-addc-42b5-90e1-51093f8cbe12]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:33:43 user nova-compute[74669]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)
Nov 08 17:33:43 user nova-compute[74669]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)
Nov 08 17:33:43 user nova-compute[74669]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 (non-flash)
Nov 08 17:33:43 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:33:43 user nova-compute[74669]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)
Nov 08 17:33:43 user nova-compute[74669]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)
Nov 08 17:33:43 user nova-compute[74669]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 (non-flash)
Nov 08 17:33:43 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.151s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] HCTL ('35', '0', '0', 0) found on session 48 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9f4ff0-fda3-4f8a-8db1-1c41c2783d8d]: (4, ('0 0 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Searching for a device in session 48 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkDuTyBU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.176s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] <== connect_volume: return (178ms) {'type': 'block', 'scsi_wwn': '23038343636336138', 'path': '/dev/sdd'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038343636336138', 'path': '/dev/sdd'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-593154799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-593154799',id=47,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:32:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08551815597744d89e3a61d190a9b8a7',ramdisk_id='',reservation_id='r-8yv89pes',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293450045',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:32:06Z,user_data=None,user_id='b1fcd1d4cf714f62aa8648b27a04c04e',uuid=6fd1fa42-b054-4c40-9260-7aef326f97ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3906eb94-933f-43ff-8be2-04f2c4205320", "address": "fa:16:3e:23:e3:66", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "vif_mac": "fa:16:3e:23:e3:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3906eb94-93", "ovs_interfaceid": "3906eb94-933f-43ff-8be2-04f2c4205320", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converting VIF {"id": "3906eb94-933f-43ff-8be2-04f2c4205320", "address": "fa:16:3e:23:e3:66", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "vif_mac": "fa:16:3e:23:e3:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3906eb94-93", "ovs_interfaceid": "3906eb94-933f-43ff-8be2-04f2c4205320", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:e3:66,bridge_name='br-int',has_traffic_filtering=True,id=3906eb94-933f-43ff-8be2-04f2c4205320,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3906eb94-93') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.objects.instance [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fd1fa42-b054-4c40-9260-7aef326f97ae {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.objects.base [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Object Instance<6fd1fa42-b054-4c40-9260-7aef326f97ae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:33:43 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:33:43 user nova-compute[74669]:   <uuid>6fd1fa42-b054-4c40-9260-7aef326f97ae</uuid>
Nov 08 17:33:43 user nova-compute[74669]:   <name>instance-0000002f</name>
Nov 08 17:33:43 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:33:43 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:33:43 user nova-compute[74669]:   <metadata>
Nov 08 17:33:43 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:33:43 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:33:43 user nova-compute[74669]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-593154799</nova:name>
Nov 08 17:33:43 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:33:43</nova:creationTime>
Nov 08 17:33:43 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:33:43 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:33:43 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:33:43 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:33:43 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:33:43 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:33:43 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:33:43 user nova-compute[74669]:       <nova:owner>
Nov 08 17:33:43 user nova-compute[74669]:         <nova:user uuid="b1fcd1d4cf714f62aa8648b27a04c04e">tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member</nova:user>
Nov 08 17:33:43 user nova-compute[74669]:         <nova:project uuid="08551815597744d89e3a61d190a9b8a7">tempest-ServerBootFromVolumeStableRescueTest-293450045</nova:project>
Nov 08 17:33:43 user nova-compute[74669]:       </nova:owner>
Nov 08 17:33:43 user nova-compute[74669]:       <nova:root type="image" uuid="ee6edaa4-6206-44ab-8497-fdbc2291f87f"/>
Nov 08 17:33:43 user nova-compute[74669]:       <nova:ports>
Nov 08 17:33:43 user nova-compute[74669]:         <nova:port uuid="3906eb94-933f-43ff-8be2-04f2c4205320">
Nov 08 17:33:43 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 17:33:43 user nova-compute[74669]:         </nova:port>
Nov 08 17:33:43 user nova-compute[74669]:       </nova:ports>
Nov 08 17:33:43 user nova-compute[74669]:     </nova:instance>
Nov 08 17:33:43 user nova-compute[74669]:   </metadata>
Nov 08 17:33:43 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:33:43 user nova-compute[74669]:     <system>
Nov 08 17:33:43 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:33:43 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:33:43 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:33:43 user nova-compute[74669]:       <entry name="serial">6fd1fa42-b054-4c40-9260-7aef326f97ae</entry>
Nov 08 17:33:43 user nova-compute[74669]:       <entry name="uuid">6fd1fa42-b054-4c40-9260-7aef326f97ae</entry>
Nov 08 17:33:43 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:33:43 user nova-compute[74669]:     </system>
Nov 08 17:33:43 user nova-compute[74669]:   </sysinfo>
Nov 08 17:33:43 user nova-compute[74669]:   <os>
Nov 08 17:33:43 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:33:43 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:33:43 user nova-compute[74669]:   </os>
Nov 08 17:33:43 user nova-compute[74669]:   <features>
Nov 08 17:33:43 user nova-compute[74669]:     <acpi/>
Nov 08 17:33:43 user nova-compute[74669]:     <apic/>
Nov 08 17:33:43 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:33:43 user nova-compute[74669]:   </features>
Nov 08 17:33:43 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:33:43 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:33:43 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:33:43 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:33:43 user nova-compute[74669]:   </clock>
Nov 08 17:33:43 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:33:43 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:33:43 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:33:43 user nova-compute[74669]:   </cpu>
Nov 08 17:33:43 user nova-compute[74669]:   <devices>
Nov 08 17:33:43 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 17:33:43 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:33:43 user nova-compute[74669]:       <source dev="/dev/sdd"/>
Nov 08 17:33:43 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:33:43 user nova-compute[74669]:       <serial>2d84cfa4-9889-4d49-92ea-53b45d2d3912</serial>
Nov 08 17:33:43 user nova-compute[74669]:     </disk>
Nov 08 17:33:43 user nova-compute[74669]:     <disk type="file" device="disk">
Nov 08 17:33:43 user nova-compute[74669]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 17:33:43 user nova-compute[74669]:       <source file="/opt/stack/data/nova/instances/6fd1fa42-b054-4c40-9260-7aef326f97ae/disk.rescue"/>
Nov 08 17:33:43 user nova-compute[74669]:       <target dev="vdb" bus="virtio"/>
Nov 08 17:33:43 user nova-compute[74669]:       <boot order="1"/>
Nov 08 17:33:43 user nova-compute[74669]:     </disk>
Nov 08 17:33:43 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:33:43 user nova-compute[74669]:       <mac address="fa:16:3e:23:e3:66"/>
Nov 08 17:33:43 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:33:43 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:33:43 user nova-compute[74669]:       <target dev="tap3906eb94-93"/>
Nov 08 17:33:43 user nova-compute[74669]:     </interface>
Nov 08 17:33:43 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:33:43 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/6fd1fa42-b054-4c40-9260-7aef326f97ae/console.log" append="off"/>
Nov 08 17:33:43 user nova-compute[74669]:     </serial>
Nov 08 17:33:43 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:33:43 user nova-compute[74669]:     <video>
Nov 08 17:33:43 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:33:43 user nova-compute[74669]:     </video>
Nov 08 17:33:43 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:33:43 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:33:43 user nova-compute[74669]:     </rng>
Nov 08 17:33:43 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:33:43 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:33:43 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:33:43 user nova-compute[74669]:     </memballoon>
Nov 08 17:33:43 user nova-compute[74669]:   </devices>
Nov 08 17:33:43 user nova-compute[74669]: </domain>
Nov 08 17:33:43 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:33:43 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Instance destroyed successfully.
Nov 08 17:33:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:33:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:33:44 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] No VIF found with MAC fa:16:3e:23:e3:66, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:33:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:45 user nova-compute[74669]: DEBUG nova.compute.manager [req-75f11621-efe2-45cd-92ac-663c9fa6572b req-421af4df-4ee7-41c8-9107-30a1e86e5ba8 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received event network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:33:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-75f11621-efe2-45cd-92ac-663c9fa6572b req-421af4df-4ee7-41c8-9107-30a1e86e5ba8 service nova] Acquiring lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:33:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-75f11621-efe2-45cd-92ac-663c9fa6572b req-421af4df-4ee7-41c8-9107-30a1e86e5ba8 service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:33:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-75f11621-efe2-45cd-92ac-663c9fa6572b req-421af4df-4ee7-41c8-9107-30a1e86e5ba8 service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:33:45 user nova-compute[74669]: DEBUG nova.compute.manager [req-75f11621-efe2-45cd-92ac-663c9fa6572b req-421af4df-4ee7-41c8-9107-30a1e86e5ba8 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] No waiting events found dispatching network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:33:45 user nova-compute[74669]: WARNING nova.compute.manager [req-75f11621-efe2-45cd-92ac-663c9fa6572b req-421af4df-4ee7-41c8-9107-30a1e86e5ba8 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received unexpected event network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 for instance with vm_state active and task_state rescuing.
Nov 08 17:33:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:47 user nova-compute[74669]: DEBUG nova.compute.manager [None req-db88660a-92c5-4788-9990-a8f130cefdb1 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:33:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-49c5f009-c0f5-44b3-bd7a-66c64b49f35b req-faa18482-788a-4ccb-bc30-5514b41befb0 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received event network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:33:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-49c5f009-c0f5-44b3-bd7a-66c64b49f35b req-faa18482-788a-4ccb-bc30-5514b41befb0 service nova] Acquiring lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:33:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-49c5f009-c0f5-44b3-bd7a-66c64b49f35b req-faa18482-788a-4ccb-bc30-5514b41befb0 service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:33:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-49c5f009-c0f5-44b3-bd7a-66c64b49f35b req-faa18482-788a-4ccb-bc30-5514b41befb0 service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:33:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-49c5f009-c0f5-44b3-bd7a-66c64b49f35b req-faa18482-788a-4ccb-bc30-5514b41befb0 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] No waiting events found dispatching network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:33:47 user nova-compute[74669]: WARNING nova.compute.manager [req-49c5f009-c0f5-44b3-bd7a-66c64b49f35b req-faa18482-788a-4ccb-bc30-5514b41befb0 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received unexpected event network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 for instance with vm_state active and task_state rescuing.
Nov 08 17:33:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:33:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:33:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:33:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:33:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:33:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:33:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:34:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:34:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:34:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:34:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:34:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:34:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:34:14 user nova-compute[74669]: DEBUG nova.compute.manager [req-f26c3788-6b0c-4bcc-8745-07c8bc825019 req-e2e500ae-8b92-4914-9573-5024708b7cf6 service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Received event network-changed-8ce2281d-5d42-4567-8483-a1c66d97db24 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:34:14 user nova-compute[74669]: DEBUG nova.compute.manager [req-f26c3788-6b0c-4bcc-8745-07c8bc825019 req-e2e500ae-8b92-4914-9573-5024708b7cf6 service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Refreshing instance network info cache due to event network-changed-8ce2281d-5d42-4567-8483-a1c66d97db24. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:34:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f26c3788-6b0c-4bcc-8745-07c8bc825019 req-e2e500ae-8b92-4914-9573-5024708b7cf6 service nova] Acquiring lock "refresh_cache-2a7fa806-b84f-4e7e-a6cd-14be375a8c9b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:34:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f26c3788-6b0c-4bcc-8745-07c8bc825019 req-e2e500ae-8b92-4914-9573-5024708b7cf6 service nova] Acquired lock "refresh_cache-2a7fa806-b84f-4e7e-a6cd-14be375a8c9b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:34:14 user nova-compute[74669]: DEBUG nova.network.neutron [req-f26c3788-6b0c-4bcc-8745-07c8bc825019 req-e2e500ae-8b92-4914-9573-5024708b7cf6 service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Refreshing network info cache for port 8ce2281d-5d42-4567-8483-a1c66d97db24 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG nova.network.neutron [req-f26c3788-6b0c-4bcc-8745-07c8bc825019 req-e2e500ae-8b92-4914-9573-5024708b7cf6 service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Updated VIF entry in instance network info cache for port 8ce2281d-5d42-4567-8483-a1c66d97db24. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG nova.network.neutron [req-f26c3788-6b0c-4bcc-8745-07c8bc825019 req-e2e500ae-8b92-4914-9573-5024708b7cf6 service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Updating instance_info_cache with network_info: [{"id": "8ce2281d-5d42-4567-8483-a1c66d97db24", "address": "fa:16:3e:99:dc:9b", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ce2281d-5d", "ovs_interfaceid": "8ce2281d-5d42-4567-8483-a1c66d97db24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f26c3788-6b0c-4bcc-8745-07c8bc825019 req-e2e500ae-8b92-4914-9573-5024708b7cf6 service nova] Releasing lock "refresh_cache-2a7fa806-b84f-4e7e-a6cd-14be375a8c9b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "2a7fa806-b84f-4e7e-a6cd-14be375a8c9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "2a7fa806-b84f-4e7e-a6cd-14be375a8c9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "2a7fa806-b84f-4e7e-a6cd-14be375a8c9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "2a7fa806-b84f-4e7e-a6cd-14be375a8c9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "2a7fa806-b84f-4e7e-a6cd-14be375a8c9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:34:15 user nova-compute[74669]: INFO nova.compute.manager [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Terminating instance
Nov 08 17:34:15 user nova-compute[74669]: DEBUG nova.compute.manager [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-4e31040b-f1dd-4d70-a0ad-3d7cae527fdc req-960951e5-7f1c-42df-86dd-fd6d3614fff7 service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Received event network-vif-unplugged-8ce2281d-5d42-4567-8483-a1c66d97db24 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4e31040b-f1dd-4d70-a0ad-3d7cae527fdc req-960951e5-7f1c-42df-86dd-fd6d3614fff7 service nova] Acquiring lock "2a7fa806-b84f-4e7e-a6cd-14be375a8c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4e31040b-f1dd-4d70-a0ad-3d7cae527fdc req-960951e5-7f1c-42df-86dd-fd6d3614fff7 service nova] Lock "2a7fa806-b84f-4e7e-a6cd-14be375a8c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-4e31040b-f1dd-4d70-a0ad-3d7cae527fdc req-960951e5-7f1c-42df-86dd-fd6d3614fff7 service nova] Lock "2a7fa806-b84f-4e7e-a6cd-14be375a8c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-4e31040b-f1dd-4d70-a0ad-3d7cae527fdc req-960951e5-7f1c-42df-86dd-fd6d3614fff7 service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] No waiting events found dispatching network-vif-unplugged-8ce2281d-5d42-4567-8483-a1c66d97db24 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-4e31040b-f1dd-4d70-a0ad-3d7cae527fdc req-960951e5-7f1c-42df-86dd-fd6d3614fff7 service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Received event network-vif-unplugged-8ce2281d-5d42-4567-8483-a1c66d97db24 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:34:15 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Instance destroyed successfully.
Nov 08 17:34:15 user nova-compute[74669]: DEBUG nova.objects.instance [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lazy-loading 'resources' on Instance uuid 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:32:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1161654116',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1161654116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1161654116',id=48,image_ref='156ae9cb-4678-4b54-a48d-502435f41e88',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3dWA+1BgJnt+M5COhI798uK8+Uf0Y9lvtprwi7VrgTACd5D64ZEUzAmMUOzbIQy5hjSP2TDAS8LZvGYvGwMFKhgmR9o7Ly0eih/hJaYIh+Wnos/etWWL+kxAXJ5aIPSw==',key_name='tempest-keypair-2003638166',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:32:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5be63fa80aa24b1e9c8d84e5f54c4270',ramdisk_id='',reservation_id='r-o4qql0z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-632748264',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-632748264-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-632748264',owner_user_name='tempest-TestVolumeBootPattern-632748264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:32:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0907ddd682244b7db3c2a10726fffb46',uuid=2a7fa806-b84f-4e7e-a6cd-14be375a8c9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ce2281d-5d42-4567-8483-a1c66d97db24", "address": "fa:16:3e:99:dc:9b", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ce2281d-5d", "ovs_interfaceid": "8ce2281d-5d42-4567-8483-a1c66d97db24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converting VIF {"id": "8ce2281d-5d42-4567-8483-a1c66d97db24", "address": "fa:16:3e:99:dc:9b", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ce2281d-5d", "ovs_interfaceid": "8ce2281d-5d42-4567-8483-a1c66d97db24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:dc:9b,bridge_name='br-int',has_traffic_filtering=True,id=8ce2281d-5d42-4567-8483-a1c66d97db24,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ce2281d-5d') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG os_vif [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:dc:9b,bridge_name='br-int',has_traffic_filtering=True,id=8ce2281d-5d42-4567-8483-a1c66d97db24,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ce2281d-5d') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ce2281d-5d, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1bfde97f-269a-4a29-b45f-c6a5eb18b049) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:34:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:34:16 user nova-compute[74669]: INFO os_vif [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:dc:9b,bridge_name='br-int',has_traffic_filtering=True,id=8ce2281d-5d42-4567-8483-a1c66d97db24,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ce2281d-5d')
Nov 08 17:34:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tansVEpk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:34:16 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:34:16 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7092544b-ac41-4b6c-918e-4d19c69c5ac5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:34:16 user nova-compute[74669]: No targets found.
Nov 08 17:34:16 user nova-compute[74669]: iSNS:
Nov 08 17:34:16 user nova-compute[74669]: No targets found.
Nov 08 17:34:16 user nova-compute[74669]: STATIC:
Nov 08 17:34:16 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d
Nov 08 17:34:16 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:34:16 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:34:16 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9
Nov 08 17:34:16 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:34:16 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:34:16 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912
Nov 08 17:34:16 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:34:16 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:34:16 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c
Nov 08 17:34:16 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:34:16 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:34:16 user nova-compute[74669]: FIRMWARE:
Nov 08 17:34:16 user nova-compute[74669]: No targets found.
Nov 08 17:34:16 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:34:16 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:34:16 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2149ac7-e73f-4c80-a6c8-8d9531c52a23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6643c8-8156-49de-ab4b-dece9d370b8c]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:34:16 user nova-compute[74669]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)
Nov 08 17:34:16 user nova-compute[74669]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)
Nov 08 17:34:16 user nova-compute[74669]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 (non-flash)
Nov 08 17:34:16 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:34:16 user nova-compute[74669]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)
Nov 08 17:34:16 user nova-compute[74669]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)
Nov 08 17:34:16 user nova-compute[74669]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 (non-flash)
Nov 08 17:34:16 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd98450ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9'): ({'sde'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Removing single pathed devices sde {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[488b8611-02f6-4166-a7ec-10e1b5557349]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8b6944-8ec8-424b-97ea-e4cf376e2e60]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Flushing IO for device /dev/sde {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07adf52-11e2-40e4-a62e-5b3bf6770d2b]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a16e648-f9f7-4b2f-879d-112266375d2a]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] SCSI volumes sde have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f2ddb9-c816-42ab-bc91-8d5f9cfadaa1]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3b9b53-da7e-484b-9c2b-9810af4c7159]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9, portal: 172.16.0.220,3260]
Nov 08 17:34:16 user nova-compute[74669]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9, portal: 172.16.0.220,3260] successful.
Nov 08 17:34:16 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07217c55-6253-4b52-818f-28d7ceda77a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7778d9-06b2-412b-9c34-e1eb2e91de1e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] <== disconnect_volume: return (319ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:34:16 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Deleting instance files /opt/stack/data/nova/instances/2a7fa806-b84f-4e7e-a6cd-14be375a8c9b_del
Nov 08 17:34:16 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Deletion of /opt/stack/data/nova/instances/2a7fa806-b84f-4e7e-a6cd-14be375a8c9b_del complete
Nov 08 17:34:16 user nova-compute[74669]: INFO nova.compute.manager [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 08 17:34:16 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:34:16 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:34:17 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:34:17 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Took 0.64 seconds to deallocate network for instance.
Nov 08 17:34:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-dcc27649-78f5-4f5d-9b4e-b0f356bded57 req-06f6d63a-f887-4bd7-8fc7-f95170efba6d service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Received event network-vif-deleted-8ce2281d-5d42-4567-8483-a1c66d97db24 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:34:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-72b2a080-7f46-466f-96d8-63fecbd6b172 req-99727fa4-25ab-42ea-b3f7-454d49fadf2d service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Received event network-vif-plugged-8ce2281d-5d42-4567-8483-a1c66d97db24 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:34:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-72b2a080-7f46-466f-96d8-63fecbd6b172 req-99727fa4-25ab-42ea-b3f7-454d49fadf2d service nova] Acquiring lock "2a7fa806-b84f-4e7e-a6cd-14be375a8c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:34:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-72b2a080-7f46-466f-96d8-63fecbd6b172 req-99727fa4-25ab-42ea-b3f7-454d49fadf2d service nova] Lock "2a7fa806-b84f-4e7e-a6cd-14be375a8c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:34:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-72b2a080-7f46-466f-96d8-63fecbd6b172 req-99727fa4-25ab-42ea-b3f7-454d49fadf2d service nova] Lock "2a7fa806-b84f-4e7e-a6cd-14be375a8c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:34:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-72b2a080-7f46-466f-96d8-63fecbd6b172 req-99727fa4-25ab-42ea-b3f7-454d49fadf2d service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] No waiting events found dispatching network-vif-plugged-8ce2281d-5d42-4567-8483-a1c66d97db24 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:34:17 user nova-compute[74669]: WARNING nova.compute.manager [req-72b2a080-7f46-466f-96d8-63fecbd6b172 req-99727fa4-25ab-42ea-b3f7-454d49fadf2d service nova] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Received unexpected event network-vif-plugged-8ce2281d-5d42-4567-8483-a1c66d97db24 for instance with vm_state active and task_state deleting.
Nov 08 17:34:17 user nova-compute[74669]: INFO nova.compute.manager [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Took 0.89 seconds to detach 1 volumes for instance.
Nov 08 17:34:17 user nova-compute[74669]: DEBUG nova.compute.manager [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b] Deleting volume: 07217c55-6253-4b52-818f-28d7ceda77a9 {{(pid=74669) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 17:34:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:34:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:34:18 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:34:18 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:34:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:34:18 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Deleted allocations for instance 2a7fa806-b84f-4e7e-a6cd-14be375a8c9b
Nov 08 17:34:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-25f813df-badb-4155-add1-fd1cd6730654 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "2a7fa806-b84f-4e7e-a6cd-14be375a8c9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.092s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:34:18 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:34:18 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:34:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:34:19 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:34:20 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:34:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:34:22 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:34:22 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:34:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-49657a40-5c34-43d3-9bb5-b78dab52d2ff" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:34:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-49657a40-5c34-43d3-9bb5-b78dab52d2ff" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:34:22 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:34:23 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Updating instance_info_cache with network_info: [{"id": "f021aef7-a8e3-4f01-8825-378de286cdbb", "address": "fa:16:3e:37:64:f1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf021aef7-a8", "ovs_interfaceid": "f021aef7-a8e3-4f01-8825-378de286cdbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:34:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-49657a40-5c34-43d3-9bb5-b78dab52d2ff" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:34:23 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:34:23 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:34:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:34:24 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:34:24 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:34:25 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:34:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:34:26 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:34:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:34:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:34:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:34:26 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:34:26 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:34:26 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:34:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:34:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:34:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:34:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:34:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:34:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:34:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:34:27 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:34:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd1fa42-b054-4c40-9260-7aef326f97ae/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:34:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd1fa42-b054-4c40-9260-7aef326f97ae/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:34:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd1fa42-b054-4c40-9260-7aef326f97ae/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:34:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd1fa42-b054-4c40-9260-7aef326f97ae/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:34:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:34:28 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:34:28 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:34:28 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8572MB free_disk=24.952106475830078GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:34:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:34:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:34:28 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0796133c-71d6-4d64-94af-49028a6603ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:34:28 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance fa8c4d88-8b6c-4ef6-9876-62597ace9c37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:34:28 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 49657a40-5c34-43d3-9bb5-b78dab52d2ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:34:28 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance c96ab1f6-7aaa-4f48-9371-61dcad72f35a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:34:28 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 6fd1fa42-b054-4c40-9260-7aef326f97ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:34:28 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:34:28 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:34:28 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:34:28 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:34:28 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:34:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:34:31 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:34:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:34:41 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:34:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:34:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:34:56 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:01 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:06 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:11 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "c96ab1f6-7aaa-4f48-9371-61dcad72f35a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:35:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "c96ab1f6-7aaa-4f48-9371-61dcad72f35a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:35:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "c96ab1f6-7aaa-4f48-9371-61dcad72f35a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:35:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "c96ab1f6-7aaa-4f48-9371-61dcad72f35a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:35:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "c96ab1f6-7aaa-4f48-9371-61dcad72f35a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:35:17 user nova-compute[74669]: INFO nova.compute.manager [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Terminating instance
Nov 08 17:35:17 user nova-compute[74669]: DEBUG nova.compute.manager [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:35:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-082f03a3-e0dc-40f7-af86-f57ffb8589d6 req-9f11104d-9545-4769-82ab-046bc32c2e81 service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Received event network-vif-unplugged-8ee1430a-0a17-4c5d-b284-cd09f88f2b05 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:35:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-082f03a3-e0dc-40f7-af86-f57ffb8589d6 req-9f11104d-9545-4769-82ab-046bc32c2e81 service nova] Acquiring lock "c96ab1f6-7aaa-4f48-9371-61dcad72f35a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:35:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-082f03a3-e0dc-40f7-af86-f57ffb8589d6 req-9f11104d-9545-4769-82ab-046bc32c2e81 service nova] Lock "c96ab1f6-7aaa-4f48-9371-61dcad72f35a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:35:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-082f03a3-e0dc-40f7-af86-f57ffb8589d6 req-9f11104d-9545-4769-82ab-046bc32c2e81 service nova] Lock "c96ab1f6-7aaa-4f48-9371-61dcad72f35a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:35:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-082f03a3-e0dc-40f7-af86-f57ffb8589d6 req-9f11104d-9545-4769-82ab-046bc32c2e81 service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] No waiting events found dispatching network-vif-unplugged-8ee1430a-0a17-4c5d-b284-cd09f88f2b05 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:35:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-082f03a3-e0dc-40f7-af86-f57ffb8589d6 req-9f11104d-9545-4769-82ab-046bc32c2e81 service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Received event network-vif-unplugged-8ee1430a-0a17-4c5d-b284-cd09f88f2b05 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:18 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Instance destroyed successfully.
Nov 08 17:35:18 user nova-compute[74669]: DEBUG nova.objects.instance [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lazy-loading 'resources' on Instance uuid c96ab1f6-7aaa-4f48-9371-61dcad72f35a {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:30:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-709532451',display_name='tempest-TestVolumeBootPattern-volume-backed-server-709532451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-709532451',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBP8DpXfCSnM4VCnefc5PDiD0xhBhJgEPwATc4bY0Y8nJLbHH53+yX1eeHCpEBMvY+uBbXf82gq1mid190ej4oQJ8O24dnIzVeulb4/z+gT1tZdI75IkF5nGptKMsoG6JQ==',key_name='tempest-keypair-1409039907',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:30:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5be63fa80aa24b1e9c8d84e5f54c4270',ramdisk_id='',reservation_id='r-e3p24w8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-632748264',owner_user_name='tempest-TestVolumeBootPattern-632748264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:30:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0907ddd682244b7db3c2a10726fffb46',uuid=c96ab1f6-7aaa-4f48-9371-61dcad72f35a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ee1430a-0a17-4c5d-b284-cd09f88f2b05", "address": "fa:16:3e:9b:31:48", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee1430a-0a", "ovs_interfaceid": "8ee1430a-0a17-4c5d-b284-cd09f88f2b05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converting VIF {"id": "8ee1430a-0a17-4c5d-b284-cd09f88f2b05", "address": "fa:16:3e:9b:31:48", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee1430a-0a", "ovs_interfaceid": "8ee1430a-0a17-4c5d-b284-cd09f88f2b05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:31:48,bridge_name='br-int',has_traffic_filtering=True,id=8ee1430a-0a17-4c5d-b284-cd09f88f2b05,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee1430a-0a') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG os_vif [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:31:48,bridge_name='br-int',has_traffic_filtering=True,id=8ee1430a-0a17-4c5d-b284-cd09f88f2b05,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee1430a-0a') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ee1430a-0a, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55318b33-56a4-4088-a643-95ddd0145a14) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:35:18 user nova-compute[74669]: INFO os_vif [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:31:48,bridge_name='br-int',has_traffic_filtering=True,id=8ee1430a-0a17-4c5d-b284-cd09f88f2b05,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee1430a-0a')
Nov 08 17:35:18 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LHetvquV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:35:18 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:35:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[89260645-1c47-478e-9e04-cee2abaa78e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:35:18 user nova-compute[74669]: No targets found.
Nov 08 17:35:18 user nova-compute[74669]: iSNS:
Nov 08 17:35:18 user nova-compute[74669]: No targets found.
Nov 08 17:35:18 user nova-compute[74669]: STATIC:
Nov 08 17:35:18 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d
Nov 08 17:35:18 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:35:18 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:35:18 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912
Nov 08 17:35:18 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:35:18 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:35:18 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c
Nov 08 17:35:18 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:35:18 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:35:18 user nova-compute[74669]: FIRMWARE:
Nov 08 17:35:18 user nova-compute[74669]: No targets found.
Nov 08 17:35:18 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:35:18 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:35:18 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1b286f-68ea-4bea-b6b1-a035af02ad78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f64869b-ba23-4019-bd92-3c0a7afde95d]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:35:18 user nova-compute[74669]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)
Nov 08 17:35:18 user nova-compute[74669]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)
Nov 08 17:35:18 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:35:18 user nova-compute[74669]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d (non-flash)
Nov 08 17:35:18 user nova-compute[74669]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)
Nov 08 17:35:18 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd984533370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d'): ({'sdc'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Removing single pathed devices sdc {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d1aadd-fffb-4d9c-bfd0-761cfff5b583]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5d43a2-55a3-40f9-a094-21848c69e18c]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Flushing IO for device /dev/sdc {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ef14ec-5d4a-4ae5-aab8-ca704d222baf]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[212aeb2a-1557-4b41-980b-80c22611ed31]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23864646536366531', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_fbb9356e', '/dev/disk/by-id/scsi-1SCST_BIOfbb9356e-8dde66e11edc045f') {{(pid=86107) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a3377c-3311-4309-b485-62af20ebbde6]: (4, None) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e412b4-ae9d-4125-8ea9-1c9ffa89e488]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71271fe-f9d9-4610-b0f8-94696d1d24f8]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d, portal: 172.16.0.220,3260]
Nov 08 17:35:18 user nova-compute[74669]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d, portal: 172.16.0.220,3260] successful.
Nov 08 17:35:18 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:201cd928-bb9e-4ecb-9328-8e487f21d01d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d8bfc7-6b6c-43dd-a32f-dc0c84d736d5]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] <== disconnect_volume: return (319ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:35:18 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Deleting instance files /opt/stack/data/nova/instances/c96ab1f6-7aaa-4f48-9371-61dcad72f35a_del
Nov 08 17:35:18 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Deletion of /opt/stack/data/nova/instances/c96ab1f6-7aaa-4f48-9371-61dcad72f35a_del complete
Nov 08 17:35:18 user nova-compute[74669]: INFO nova.compute.manager [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 08 17:35:18 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:35:18 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:35:19 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:35:19 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Took 1.09 seconds to deallocate network for instance.
Nov 08 17:35:20 user nova-compute[74669]: DEBUG nova.compute.manager [req-5aaa9374-4f5e-4c10-b5f0-16f5c37517fb req-db25fca6-0111-4285-b88d-39c5ebfec3e9 service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Received event network-vif-plugged-8ee1430a-0a17-4c5d-b284-cd09f88f2b05 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:35:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5aaa9374-4f5e-4c10-b5f0-16f5c37517fb req-db25fca6-0111-4285-b88d-39c5ebfec3e9 service nova] Acquiring lock "c96ab1f6-7aaa-4f48-9371-61dcad72f35a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:35:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5aaa9374-4f5e-4c10-b5f0-16f5c37517fb req-db25fca6-0111-4285-b88d-39c5ebfec3e9 service nova] Lock "c96ab1f6-7aaa-4f48-9371-61dcad72f35a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:35:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5aaa9374-4f5e-4c10-b5f0-16f5c37517fb req-db25fca6-0111-4285-b88d-39c5ebfec3e9 service nova] Lock "c96ab1f6-7aaa-4f48-9371-61dcad72f35a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:35:20 user nova-compute[74669]: DEBUG nova.compute.manager [req-5aaa9374-4f5e-4c10-b5f0-16f5c37517fb req-db25fca6-0111-4285-b88d-39c5ebfec3e9 service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] No waiting events found dispatching network-vif-plugged-8ee1430a-0a17-4c5d-b284-cd09f88f2b05 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:35:20 user nova-compute[74669]: WARNING nova.compute.manager [req-5aaa9374-4f5e-4c10-b5f0-16f5c37517fb req-db25fca6-0111-4285-b88d-39c5ebfec3e9 service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Received unexpected event network-vif-plugged-8ee1430a-0a17-4c5d-b284-cd09f88f2b05 for instance with vm_state active and task_state deleting.
Nov 08 17:35:20 user nova-compute[74669]: DEBUG nova.compute.manager [req-5aaa9374-4f5e-4c10-b5f0-16f5c37517fb req-db25fca6-0111-4285-b88d-39c5ebfec3e9 service nova] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Received event network-vif-deleted-8ee1430a-0a17-4c5d-b284-cd09f88f2b05 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:35:20 user nova-compute[74669]: INFO nova.compute.manager [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Took 0.89 seconds to detach 1 volumes for instance.
Nov 08 17:35:20 user nova-compute[74669]: DEBUG nova.compute.manager [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: c96ab1f6-7aaa-4f48-9371-61dcad72f35a] Deleting volume: 201cd928-bb9e-4ecb-9328-8e487f21d01d {{(pid=74669) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 17:35:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:35:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:35:21 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:35:21 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:35:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:35:21 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Deleted allocations for instance c96ab1f6-7aaa-4f48-9371-61dcad72f35a
Nov 08 17:35:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-beed4c5d-de41-48e8-b7ba-1624b99f5731 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "c96ab1f6-7aaa-4f48-9371-61dcad72f35a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.830s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:35:21 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:35:21 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:35:21 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:35:21 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:35:22 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:35:22 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:35:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-6fd1fa42-b054-4c40-9260-7aef326f97ae" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:35:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-6fd1fa42-b054-4c40-9260-7aef326f97ae" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:35:22 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:35:23 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Updating instance_info_cache with network_info: [{"id": "3906eb94-933f-43ff-8be2-04f2c4205320", "address": "fa:16:3e:23:e3:66", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3906eb94-93", "ovs_interfaceid": "3906eb94-933f-43ff-8be2-04f2c4205320", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:35:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-6fd1fa42-b054-4c40-9260-7aef326f97ae" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:35:23 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:35:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:25 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:35:25 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:35:25 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:35:27 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:35:27 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:35:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:35:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:35:27 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:35:27 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:35:27 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:35:27 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:35:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:35:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:35:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:35:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:35:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:35:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:35:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:35:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:35:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:35:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd1fa42-b054-4c40-9260-7aef326f97ae/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:35:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd1fa42-b054-4c40-9260-7aef326f97ae/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:35:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd1fa42-b054-4c40-9260-7aef326f97ae/disk.rescue --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:35:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fd1fa42-b054-4c40-9260-7aef326f97ae/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:35:29 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:35:29 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:35:29 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8720MB free_disk=24.950908660888672GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:35:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:35:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:35:29 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0796133c-71d6-4d64-94af-49028a6603ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:35:29 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance fa8c4d88-8b6c-4ef6-9876-62597ace9c37 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:35:29 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 49657a40-5c34-43d3-9bb5-b78dab52d2ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:35:29 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 6fd1fa42-b054-4c40-9260-7aef326f97ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:35:29 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:35:29 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:35:29 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:35:29 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:35:29 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:35:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.309s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:35:30 user nova-compute[74669]: INFO nova.compute.manager [None req-1e1ad1f3-489a-4f89-a8a8-633fb1642839 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Unrescuing
Nov 08 17:35:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1e1ad1f3-489a-4f89-a8a8-633fb1642839 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "refresh_cache-6fd1fa42-b054-4c40-9260-7aef326f97ae" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:35:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1e1ad1f3-489a-4f89-a8a8-633fb1642839 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquired lock "refresh_cache-6fd1fa42-b054-4c40-9260-7aef326f97ae" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:35:30 user nova-compute[74669]: DEBUG nova.network.neutron [None req-1e1ad1f3-489a-4f89-a8a8-633fb1642839 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:35:31 user nova-compute[74669]: DEBUG nova.network.neutron [None req-1e1ad1f3-489a-4f89-a8a8-633fb1642839 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Updating instance_info_cache with network_info: [{"id": "3906eb94-933f-43ff-8be2-04f2c4205320", "address": "fa:16:3e:23:e3:66", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3906eb94-93", "ovs_interfaceid": "3906eb94-933f-43ff-8be2-04f2c4205320", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:35:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1e1ad1f3-489a-4f89-a8a8-633fb1642839 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Releasing lock "refresh_cache-6fd1fa42-b054-4c40-9260-7aef326f97ae" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:35:31 user nova-compute[74669]: DEBUG nova.objects.instance [None req-1e1ad1f3-489a-4f89-a8a8-633fb1642839 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lazy-loading 'flavor' on Instance uuid 6fd1fa42-b054-4c40-9260-7aef326f97ae {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:35:31 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:31 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:31 user nova-compute[74669]: DEBUG nova.compute.manager [req-c8dad0a3-63dd-4be7-bd95-d39319b56314 req-a0ba39e9-c4e1-42cf-912e-e99b583fdd9f service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received event network-vif-unplugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:35:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c8dad0a3-63dd-4be7-bd95-d39319b56314 req-a0ba39e9-c4e1-42cf-912e-e99b583fdd9f service nova] Acquiring lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:35:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c8dad0a3-63dd-4be7-bd95-d39319b56314 req-a0ba39e9-c4e1-42cf-912e-e99b583fdd9f service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:35:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c8dad0a3-63dd-4be7-bd95-d39319b56314 req-a0ba39e9-c4e1-42cf-912e-e99b583fdd9f service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:35:31 user nova-compute[74669]: DEBUG nova.compute.manager [req-c8dad0a3-63dd-4be7-bd95-d39319b56314 req-a0ba39e9-c4e1-42cf-912e-e99b583fdd9f service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] No waiting events found dispatching network-vif-unplugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:35:31 user nova-compute[74669]: WARNING nova.compute.manager [req-c8dad0a3-63dd-4be7-bd95-d39319b56314 req-a0ba39e9-c4e1-42cf-912e-e99b583fdd9f service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received unexpected event network-vif-unplugged-3906eb94-933f-43ff-8be2-04f2c4205320 for instance with vm_state rescued and task_state unrescuing.
Nov 08 17:35:31 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:31 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:32 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Instance destroyed successfully.
Nov 08 17:35:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:33 user nova-compute[74669]: DEBUG nova.compute.manager [req-34221f5c-2eae-4e71-8611-66dc7da73eda req-64972aeb-3876-49cc-a004-969a3e13fa73 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received event network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:35:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-34221f5c-2eae-4e71-8611-66dc7da73eda req-64972aeb-3876-49cc-a004-969a3e13fa73 service nova] Acquiring lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:35:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-34221f5c-2eae-4e71-8611-66dc7da73eda req-64972aeb-3876-49cc-a004-969a3e13fa73 service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:35:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-34221f5c-2eae-4e71-8611-66dc7da73eda req-64972aeb-3876-49cc-a004-969a3e13fa73 service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:35:33 user nova-compute[74669]: DEBUG nova.compute.manager [req-34221f5c-2eae-4e71-8611-66dc7da73eda req-64972aeb-3876-49cc-a004-969a3e13fa73 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] No waiting events found dispatching network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:35:33 user nova-compute[74669]: WARNING nova.compute.manager [req-34221f5c-2eae-4e71-8611-66dc7da73eda req-64972aeb-3876-49cc-a004-969a3e13fa73 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received unexpected event network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 for instance with vm_state rescued and task_state unrescuing.
Nov 08 17:35:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:35 user nova-compute[74669]: DEBUG nova.compute.manager [None req-1e1ad1f3-489a-4f89-a8a8-633fb1642839 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:35:35 user nova-compute[74669]: DEBUG nova.compute.manager [req-10f24bc1-1ee0-4d61-9201-dd3ad4adbb91 req-7b45212e-333d-4b40-b41b-157c7eb6d55a service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received event network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:35:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-10f24bc1-1ee0-4d61-9201-dd3ad4adbb91 req-7b45212e-333d-4b40-b41b-157c7eb6d55a service nova] Acquiring lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:35:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-10f24bc1-1ee0-4d61-9201-dd3ad4adbb91 req-7b45212e-333d-4b40-b41b-157c7eb6d55a service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:35:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-10f24bc1-1ee0-4d61-9201-dd3ad4adbb91 req-7b45212e-333d-4b40-b41b-157c7eb6d55a service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:35:35 user nova-compute[74669]: DEBUG nova.compute.manager [req-10f24bc1-1ee0-4d61-9201-dd3ad4adbb91 req-7b45212e-333d-4b40-b41b-157c7eb6d55a service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] No waiting events found dispatching network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:35:35 user nova-compute[74669]: WARNING nova.compute.manager [req-10f24bc1-1ee0-4d61-9201-dd3ad4adbb91 req-7b45212e-333d-4b40-b41b-157c7eb6d55a service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received unexpected event network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 for instance with vm_state rescued and task_state unrescuing.
Nov 08 17:35:35 user nova-compute[74669]: DEBUG nova.compute.manager [req-10f24bc1-1ee0-4d61-9201-dd3ad4adbb91 req-7b45212e-333d-4b40-b41b-157c7eb6d55a service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received event network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:35:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-10f24bc1-1ee0-4d61-9201-dd3ad4adbb91 req-7b45212e-333d-4b40-b41b-157c7eb6d55a service nova] Acquiring lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:35:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-10f24bc1-1ee0-4d61-9201-dd3ad4adbb91 req-7b45212e-333d-4b40-b41b-157c7eb6d55a service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:35:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-10f24bc1-1ee0-4d61-9201-dd3ad4adbb91 req-7b45212e-333d-4b40-b41b-157c7eb6d55a service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:35:35 user nova-compute[74669]: DEBUG nova.compute.manager [req-10f24bc1-1ee0-4d61-9201-dd3ad4adbb91 req-7b45212e-333d-4b40-b41b-157c7eb6d55a service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] No waiting events found dispatching network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:35:35 user nova-compute[74669]: WARNING nova.compute.manager [req-10f24bc1-1ee0-4d61-9201-dd3ad4adbb91 req-7b45212e-333d-4b40-b41b-157c7eb6d55a service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received unexpected event network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 for instance with vm_state rescued and task_state unrescuing.
Nov 08 17:35:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:45 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:35:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:35:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:19 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:36:21 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:36:21 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:36:21 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:36:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:36:23 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:36:23 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:36:23 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 17:36:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:36:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:36:23 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:36:23 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lazy-loading 'info_cache' on Instance uuid 0796133c-71d6-4d64-94af-49028a6603ea {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:36:24 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Updating instance_info_cache with network_info: [{"id": "1fa691c0-3473-4f34-a504-3778913558ab", "address": "fa:16:3e:2f:15:d7", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa691c0-34", "ovs_interfaceid": "1fa691c0-3473-4f34-a504-3778913558ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:36:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:36:24 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:36:26 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:36:26 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:36:26 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:36:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:28 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:36:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:36:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:36:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:36:28 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:36:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:36:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:36:28 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:36:28 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:36:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:36:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:36:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:36:28 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:36:28 user nova-compute[74669]: INFO nova.compute.claims [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Claim successful on node user
Nov 08 17:36:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:36:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:36:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:36:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:36:29 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:36:29 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:36:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:36:29 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:36:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:36:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:36:29 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:36:29 user nova-compute[74669]: DEBUG nova.network.neutron [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:36:29 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:36:29 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:36:29 user nova-compute[74669]: DEBUG nova.policy [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0907ddd682244b7db3c2a10726fffb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be63fa80aa24b1e9c8d84e5f54c4270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:36:29 user nova-compute[74669]: INFO nova.virt.block_device [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Booting with volume a9c0622e-d0da-44e7-bc53-718ad2c1c89b at /dev/vda
Nov 08 17:36:29 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:36:29 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG os_brick.utils [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:36:30 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:36:30 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:36:30 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8693MB free_disk=24.95034408569336GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b815c29-fd94-46e1-92ac-c54177facc7e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a51513-9119-4229-ab78-7271c25b228f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d6eda3-da10-4d93-ad91-d568b98bf832]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b96b1f-41e1-447d-b639-a197b7f5daa4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:36:30 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:36:30 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de369e4-a26b-4880-a295-70d9a7594e3c]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG os_brick.utils [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Updating existing volume attachment record: b98d5d50-e53d-49be-b0fc-26ebb4430cec {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0796133c-71d6-4d64-94af-49028a6603ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance fa8c4d88-8b6c-4ef6-9876-62597ace9c37 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 49657a40-5c34-43d3-9bb5-b78dab52d2ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 6fd1fa42-b054-4c40-9260-7aef326f97ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 71a6b6c3-2401-42ba-8f5a-01801168bcd1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:36:30 user nova-compute[74669]: DEBUG nova.network.neutron [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Successfully created port: dca40928-5ece-4c03-aea0-5024617262d4 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:36:31 user nova-compute[74669]: DEBUG nova.network.neutron [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Successfully updated port: dca40928-5ece-4c03-aea0-5024617262d4 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:36:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "refresh_cache-71a6b6c3-2401-42ba-8f5a-01801168bcd1" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:36:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquired lock "refresh_cache-71a6b6c3-2401-42ba-8f5a-01801168bcd1" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:36:31 user nova-compute[74669]: DEBUG nova.network.neutron [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:36:31 user nova-compute[74669]: DEBUG nova.compute.manager [req-f883344d-73c5-475a-8833-f3c1a21b2095 req-5cc8f6af-f533-4ac2-97de-f61bc43381d2 service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Received event network-changed-dca40928-5ece-4c03-aea0-5024617262d4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:36:31 user nova-compute[74669]: DEBUG nova.compute.manager [req-f883344d-73c5-475a-8833-f3c1a21b2095 req-5cc8f6af-f533-4ac2-97de-f61bc43381d2 service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Refreshing instance network info cache due to event network-changed-dca40928-5ece-4c03-aea0-5024617262d4. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:36:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f883344d-73c5-475a-8833-f3c1a21b2095 req-5cc8f6af-f533-4ac2-97de-f61bc43381d2 service nova] Acquiring lock "refresh_cache-71a6b6c3-2401-42ba-8f5a-01801168bcd1" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:36:31 user nova-compute[74669]: DEBUG nova.network.neutron [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:36:31 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:36:31 user nova-compute[74669]: DEBUG nova.network.neutron [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Updating instance_info_cache with network_info: [{"id": "dca40928-5ece-4c03-aea0-5024617262d4", "address": "fa:16:3e:a3:8b:a4", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdca40928-5e", "ovs_interfaceid": "dca40928-5ece-4c03-aea0-5024617262d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:36:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Releasing lock "refresh_cache-71a6b6c3-2401-42ba-8f5a-01801168bcd1" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:36:31 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Instance network_info: |[{"id": "dca40928-5ece-4c03-aea0-5024617262d4", "address": "fa:16:3e:a3:8b:a4", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdca40928-5e", "ovs_interfaceid": "dca40928-5ece-4c03-aea0-5024617262d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:36:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f883344d-73c5-475a-8833-f3c1a21b2095 req-5cc8f6af-f533-4ac2-97de-f61bc43381d2 service nova] Acquired lock "refresh_cache-71a6b6c3-2401-42ba-8f5a-01801168bcd1" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:36:31 user nova-compute[74669]: DEBUG nova.network.neutron [req-f883344d-73c5-475a-8833-f3c1a21b2095 req-5cc8f6af-f533-4ac2-97de-f61bc43381d2 service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Refreshing network info cache for port dca40928-5ece-4c03-aea0-5024617262d4 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:36:31 user nova-compute[74669]: DEBUG nova.network.neutron [req-f883344d-73c5-475a-8833-f3c1a21b2095 req-5cc8f6af-f533-4ac2-97de-f61bc43381d2 service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Updated VIF entry in instance network info cache for port dca40928-5ece-4c03-aea0-5024617262d4. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:36:31 user nova-compute[74669]: DEBUG nova.network.neutron [req-f883344d-73c5-475a-8833-f3c1a21b2095 req-5cc8f6af-f533-4ac2-97de-f61bc43381d2 service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Updating instance_info_cache with network_info: [{"id": "dca40928-5ece-4c03-aea0-5024617262d4", "address": "fa:16:3e:a3:8b:a4", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdca40928-5e", "ovs_interfaceid": "dca40928-5ece-4c03-aea0-5024617262d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:36:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f883344d-73c5-475a-8833-f3c1a21b2095 req-5cc8f6af-f533-4ac2-97de-f61bc43381d2 service nova] Releasing lock "refresh_cache-71a6b6c3-2401-42ba-8f5a-01801168bcd1" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:36:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:36:51 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Creating image(s)
Nov 08 17:36:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Did not create local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Ensure instance console log exists: /opt/stack/data/nova/instances/71a6b6c3-2401-42ba-8f5a-01801168bcd1/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Start _get_guest_xml network_info=[{"id": "dca40928-5ece-4c03-aea0-5024617262d4", "address": "fa:16:3e:a3:8b:a4", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdca40928-5e", "ovs_interfaceid": "dca40928-5ece-4c03-aea0-5024617262d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'b98d5d50-e53d-49be-b0fc-26ebb4430cec', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imFMhLHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '71a6b6c3-2401-42ba-8f5a-01801168bcd1', 'attached_at': '', 'detached_at': '', 'volume_id': 'a9c0622e-d0da-44e7-bc53-718ad2c1c89b', 'serial': 'a9c0622e-d0da-44e7-bc53-718ad2c1c89b'}, 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:36:51 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:36:51 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:36:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imFMhLHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:36:51 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:36:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:36:51 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:36:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:36:51 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:36:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfaf1b61-fb51-49f6-a27b-7d8f342f8a4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:36:51 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02513e6-551d-4a7c-ba60-5ad5fb6d6391]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b] added
Nov 08 17:36:51 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:36:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf17e4e2-eb55-4d12-a664-6673f30270b8]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ebe5a9-47a2-473e-af84-1dcd668465e6]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v imFMhLHo {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v imFMhLHo" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b870f534-4076-4d0c-9205-0643e7b416ad]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'imFMhLHo'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ef7aeb-8ceb-4fdc-90c1-35fc23f43d39]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2c8c0c-42c6-4736-bcaf-a57e55e783fc]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:36:52 user nova-compute[74669]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)
Nov 08 17:36:52 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:36:52 user nova-compute[74669]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)
Nov 08 17:36:52 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a613ed-7d33-4896-9322-74f53c07fceb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b, portal: 172.16.0.220,3260]
Nov 08 17:36:52 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b, portal: 172.16.0.220,3260] successful.
Nov 08 17:36:52 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0189d388-7a2b-403c-9dfa-d64cddf27330]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e225d5-9681-4ea3-b7e2-2b8c784958e0]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:36:52 user nova-compute[74669]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)
Nov 08 17:36:52 user nova-compute[74669]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)
Nov 08 17:36:52 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:36:52 user nova-compute[74669]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)
Nov 08 17:36:52 user nova-compute[74669]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)
Nov 08 17:36:52 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f4969e-b2e9-4388-a72e-9f16b4515f89]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:36:52 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: None {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imFMhLHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26161393236633631', 'path': '/dev/sdc'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161393236633631', 'path': '/dev/sdc'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1312345949',display_name='tempest-TestVolumeBootPattern-server-1312345949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1312345949',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGSH1tfl+t1f+AoN2/TlyQFqcpvH4dUnBb0qtUp3kmmhEHY7AifIfQPVEX1+0Iv7aAMwriH1/vMPkr9izF41xY+X6NTHXQUsxzNFOO/wJqkiikY/LpDilWqnGkVHaws3Q==',key_name='tempest-TestVolumeBootPattern-1527417449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5be63fa80aa24b1e9c8d84e5f54c4270',ramdisk_id='',reservation_id='r-w5ja0958',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-632748264',owner_user_name='tempest-TestVolumeBootPattern-632748264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:36:30Z,user_data=None,user_id='0907ddd682244b7db3c2a10726fffb46',uuid=71a6b6c3-2401-42ba-8f5a-01801168bcd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dca40928-5ece-4c03-aea0-5024617262d4", "address": "fa:16:3e:a3:8b:a4", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdca40928-5e", "ovs_interfaceid": "dca40928-5ece-4c03-aea0-5024617262d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converting VIF {"id": "dca40928-5ece-4c03-aea0-5024617262d4", "address": "fa:16:3e:a3:8b:a4", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdca40928-5e", "ovs_interfaceid": "dca40928-5ece-4c03-aea0-5024617262d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:8b:a4,bridge_name='br-int',has_traffic_filtering=True,id=dca40928-5ece-4c03-aea0-5024617262d4,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdca40928-5e') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG nova.objects.instance [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lazy-loading 'pci_devices' on Instance uuid 71a6b6c3-2401-42ba-8f5a-01801168bcd1 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:36:53 user nova-compute[74669]:   <uuid>71a6b6c3-2401-42ba-8f5a-01801168bcd1</uuid>
Nov 08 17:36:53 user nova-compute[74669]:   <name>instance-00000031</name>
Nov 08 17:36:53 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:36:53 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:36:53 user nova-compute[74669]:   <metadata>
Nov 08 17:36:53 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:36:53 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:36:53 user nova-compute[74669]:       <nova:name>tempest-TestVolumeBootPattern-server-1312345949</nova:name>
Nov 08 17:36:53 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:36:51</nova:creationTime>
Nov 08 17:36:53 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:36:53 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:36:53 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:36:53 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:36:53 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:36:53 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:36:53 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:36:53 user nova-compute[74669]:       <nova:owner>
Nov 08 17:36:53 user nova-compute[74669]:         <nova:user uuid="0907ddd682244b7db3c2a10726fffb46">tempest-TestVolumeBootPattern-632748264-project-member</nova:user>
Nov 08 17:36:53 user nova-compute[74669]:         <nova:project uuid="5be63fa80aa24b1e9c8d84e5f54c4270">tempest-TestVolumeBootPattern-632748264</nova:project>
Nov 08 17:36:53 user nova-compute[74669]:       </nova:owner>
Nov 08 17:36:53 user nova-compute[74669]:       <nova:ports>
Nov 08 17:36:53 user nova-compute[74669]:         <nova:port uuid="dca40928-5ece-4c03-aea0-5024617262d4">
Nov 08 17:36:53 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 17:36:53 user nova-compute[74669]:         </nova:port>
Nov 08 17:36:53 user nova-compute[74669]:       </nova:ports>
Nov 08 17:36:53 user nova-compute[74669]:     </nova:instance>
Nov 08 17:36:53 user nova-compute[74669]:   </metadata>
Nov 08 17:36:53 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:36:53 user nova-compute[74669]:     <system>
Nov 08 17:36:53 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:36:53 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:36:53 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:36:53 user nova-compute[74669]:       <entry name="serial">71a6b6c3-2401-42ba-8f5a-01801168bcd1</entry>
Nov 08 17:36:53 user nova-compute[74669]:       <entry name="uuid">71a6b6c3-2401-42ba-8f5a-01801168bcd1</entry>
Nov 08 17:36:53 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:36:53 user nova-compute[74669]:     </system>
Nov 08 17:36:53 user nova-compute[74669]:   </sysinfo>
Nov 08 17:36:53 user nova-compute[74669]:   <os>
Nov 08 17:36:53 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:36:53 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:36:53 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:36:53 user nova-compute[74669]:   </os>
Nov 08 17:36:53 user nova-compute[74669]:   <features>
Nov 08 17:36:53 user nova-compute[74669]:     <acpi/>
Nov 08 17:36:53 user nova-compute[74669]:     <apic/>
Nov 08 17:36:53 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:36:53 user nova-compute[74669]:   </features>
Nov 08 17:36:53 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:36:53 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:36:53 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:36:53 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:36:53 user nova-compute[74669]:   </clock>
Nov 08 17:36:53 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:36:53 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:36:53 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:36:53 user nova-compute[74669]:   </cpu>
Nov 08 17:36:53 user nova-compute[74669]:   <devices>
Nov 08 17:36:53 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 17:36:53 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:36:53 user nova-compute[74669]:       <source dev="/dev/sdc"/>
Nov 08 17:36:53 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:36:53 user nova-compute[74669]:       <serial>a9c0622e-d0da-44e7-bc53-718ad2c1c89b</serial>
Nov 08 17:36:53 user nova-compute[74669]:     </disk>
Nov 08 17:36:53 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:36:53 user nova-compute[74669]:       <mac address="fa:16:3e:a3:8b:a4"/>
Nov 08 17:36:53 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:36:53 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:36:53 user nova-compute[74669]:       <target dev="tapdca40928-5e"/>
Nov 08 17:36:53 user nova-compute[74669]:     </interface>
Nov 08 17:36:53 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:36:53 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/71a6b6c3-2401-42ba-8f5a-01801168bcd1/console.log" append="off"/>
Nov 08 17:36:53 user nova-compute[74669]:     </serial>
Nov 08 17:36:53 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:36:53 user nova-compute[74669]:     <video>
Nov 08 17:36:53 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:36:53 user nova-compute[74669]:     </video>
Nov 08 17:36:53 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:36:53 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:36:53 user nova-compute[74669]:     </rng>
Nov 08 17:36:53 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:36:53 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:36:53 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:36:53 user nova-compute[74669]:     </memballoon>
Nov 08 17:36:53 user nova-compute[74669]:   </devices>
Nov 08 17:36:53 user nova-compute[74669]: </domain>
Nov 08 17:36:53 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1312345949',display_name='tempest-TestVolumeBootPattern-server-1312345949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1312345949',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGSH1tfl+t1f+AoN2/TlyQFqcpvH4dUnBb0qtUp3kmmhEHY7AifIfQPVEX1+0Iv7aAMwriH1/vMPkr9izF41xY+X6NTHXQUsxzNFOO/wJqkiikY/LpDilWqnGkVHaws3Q==',key_name='tempest-TestVolumeBootPattern-1527417449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5be63fa80aa24b1e9c8d84e5f54c4270',ramdisk_id='',reservation_id='r-w5ja0958',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-632748264',owner_user_name='tempest-TestVolumeBootPattern-632748264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:36:30Z,user_data=None,user_id='0907ddd682244b7db3c2a10726fffb46',uuid=71a6b6c3-2401-42ba-8f5a-01801168bcd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dca40928-5ece-4c03-aea0-5024617262d4", "address": "fa:16:3e:a3:8b:a4", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdca40928-5e", "ovs_interfaceid": "dca40928-5ece-4c03-aea0-5024617262d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converting VIF {"id": "dca40928-5ece-4c03-aea0-5024617262d4", "address": "fa:16:3e:a3:8b:a4", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdca40928-5e", "ovs_interfaceid": "dca40928-5ece-4c03-aea0-5024617262d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:8b:a4,bridge_name='br-int',has_traffic_filtering=True,id=dca40928-5ece-4c03-aea0-5024617262d4,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdca40928-5e') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG os_vif [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:8b:a4,bridge_name='br-int',has_traffic_filtering=True,id=dca40928-5ece-4c03-aea0-5024617262d4,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdca40928-5e') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '874a25a0-1549-5fad-8902-93f125502a3f', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdca40928-5e, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdca40928-5e, col_values=(('qos', UUID('577faeeb-6b22-42df-9ef0-7f800232b0f9')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdca40928-5e, col_values=(('external_ids', {'iface-id': 'dca40928-5ece-4c03-aea0-5024617262d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:8b:a4', 'vm-uuid': '71a6b6c3-2401-42ba-8f5a-01801168bcd1'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:53 user nova-compute[74669]: INFO os_vif [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:8b:a4,bridge_name='br-int',has_traffic_filtering=True,id=dca40928-5ece-4c03-aea0-5024617262d4,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdca40928-5e')
Nov 08 17:36:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:36:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] No VIF found with MAC fa:16:3e:a3:8b:a4, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:36:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-3a823f92-fc2f-476f-9ee8-32051e046c02 req-1a2458b4-83b8-4f40-8818-4a4d251f36c6 service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Received event network-vif-plugged-dca40928-5ece-4c03-aea0-5024617262d4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:36:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3a823f92-fc2f-476f-9ee8-32051e046c02 req-1a2458b4-83b8-4f40-8818-4a4d251f36c6 service nova] Acquiring lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:36:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3a823f92-fc2f-476f-9ee8-32051e046c02 req-1a2458b4-83b8-4f40-8818-4a4d251f36c6 service nova] Lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:36:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-3a823f92-fc2f-476f-9ee8-32051e046c02 req-1a2458b4-83b8-4f40-8818-4a4d251f36c6 service nova] Lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:36:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-3a823f92-fc2f-476f-9ee8-32051e046c02 req-1a2458b4-83b8-4f40-8818-4a4d251f36c6 service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] No waiting events found dispatching network-vif-plugged-dca40928-5ece-4c03-aea0-5024617262d4 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:36:54 user nova-compute[74669]: WARNING nova.compute.manager [req-3a823f92-fc2f-476f-9ee8-32051e046c02 req-1a2458b4-83b8-4f40-8818-4a4d251f36c6 service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Received unexpected event network-vif-plugged-dca40928-5ece-4c03-aea0-5024617262d4 for instance with vm_state building and task_state spawning.
Nov 08 17:36:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:56 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:36:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:36:56 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Instance spawned successfully.
Nov 08 17:36:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:36:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:36:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:36:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:36:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:36:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:36:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:36:56 user nova-compute[74669]: DEBUG nova.compute.manager [req-89698c18-3766-4366-b4ae-415355a01a61 req-8532a068-63fd-49d9-a10f-0e5431e0c81a service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Received event network-vif-plugged-dca40928-5ece-4c03-aea0-5024617262d4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:36:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-89698c18-3766-4366-b4ae-415355a01a61 req-8532a068-63fd-49d9-a10f-0e5431e0c81a service nova] Acquiring lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:36:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-89698c18-3766-4366-b4ae-415355a01a61 req-8532a068-63fd-49d9-a10f-0e5431e0c81a service nova] Lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:36:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-89698c18-3766-4366-b4ae-415355a01a61 req-8532a068-63fd-49d9-a10f-0e5431e0c81a service nova] Lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:36:56 user nova-compute[74669]: DEBUG nova.compute.manager [req-89698c18-3766-4366-b4ae-415355a01a61 req-8532a068-63fd-49d9-a10f-0e5431e0c81a service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] No waiting events found dispatching network-vif-plugged-dca40928-5ece-4c03-aea0-5024617262d4 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:36:56 user nova-compute[74669]: WARNING nova.compute.manager [req-89698c18-3766-4366-b4ae-415355a01a61 req-8532a068-63fd-49d9-a10f-0e5431e0c81a service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Received unexpected event network-vif-plugged-dca40928-5ece-4c03-aea0-5024617262d4 for instance with vm_state building and task_state spawning.
Nov 08 17:36:57 user nova-compute[74669]: INFO nova.compute.manager [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Took 5.16 seconds to spawn the instance on the hypervisor.
Nov 08 17:36:57 user nova-compute[74669]: DEBUG nova.compute.manager [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:36:57 user nova-compute[74669]: INFO nova.compute.manager [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Took 28.19 seconds to build instance.
Nov 08 17:36:57 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-0c72905a-8663-4bc3-afbc-dafc5d6da932 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.298s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:36:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:36:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:37:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:37:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:37:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:37:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:37:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:37:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:37:19 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:37:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "6fd1fa42-b054-4c40-9260-7aef326f97ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:37:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:37:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:37:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:37:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:37:21 user nova-compute[74669]: INFO nova.compute.manager [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Terminating instance
Nov 08 17:37:21 user nova-compute[74669]: DEBUG nova.compute.manager [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:37:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:37:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG nova.compute.manager [req-72d3a147-13b5-4991-b792-a30a6becc389 req-1a217eb3-183d-4485-9afd-ef31c102e4d0 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received event network-vif-unplugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-72d3a147-13b5-4991-b792-a30a6becc389 req-1a217eb3-183d-4485-9afd-ef31c102e4d0 service nova] Acquiring lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-72d3a147-13b5-4991-b792-a30a6becc389 req-1a217eb3-183d-4485-9afd-ef31c102e4d0 service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-72d3a147-13b5-4991-b792-a30a6becc389 req-1a217eb3-183d-4485-9afd-ef31c102e4d0 service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG nova.compute.manager [req-72d3a147-13b5-4991-b792-a30a6becc389 req-1a217eb3-183d-4485-9afd-ef31c102e4d0 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] No waiting events found dispatching network-vif-unplugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG nova.compute.manager [req-72d3a147-13b5-4991-b792-a30a6becc389 req-1a217eb3-183d-4485-9afd-ef31c102e4d0 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received event network-vif-unplugged-3906eb94-933f-43ff-8be2-04f2c4205320 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:37:22 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Instance destroyed successfully.
Nov 08 17:37:22 user nova-compute[74669]: DEBUG nova.objects.instance [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lazy-loading 'resources' on Instance uuid 6fd1fa42-b054-4c40-9260-7aef326f97ae {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-593154799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-593154799',id=47,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:33:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08551815597744d89e3a61d190a9b8a7',ramdisk_id='',reservation_id='r-8yv89pes',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293450045',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:35:36Z,user_data=None,user_id='b1fcd1d4cf714f62aa8648b27a04c04e',uuid=6fd1fa42-b054-4c40-9260-7aef326f97ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3906eb94-933f-43ff-8be2-04f2c4205320", "address": "fa:16:3e:23:e3:66", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3906eb94-93", "ovs_interfaceid": "3906eb94-933f-43ff-8be2-04f2c4205320", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converting VIF {"id": "3906eb94-933f-43ff-8be2-04f2c4205320", "address": "fa:16:3e:23:e3:66", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3906eb94-93", "ovs_interfaceid": "3906eb94-933f-43ff-8be2-04f2c4205320", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:e3:66,bridge_name='br-int',has_traffic_filtering=True,id=3906eb94-933f-43ff-8be2-04f2c4205320,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3906eb94-93') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG os_vif [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:e3:66,bridge_name='br-int',has_traffic_filtering=True,id=3906eb94-933f-43ff-8be2-04f2c4205320,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3906eb94-93') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3906eb94-93, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01b658d7-28bd-4b63-9b5f-8840ff4912d6) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:37:22 user nova-compute[74669]: INFO os_vif [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:e3:66,bridge_name='br-int',has_traffic_filtering=True,id=3906eb94-933f-43ff-8be2-04f2c4205320,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3906eb94-93')
Nov 08 17:37:22 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkDuTyBU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:37:22 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:37:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d619b1ee-515b-43a4-80f8-75cff15b2525]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:37:22 user nova-compute[74669]: No targets found.
Nov 08 17:37:22 user nova-compute[74669]: iSNS:
Nov 08 17:37:22 user nova-compute[74669]: No targets found.
Nov 08 17:37:22 user nova-compute[74669]: STATIC:
Nov 08 17:37:22 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912
Nov 08 17:37:22 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:37:22 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:37:22 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c
Nov 08 17:37:22 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:37:22 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:37:22 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b
Nov 08 17:37:22 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:37:22 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:37:22 user nova-compute[74669]: FIRMWARE:
Nov 08 17:37:22 user nova-compute[74669]: No targets found.
Nov 08 17:37:22 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:37:22 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:37:22 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e794b7ff-c983-41f2-a25e-c68e2b14326a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aac2699-59c0-4b90-936b-e403b6757f63]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:37:22 user nova-compute[74669]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)
Nov 08 17:37:22 user nova-compute[74669]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)
Nov 08 17:37:22 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:37:22 user nova-compute[74669]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 (non-flash)
Nov 08 17:37:22 user nova-compute[74669]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)
Nov 08 17:37:22 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9a869a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912'): ({'sdd'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Removing single pathed devices sdd {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1c109c-d58a-41af-8c4a-d58019ce8f2e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a0a1bd-a13e-4577-b9b0-4dd949a6577c]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Flushing IO for device /dev/sdd {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf7530b-da0a-4cd0-aa20-75efb4ea815c]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[17510399-b576-44dc-a23a-45aafd3daf4b]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] SCSI volumes sdd have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_388a1fb1',) {{(pid=86107) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff580a54-d02d-4f4f-9357-71f0a6ba0cbf]: (4, None) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d11a929-bc9d-40b1-9c25-d6088d048b2b]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74f70af-7748-4929-9176-eb26104999fb]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912, portal: 172.16.0.220,3260]
Nov 08 17:37:22 user nova-compute[74669]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912, portal: 172.16.0.220,3260] successful.
Nov 08 17:37:22 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d84cfa4-9889-4d49-92ea-53b45d2d3912 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1691c4-edc9-4c45-8004-ba23fbe68739]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] <== disconnect_volume: return (297ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:37:22 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:37:22 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Deleting instance files /opt/stack/data/nova/instances/6fd1fa42-b054-4c40-9260-7aef326f97ae_del
Nov 08 17:37:22 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Deletion of /opt/stack/data/nova/instances/6fd1fa42-b054-4c40-9260-7aef326f97ae_del complete
Nov 08 17:37:23 user nova-compute[74669]: INFO nova.compute.manager [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 08 17:37:23 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:37:23 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:37:23 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:37:23 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:37:23 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:37:23 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Took 0.58 seconds to deallocate network for instance.
Nov 08 17:37:23 user nova-compute[74669]: DEBUG nova.compute.manager [req-b3ed25f5-ef4c-4806-99fd-bea5678b3c88 req-9b663797-4580-4138-ae30-e92aa71f644b service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received event network-vif-deleted-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:37:23 user nova-compute[74669]: INFO nova.compute.manager [req-b3ed25f5-ef4c-4806-99fd-bea5678b3c88 req-9b663797-4580-4138-ae30-e92aa71f644b service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Neutron deleted interface 3906eb94-933f-43ff-8be2-04f2c4205320; detaching it from the instance and deleting it from the info cache
Nov 08 17:37:23 user nova-compute[74669]: DEBUG nova.network.neutron [req-b3ed25f5-ef4c-4806-99fd-bea5678b3c88 req-9b663797-4580-4138-ae30-e92aa71f644b service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:37:23 user nova-compute[74669]: DEBUG nova.compute.manager [req-b3ed25f5-ef4c-4806-99fd-bea5678b3c88 req-9b663797-4580-4138-ae30-e92aa71f644b service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Detach interface failed, port_id=3906eb94-933f-43ff-8be2-04f2c4205320, reason: Instance 6fd1fa42-b054-4c40-9260-7aef326f97ae could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 17:37:24 user nova-compute[74669]: DEBUG nova.compute.manager [req-ae5c0cd3-5cbf-435f-a567-b979aac5534f req-08c83eaf-4211-441d-9325-7e6a545f5ed0 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received event network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:37:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ae5c0cd3-5cbf-435f-a567-b979aac5534f req-08c83eaf-4211-441d-9325-7e6a545f5ed0 service nova] Acquiring lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:37:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ae5c0cd3-5cbf-435f-a567-b979aac5534f req-08c83eaf-4211-441d-9325-7e6a545f5ed0 service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:37:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ae5c0cd3-5cbf-435f-a567-b979aac5534f req-08c83eaf-4211-441d-9325-7e6a545f5ed0 service nova] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:37:24 user nova-compute[74669]: DEBUG nova.compute.manager [req-ae5c0cd3-5cbf-435f-a567-b979aac5534f req-08c83eaf-4211-441d-9325-7e6a545f5ed0 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] No waiting events found dispatching network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:37:24 user nova-compute[74669]: WARNING nova.compute.manager [req-ae5c0cd3-5cbf-435f-a567-b979aac5534f req-08c83eaf-4211-441d-9325-7e6a545f5ed0 service nova] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Received unexpected event network-vif-plugged-3906eb94-933f-43ff-8be2-04f2c4205320 for instance with vm_state active and task_state deleting.
Nov 08 17:37:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:37:24 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:37:24 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:37:24 user nova-compute[74669]: INFO nova.compute.manager [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 6fd1fa42-b054-4c40-9260-7aef326f97ae] Took 1.03 seconds to detach 1 volumes for instance.
Nov 08 17:37:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:37:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:37:24 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:37:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:37:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:37:24 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Refreshing inventories for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 17:37:25 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Updating ProviderTree inventory for provider ce26964b-e55b-43d2-801a-7221ff1fe64b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 17:37:25 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Updating inventory in ProviderTree for provider ce26964b-e55b-43d2-801a-7221ff1fe64b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 17:37:25 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Refreshing aggregate associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, aggregates: None {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 17:37:25 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Refreshing trait associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, traits: HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 17:37:25 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Updating instance_info_cache with network_info: [{"id": "a4820eb9-3a23-479e-b429-47171c75f100", "address": "fa:16:3e:12:b9:b1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4820eb9-3a", "ovs_interfaceid": "a4820eb9-3a23-479e-b429-47171c75f100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:37:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-fa8c4d88-8b6c-4ef6-9876-62597ace9c37" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:37:25 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:37:25 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:37:25 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:37:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:37:25 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Deleted allocations for instance 6fd1fa42-b054-4c40-9260-7aef326f97ae
Nov 08 17:37:25 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-57703fc8-caed-4a53-b5e9-257d5a62d6eb tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "6fd1fa42-b054-4c40-9260-7aef326f97ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.694s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:37:26 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:37:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:37:27 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:37:27 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:37:29 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:37:30 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:37:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:37:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:37:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:37:30 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:37:30 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:37:30 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:37:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:37:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:37:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:37:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:37:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:37:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:37:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:37:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:37:31 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:37:31 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:37:32 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8658MB free_disk=24.948471069335938GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:37:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:37:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:37:32 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0796133c-71d6-4d64-94af-49028a6603ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:37:32 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance fa8c4d88-8b6c-4ef6-9876-62597ace9c37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:37:32 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 49657a40-5c34-43d3-9bb5-b78dab52d2ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:37:32 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 71a6b6c3-2401-42ba-8f5a-01801168bcd1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:37:32 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:37:32 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:37:32 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:37:32 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:37:32 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:37:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:37:32 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:37:32 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74669) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 17:37:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:37:33 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:37:33 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 17:37:33 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] There are 0 instances to clean {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 17:37:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:37:40 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:37:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:37:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:37:48 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:37:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:37:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:38:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:07 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:38:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:38:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:38:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:38:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:38:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:38:12 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:38:12 user nova-compute[74669]: INFO nova.compute.manager [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Terminating instance
Nov 08 17:38:12 user nova-compute[74669]: DEBUG nova.compute.manager [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:38:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG nova.compute.manager [req-a1835db7-f224-445c-bac2-c7a775474262 req-5b7cfa3f-39bd-4641-839e-e86946b8c324 service nova] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Received event network-vif-unplugged-f021aef7-a8e3-4f01-8825-378de286cdbb {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a1835db7-f224-445c-bac2-c7a775474262 req-5b7cfa3f-39bd-4641-839e-e86946b8c324 service nova] Acquiring lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a1835db7-f224-445c-bac2-c7a775474262 req-5b7cfa3f-39bd-4641-839e-e86946b8c324 service nova] Lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a1835db7-f224-445c-bac2-c7a775474262 req-5b7cfa3f-39bd-4641-839e-e86946b8c324 service nova] Lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG nova.compute.manager [req-a1835db7-f224-445c-bac2-c7a775474262 req-5b7cfa3f-39bd-4641-839e-e86946b8c324 service nova] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] No waiting events found dispatching network-vif-unplugged-f021aef7-a8e3-4f01-8825-378de286cdbb {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG nova.compute.manager [req-a1835db7-f224-445c-bac2-c7a775474262 req-5b7cfa3f-39bd-4641-839e-e86946b8c324 service nova] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Received event network-vif-unplugged-f021aef7-a8e3-4f01-8825-378de286cdbb for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:13 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Instance destroyed successfully.
Nov 08 17:38:13 user nova-compute[74669]: DEBUG nova.objects.instance [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lazy-loading 'resources' on Instance uuid 49657a40-5c34-43d3-9bb5-b78dab52d2ff {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:27:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1455283578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1455283578',id=45,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:28:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08551815597744d89e3a61d190a9b8a7',ramdisk_id='',reservation_id='r-1hdsfeqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293450045',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:29:57Z,user_data=None,user_id='b1fcd1d4cf714f62aa8648b27a04c04e',uuid=49657a40-5c34-43d3-9bb5-b78dab52d2ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f021aef7-a8e3-4f01-8825-378de286cdbb", "address": "fa:16:3e:37:64:f1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf021aef7-a8", "ovs_interfaceid": "f021aef7-a8e3-4f01-8825-378de286cdbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converting VIF {"id": "f021aef7-a8e3-4f01-8825-378de286cdbb", "address": "fa:16:3e:37:64:f1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf021aef7-a8", "ovs_interfaceid": "f021aef7-a8e3-4f01-8825-378de286cdbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:64:f1,bridge_name='br-int',has_traffic_filtering=True,id=f021aef7-a8e3-4f01-8825-378de286cdbb,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf021aef7-a8') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG os_vif [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:64:f1,bridge_name='br-int',has_traffic_filtering=True,id=f021aef7-a8e3-4f01-8825-378de286cdbb,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf021aef7-a8') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf021aef7-a8, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d462e175-4ecc-4702-be6a-0664b90ab09b) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:13 user nova-compute[74669]: INFO os_vif [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:64:f1,bridge_name='br-int',has_traffic_filtering=True,id=f021aef7-a8e3-4f01-8825-378de286cdbb,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf021aef7-a8')
Nov 08 17:38:13 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Deleting instance files /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff_del
Nov 08 17:38:13 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Deletion of /opt/stack/data/nova/instances/49657a40-5c34-43d3-9bb5-b78dab52d2ff_del complete
Nov 08 17:38:13 user nova-compute[74669]: INFO nova.compute.manager [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Took 0.80 seconds to destroy the instance on the hypervisor.
Nov 08 17:38:13 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:38:13 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:38:14 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:38:14 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Took 0.46 seconds to deallocate network for instance.
Nov 08 17:38:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:38:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:38:14 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:38:14 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:38:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:38:14 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Deleted allocations for instance 49657a40-5c34-43d3-9bb5-b78dab52d2ff
Nov 08 17:38:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-fb154829-f5dd-4f2f-9ec6-227f3b0669af tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.635s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:38:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-0e07169a-625a-42de-a1d2-c29d6f02a1df req-6ba09c2c-ab5d-4db6-b8d5-5714dcafe886 service nova] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Received event network-vif-plugged-f021aef7-a8e3-4f01-8825-378de286cdbb {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:38:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0e07169a-625a-42de-a1d2-c29d6f02a1df req-6ba09c2c-ab5d-4db6-b8d5-5714dcafe886 service nova] Acquiring lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:38:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0e07169a-625a-42de-a1d2-c29d6f02a1df req-6ba09c2c-ab5d-4db6-b8d5-5714dcafe886 service nova] Lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:38:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0e07169a-625a-42de-a1d2-c29d6f02a1df req-6ba09c2c-ab5d-4db6-b8d5-5714dcafe886 service nova] Lock "49657a40-5c34-43d3-9bb5-b78dab52d2ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:38:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-0e07169a-625a-42de-a1d2-c29d6f02a1df req-6ba09c2c-ab5d-4db6-b8d5-5714dcafe886 service nova] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] No waiting events found dispatching network-vif-plugged-f021aef7-a8e3-4f01-8825-378de286cdbb {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:38:15 user nova-compute[74669]: WARNING nova.compute.manager [req-0e07169a-625a-42de-a1d2-c29d6f02a1df req-6ba09c2c-ab5d-4db6-b8d5-5714dcafe886 service nova] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Received unexpected event network-vif-plugged-f021aef7-a8e3-4f01-8825-378de286cdbb for instance with vm_state deleted and task_state None.
Nov 08 17:38:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-0e07169a-625a-42de-a1d2-c29d6f02a1df req-6ba09c2c-ab5d-4db6-b8d5-5714dcafe886 service nova] [instance: 49657a40-5c34-43d3-9bb5-b78dab52d2ff] Received event network-vif-deleted-f021aef7-a8e3-4f01-8825-378de286cdbb {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:38:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:19 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:38:20 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:38:20 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid 0796133c-71d6-4d64-94af-49028a6603ea {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 17:38:20 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid fa8c4d88-8b6c-4ef6-9876-62597ace9c37 {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 17:38:20 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Triggering sync for uuid 71a6b6c3-2401-42ba-8f5a-01801168bcd1 {{(pid=74669) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 17:38:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "0796133c-71d6-4d64-94af-49028a6603ea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:38:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "0796133c-71d6-4d64-94af-49028a6603ea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:38:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:38:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:38:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:38:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:38:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "0796133c-71d6-4d64-94af-49028a6603ea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:38:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:38:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:38:20 user nova-compute[74669]: DEBUG nova.compute.manager [req-eca29d47-a0b4-4441-8145-b8edda512cd9 req-b86ed5d1-3cf4-43c1-8fb7-26ffca0c937a service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Received event network-changed-dca40928-5ece-4c03-aea0-5024617262d4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:38:20 user nova-compute[74669]: DEBUG nova.compute.manager [req-eca29d47-a0b4-4441-8145-b8edda512cd9 req-b86ed5d1-3cf4-43c1-8fb7-26ffca0c937a service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Refreshing instance network info cache due to event network-changed-dca40928-5ece-4c03-aea0-5024617262d4. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:38:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eca29d47-a0b4-4441-8145-b8edda512cd9 req-b86ed5d1-3cf4-43c1-8fb7-26ffca0c937a service nova] Acquiring lock "refresh_cache-71a6b6c3-2401-42ba-8f5a-01801168bcd1" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:38:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eca29d47-a0b4-4441-8145-b8edda512cd9 req-b86ed5d1-3cf4-43c1-8fb7-26ffca0c937a service nova] Acquired lock "refresh_cache-71a6b6c3-2401-42ba-8f5a-01801168bcd1" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:38:20 user nova-compute[74669]: DEBUG nova.network.neutron [req-eca29d47-a0b4-4441-8145-b8edda512cd9 req-b86ed5d1-3cf4-43c1-8fb7-26ffca0c937a service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Refreshing network info cache for port dca40928-5ece-4c03-aea0-5024617262d4 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:38:21 user nova-compute[74669]: DEBUG nova.network.neutron [req-eca29d47-a0b4-4441-8145-b8edda512cd9 req-b86ed5d1-3cf4-43c1-8fb7-26ffca0c937a service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Updated VIF entry in instance network info cache for port dca40928-5ece-4c03-aea0-5024617262d4. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:38:21 user nova-compute[74669]: DEBUG nova.network.neutron [req-eca29d47-a0b4-4441-8145-b8edda512cd9 req-b86ed5d1-3cf4-43c1-8fb7-26ffca0c937a service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Updating instance_info_cache with network_info: [{"id": "dca40928-5ece-4c03-aea0-5024617262d4", "address": "fa:16:3e:a3:8b:a4", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdca40928-5e", "ovs_interfaceid": "dca40928-5ece-4c03-aea0-5024617262d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:38:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eca29d47-a0b4-4441-8145-b8edda512cd9 req-b86ed5d1-3cf4-43c1-8fb7-26ffca0c937a service nova] Releasing lock "refresh_cache-71a6b6c3-2401-42ba-8f5a-01801168bcd1" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:38:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:38:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:38:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:38:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:38:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:38:21 user nova-compute[74669]: INFO nova.compute.manager [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Terminating instance
Nov 08 17:38:21 user nova-compute[74669]: DEBUG nova.compute.manager [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:38:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:22 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Instance destroyed successfully.
Nov 08 17:38:22 user nova-compute[74669]: DEBUG nova.objects.instance [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lazy-loading 'resources' on Instance uuid 71a6b6c3-2401-42ba-8f5a-01801168bcd1 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1312345949',display_name='tempest-TestVolumeBootPattern-server-1312345949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1312345949',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGSH1tfl+t1f+AoN2/TlyQFqcpvH4dUnBb0qtUp3kmmhEHY7AifIfQPVEX1+0Iv7aAMwriH1/vMPkr9izF41xY+X6NTHXQUsxzNFOO/wJqkiikY/LpDilWqnGkVHaws3Q==',key_name='tempest-TestVolumeBootPattern-1527417449',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:36:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5be63fa80aa24b1e9c8d84e5f54c4270',ramdisk_id='',reservation_id='r-w5ja0958',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-632748264',owner_user_name='tempest-TestVolumeBootPattern-632748264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:36:57Z,user_data=None,user_id='0907ddd682244b7db3c2a10726fffb46',uuid=71a6b6c3-2401-42ba-8f5a-01801168bcd1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dca40928-5ece-4c03-aea0-5024617262d4", "address": "fa:16:3e:a3:8b:a4", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdca40928-5e", "ovs_interfaceid": "dca40928-5ece-4c03-aea0-5024617262d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converting VIF {"id": "dca40928-5ece-4c03-aea0-5024617262d4", "address": "fa:16:3e:a3:8b:a4", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdca40928-5e", "ovs_interfaceid": "dca40928-5ece-4c03-aea0-5024617262d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:8b:a4,bridge_name='br-int',has_traffic_filtering=True,id=dca40928-5ece-4c03-aea0-5024617262d4,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdca40928-5e') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG os_vif [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:8b:a4,bridge_name='br-int',has_traffic_filtering=True,id=dca40928-5ece-4c03-aea0-5024617262d4,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdca40928-5e') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdca40928-5e, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=577faeeb-6b22-42df-9ef0-7f800232b0f9) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:22 user nova-compute[74669]: INFO os_vif [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:8b:a4,bridge_name='br-int',has_traffic_filtering=True,id=dca40928-5ece-4c03-aea0-5024617262d4,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdca40928-5e')
Nov 08 17:38:22 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imFMhLHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:38:22 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:38:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f951c37e-836c-472a-a297-f5d3f735ee80]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:38:22 user nova-compute[74669]: No targets found.
Nov 08 17:38:22 user nova-compute[74669]: iSNS:
Nov 08 17:38:22 user nova-compute[74669]: No targets found.
Nov 08 17:38:22 user nova-compute[74669]: STATIC:
Nov 08 17:38:22 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c
Nov 08 17:38:22 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:38:22 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:38:22 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b
Nov 08 17:38:22 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:38:22 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:38:22 user nova-compute[74669]: FIRMWARE:
Nov 08 17:38:22 user nova-compute[74669]: No targets found.
Nov 08 17:38:22 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:38:22 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:38:22 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cc3f10-78a2-450f-a4bc-5033e2bce5ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c249bd2c-8e2b-4d32-ad80-cac7b9981e3c]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:38:22 user nova-compute[74669]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)
Nov 08 17:38:22 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:38:22 user nova-compute[74669]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)
Nov 08 17:38:22 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9846bf400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b'): ({'sdc'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Removing single pathed devices sdc {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4526aa10-2767-4766-b75f-00b1446255e7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a582db-4ad0-46c6-b3be-f35493fcb64a]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Flushing IO for device /dev/sdc {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee1948f-afb4-4c7a-9947-5f54d5647eef]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac888ae-e4b3-46ae-b4ca-bfe848ded94a]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_aae2e32b', '/dev/disk/by-id/scsi-1SCST_BIOaae2e32b-aa926c61afbf7b97', '/dev/disk/by-id/scsi-26161393236633631') {{(pid=86107) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c23b47-f305-4b00-80bf-e47d2c893f37]: (4, None) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a38fd8-fb20-452f-98ee-6ead662ac844]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2b919b-3283-40c2-b3ad-8a424789dd3d]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b, portal: 172.16.0.220,3260]
Nov 08 17:38:22 user nova-compute[74669]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b, portal: 172.16.0.220,3260] successful.
Nov 08 17:38:22 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[604dac19-a31d-445b-a76f-a370339ac890]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] <== disconnect_volume: return (290ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:38:22 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Deleting instance files /opt/stack/data/nova/instances/71a6b6c3-2401-42ba-8f5a-01801168bcd1_del
Nov 08 17:38:22 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Deletion of /opt/stack/data/nova/instances/71a6b6c3-2401-42ba-8f5a-01801168bcd1_del complete
Nov 08 17:38:22 user nova-compute[74669]: INFO nova.compute.manager [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG nova.compute.manager [req-ab4f87a9-89d6-4545-8f99-df71d53b2b8a req-2b126559-9e7c-43a9-9dd8-eddf6ac8cb44 service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Received event network-vif-unplugged-dca40928-5ece-4c03-aea0-5024617262d4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ab4f87a9-89d6-4545-8f99-df71d53b2b8a req-2b126559-9e7c-43a9-9dd8-eddf6ac8cb44 service nova] Acquiring lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ab4f87a9-89d6-4545-8f99-df71d53b2b8a req-2b126559-9e7c-43a9-9dd8-eddf6ac8cb44 service nova] Lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ab4f87a9-89d6-4545-8f99-df71d53b2b8a req-2b126559-9e7c-43a9-9dd8-eddf6ac8cb44 service nova] Lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG nova.compute.manager [req-ab4f87a9-89d6-4545-8f99-df71d53b2b8a req-2b126559-9e7c-43a9-9dd8-eddf6ac8cb44 service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] No waiting events found dispatching network-vif-unplugged-dca40928-5ece-4c03-aea0-5024617262d4 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG nova.compute.manager [req-ab4f87a9-89d6-4545-8f99-df71d53b2b8a req-2b126559-9e7c-43a9-9dd8-eddf6ac8cb44 service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Received event network-vif-unplugged-dca40928-5ece-4c03-aea0-5024617262d4 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG nova.compute.manager [req-ab4f87a9-89d6-4545-8f99-df71d53b2b8a req-2b126559-9e7c-43a9-9dd8-eddf6ac8cb44 service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Received event network-vif-plugged-dca40928-5ece-4c03-aea0-5024617262d4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ab4f87a9-89d6-4545-8f99-df71d53b2b8a req-2b126559-9e7c-43a9-9dd8-eddf6ac8cb44 service nova] Acquiring lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ab4f87a9-89d6-4545-8f99-df71d53b2b8a req-2b126559-9e7c-43a9-9dd8-eddf6ac8cb44 service nova] Lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ab4f87a9-89d6-4545-8f99-df71d53b2b8a req-2b126559-9e7c-43a9-9dd8-eddf6ac8cb44 service nova] Lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:38:22 user nova-compute[74669]: DEBUG nova.compute.manager [req-ab4f87a9-89d6-4545-8f99-df71d53b2b8a req-2b126559-9e7c-43a9-9dd8-eddf6ac8cb44 service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] No waiting events found dispatching network-vif-plugged-dca40928-5ece-4c03-aea0-5024617262d4 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:38:22 user nova-compute[74669]: WARNING nova.compute.manager [req-ab4f87a9-89d6-4545-8f99-df71d53b2b8a req-2b126559-9e7c-43a9-9dd8-eddf6ac8cb44 service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Received unexpected event network-vif-plugged-dca40928-5ece-4c03-aea0-5024617262d4 for instance with vm_state active and task_state deleting.
Nov 08 17:38:23 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:38:23 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Took 0.65 seconds to deallocate network for instance.
Nov 08 17:38:23 user nova-compute[74669]: DEBUG nova.compute.manager [req-f974128c-eba9-4a92-881a-65bc729c5b5c req-094b25b5-65d6-4bd5-9df4-aba8e9ad28fa service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Received event network-vif-deleted-dca40928-5ece-4c03-aea0-5024617262d4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:38:23 user nova-compute[74669]: INFO nova.compute.manager [req-f974128c-eba9-4a92-881a-65bc729c5b5c req-094b25b5-65d6-4bd5-9df4-aba8e9ad28fa service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Neutron deleted interface dca40928-5ece-4c03-aea0-5024617262d4; detaching it from the instance and deleting it from the info cache
Nov 08 17:38:23 user nova-compute[74669]: DEBUG nova.network.neutron [req-f974128c-eba9-4a92-881a-65bc729c5b5c req-094b25b5-65d6-4bd5-9df4-aba8e9ad28fa service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:38:23 user nova-compute[74669]: DEBUG nova.compute.manager [req-f974128c-eba9-4a92-881a-65bc729c5b5c req-094b25b5-65d6-4bd5-9df4-aba8e9ad28fa service nova] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Detach interface failed, port_id=dca40928-5ece-4c03-aea0-5024617262d4, reason: Instance 71a6b6c3-2401-42ba-8f5a-01801168bcd1 could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 17:38:23 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:38:23 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:38:24 user nova-compute[74669]: INFO nova.compute.manager [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 71a6b6c3-2401-42ba-8f5a-01801168bcd1] Took 0.89 seconds to detach 1 volumes for instance.
Nov 08 17:38:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:38:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:38:24 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:38:24 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:38:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:38:24 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Deleted allocations for instance 71a6b6c3-2401-42ba-8f5a-01801168bcd1
Nov 08 17:38:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-b1d0d668-0d79-4442-b8fc-94614ff02d36 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "71a6b6c3-2401-42ba-8f5a-01801168bcd1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.987s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:38:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:24 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:38:26 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:38:26 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:38:26 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Didn't find any instances for network info cache update. {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 17:38:26 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:38:27 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:29 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:38:29 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:38:30 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:38:31 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:38:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:38:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:38:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:38:31 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:38:31 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:38:31 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:38:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:38:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:38:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:38:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:38:32 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:38:32 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:38:32 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8891MB free_disk=25.07278823852539GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:38:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:38:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:38:32 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0796133c-71d6-4d64-94af-49028a6603ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:38:32 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance fa8c4d88-8b6c-4ef6-9876-62597ace9c37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:38:32 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:38:32 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:38:32 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:38:32 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:38:32 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:38:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:38:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:38:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:38:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:38:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:38:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:38:42 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:38:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:38:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:38:57 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:39:02 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:39:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:39:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:39:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:39:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:39:03 user nova-compute[74669]: INFO nova.compute.manager [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Terminating instance
Nov 08 17:39:03 user nova-compute[74669]: DEBUG nova.compute.manager [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:39:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:03 user nova-compute[74669]: DEBUG nova.compute.manager [req-b5e80046-7ad4-4e1c-adc5-a2eb3e62df81 req-390964e1-dcd0-4e64-950d-220febd41b8c service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received event network-vif-unplugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:39:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b5e80046-7ad4-4e1c-adc5-a2eb3e62df81 req-390964e1-dcd0-4e64-950d-220febd41b8c service nova] Acquiring lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:39:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b5e80046-7ad4-4e1c-adc5-a2eb3e62df81 req-390964e1-dcd0-4e64-950d-220febd41b8c service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:39:03 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b5e80046-7ad4-4e1c-adc5-a2eb3e62df81 req-390964e1-dcd0-4e64-950d-220febd41b8c service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:39:03 user nova-compute[74669]: DEBUG nova.compute.manager [req-b5e80046-7ad4-4e1c-adc5-a2eb3e62df81 req-390964e1-dcd0-4e64-950d-220febd41b8c service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] No waiting events found dispatching network-vif-unplugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:39:03 user nova-compute[74669]: DEBUG nova.compute.manager [req-b5e80046-7ad4-4e1c-adc5-a2eb3e62df81 req-390964e1-dcd0-4e64-950d-220febd41b8c service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received event network-vif-unplugged-a4820eb9-3a23-479e-b429-47171c75f100 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:39:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:04 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Instance destroyed successfully.
Nov 08 17:39:04 user nova-compute[74669]: DEBUG nova.objects.instance [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lazy-loading 'resources' on Instance uuid fa8c4d88-8b6c-4ef6-9876-62597ace9c37 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:22:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1647964349',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1647964349',id=41,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:24:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08551815597744d89e3a61d190a9b8a7',ramdisk_id='',reservation_id='r-6nt2kfv8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293450045',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:26:12Z,user_data=None,user_id='b1fcd1d4cf714f62aa8648b27a04c04e',uuid=fa8c4d88-8b6c-4ef6-9876-62597ace9c37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4820eb9-3a23-479e-b429-47171c75f100", "address": "fa:16:3e:12:b9:b1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4820eb9-3a", "ovs_interfaceid": "a4820eb9-3a23-479e-b429-47171c75f100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converting VIF {"id": "a4820eb9-3a23-479e-b429-47171c75f100", "address": "fa:16:3e:12:b9:b1", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4820eb9-3a", "ovs_interfaceid": "a4820eb9-3a23-479e-b429-47171c75f100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:b9:b1,bridge_name='br-int',has_traffic_filtering=True,id=a4820eb9-3a23-479e-b429-47171c75f100,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4820eb9-3a') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG os_vif [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:b9:b1,bridge_name='br-int',has_traffic_filtering=True,id=a4820eb9-3a23-479e-b429-47171c75f100,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4820eb9-3a') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4820eb9-3a, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=553dedd6-141e-4cf4-bfa0-63dc72efc6d5) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:39:04 user nova-compute[74669]: INFO os_vif [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:b9:b1,bridge_name='br-int',has_traffic_filtering=True,id=a4820eb9-3a23-479e-b429-47171c75f100,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4820eb9-3a')
Nov 08 17:39:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WDbQCvMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:39:04 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:39:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[145562aa-4580-4782-ad9f-216f09a023b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:39:04 user nova-compute[74669]: No targets found.
Nov 08 17:39:04 user nova-compute[74669]: iSNS:
Nov 08 17:39:04 user nova-compute[74669]: No targets found.
Nov 08 17:39:04 user nova-compute[74669]: STATIC:
Nov 08 17:39:04 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c
Nov 08 17:39:04 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:39:04 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:39:04 user nova-compute[74669]: FIRMWARE:
Nov 08 17:39:04 user nova-compute[74669]: No targets found.
Nov 08 17:39:04 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:39:04 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:39:04 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbc82ba-c42d-40c6-b294-8dbfb777a282]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d26016-e8e7-482c-a02c-62514682f09c]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:39:04 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c (non-flash)
Nov 08 17:39:04 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd98450dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c'): ({'sdb'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Removing single pathed devices sdb {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce9cd58-82fd-42a9-91cc-3929dcd240c6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dd753e-cd0f-4803-9793-661865391724]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Flushing IO for device /dev/sdb {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c7fa68-968a-4d62-af64-a87b61d0ade0]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[13685e80-d047-4702-94ea-6eac3218c343]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d241c6-df89-407b-ace7-e33cbffe473b]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[843b987c-f0dc-4739-8dd4-7a8001faa67e]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c, portal: 172.16.0.220,3260]
Nov 08 17:39:04 user nova-compute[74669]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c, portal: 172.16.0.220,3260] successful.
Nov 08 17:39:04 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92ef8ae2-8cbb-4187-8a86-f5cc787c4e9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[69295a04-f461-4fa9-8ea1-06276a8ac663]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] <== disconnect_volume: return (282ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:39:04 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Deleting instance files /opt/stack/data/nova/instances/fa8c4d88-8b6c-4ef6-9876-62597ace9c37_del
Nov 08 17:39:04 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Deletion of /opt/stack/data/nova/instances/fa8c4d88-8b6c-4ef6-9876-62597ace9c37_del complete
Nov 08 17:39:04 user nova-compute[74669]: INFO nova.compute.manager [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 08 17:39:04 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:39:04 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:39:04 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Took 0.38 seconds to deallocate network for instance.
Nov 08 17:39:05 user nova-compute[74669]: DEBUG nova.compute.manager [req-6e521e87-a140-484c-b4da-ee54f8b31bd8 req-13b83155-89f5-46a9-9a5d-3b3c398f41c8 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received event network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:39:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6e521e87-a140-484c-b4da-ee54f8b31bd8 req-13b83155-89f5-46a9-9a5d-3b3c398f41c8 service nova] Acquiring lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:39:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6e521e87-a140-484c-b4da-ee54f8b31bd8 req-13b83155-89f5-46a9-9a5d-3b3c398f41c8 service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:39:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6e521e87-a140-484c-b4da-ee54f8b31bd8 req-13b83155-89f5-46a9-9a5d-3b3c398f41c8 service nova] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:39:05 user nova-compute[74669]: DEBUG nova.compute.manager [req-6e521e87-a140-484c-b4da-ee54f8b31bd8 req-13b83155-89f5-46a9-9a5d-3b3c398f41c8 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] No waiting events found dispatching network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:39:05 user nova-compute[74669]: WARNING nova.compute.manager [req-6e521e87-a140-484c-b4da-ee54f8b31bd8 req-13b83155-89f5-46a9-9a5d-3b3c398f41c8 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received unexpected event network-vif-plugged-a4820eb9-3a23-479e-b429-47171c75f100 for instance with vm_state active and task_state deleting.
Nov 08 17:39:05 user nova-compute[74669]: DEBUG nova.compute.manager [req-6e521e87-a140-484c-b4da-ee54f8b31bd8 req-13b83155-89f5-46a9-9a5d-3b3c398f41c8 service nova] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Received event network-vif-deleted-a4820eb9-3a23-479e-b429-47171c75f100 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:39:05 user nova-compute[74669]: INFO nova.compute.manager [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: fa8c4d88-8b6c-4ef6-9876-62597ace9c37] Took 0.95 seconds to detach 1 volumes for instance.
Nov 08 17:39:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:39:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:39:05 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:39:05 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:39:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:39:06 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Deleted allocations for instance fa8c4d88-8b6c-4ef6-9876-62597ace9c37
Nov 08 17:39:06 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-fbfa1e23-3319-4231-941f-641d3f5d3897 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "fa8c4d88-8b6c-4ef6-9876-62597ace9c37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.801s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:39:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "82cabffe-2794-409f-b797-e7db3046614e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "82cabffe-2794-409f-b797-e7db3046614e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:39:13 user nova-compute[74669]: INFO nova.compute.claims [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Claim successful on node user
Nov 08 17:39:13 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.253s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:39:13 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:39:13 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG nova.policy [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0907ddd682244b7db3c2a10726fffb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be63fa80aa24b1e9c8d84e5f54c4270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:39:13 user nova-compute[74669]: INFO nova.virt.block_device [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Booting with volume a9c0622e-d0da-44e7-bc53-718ad2c1c89b at /dev/vda
Nov 08 17:39:13 user nova-compute[74669]: DEBUG os_brick.utils [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2638c26a-e873-468c-a60d-27a7fd12a089]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9063223e-6c66-448c-b5ce-72a4c50534f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aec0820-849c-42a4-94c9-e879833d2612]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e57e075-b60f-4032-9980-c2593f10193a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:39:13 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:39:13 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d969162f-0543-47da-bc19-c2af52652c69]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG os_brick.utils [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:39:13 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Updating existing volume attachment record: 0e5ab059-f1bc-4d48-9fd7-2779be6aca6f {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:39:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:14 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Successfully created port: ec75ccfc-f347-4de7-89d7-9e4a2588edd4 {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:39:14 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Successfully updated port: ec75ccfc-f347-4de7-89d7-9e4a2588edd4 {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:39:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:39:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquired lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:39:14 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:39:14 user nova-compute[74669]: DEBUG nova.compute.manager [req-2d7c84fd-10f3-47e6-b1c7-4004cccf39f4 req-4f48e02a-16ab-4036-9eb5-17e4ec68d678 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Received event network-changed-ec75ccfc-f347-4de7-89d7-9e4a2588edd4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:39:14 user nova-compute[74669]: DEBUG nova.compute.manager [req-2d7c84fd-10f3-47e6-b1c7-4004cccf39f4 req-4f48e02a-16ab-4036-9eb5-17e4ec68d678 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Refreshing instance network info cache due to event network-changed-ec75ccfc-f347-4de7-89d7-9e4a2588edd4. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:39:14 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2d7c84fd-10f3-47e6-b1c7-4004cccf39f4 req-4f48e02a-16ab-4036-9eb5-17e4ec68d678 service nova] Acquiring lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:39:14 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:39:15 user nova-compute[74669]: DEBUG nova.network.neutron [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Updating instance_info_cache with network_info: [{"id": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "address": "fa:16:3e:3f:9b:08", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec75ccfc-f3", "ovs_interfaceid": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:39:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Releasing lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:39:15 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Instance network_info: |[{"id": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "address": "fa:16:3e:3f:9b:08", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec75ccfc-f3", "ovs_interfaceid": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:39:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2d7c84fd-10f3-47e6-b1c7-4004cccf39f4 req-4f48e02a-16ab-4036-9eb5-17e4ec68d678 service nova] Acquired lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:39:15 user nova-compute[74669]: DEBUG nova.network.neutron [req-2d7c84fd-10f3-47e6-b1c7-4004cccf39f4 req-4f48e02a-16ab-4036-9eb5-17e4ec68d678 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Refreshing network info cache for port ec75ccfc-f347-4de7-89d7-9e4a2588edd4 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:39:15 user nova-compute[74669]: DEBUG nova.network.neutron [req-2d7c84fd-10f3-47e6-b1c7-4004cccf39f4 req-4f48e02a-16ab-4036-9eb5-17e4ec68d678 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Updated VIF entry in instance network info cache for port ec75ccfc-f347-4de7-89d7-9e4a2588edd4. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:39:15 user nova-compute[74669]: DEBUG nova.network.neutron [req-2d7c84fd-10f3-47e6-b1c7-4004cccf39f4 req-4f48e02a-16ab-4036-9eb5-17e4ec68d678 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Updating instance_info_cache with network_info: [{"id": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "address": "fa:16:3e:3f:9b:08", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec75ccfc-f3", "ovs_interfaceid": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:39:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2d7c84fd-10f3-47e6-b1c7-4004cccf39f4 req-4f48e02a-16ab-4036-9eb5-17e4ec68d678 service nova] Releasing lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:39:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:20 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:39:23 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:39:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:25 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:39:25 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:39:28 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:39:28 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:39:28 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 17:39:28 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Skipping network cache update for instance because it is Building. {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 08 17:39:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:39:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:39:28 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:39:28 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lazy-loading 'info_cache' on Instance uuid 0796133c-71d6-4d64-94af-49028a6603ea {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:39:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:39:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:39:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:39:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:39:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:29 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Updating instance_info_cache with network_info: [{"id": "1fa691c0-3473-4f34-a504-3778913558ab", "address": "fa:16:3e:2f:15:d7", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa691c0-34", "ovs_interfaceid": "1fa691c0-3473-4f34-a504-3778913558ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:39:29 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-0796133c-71d6-4d64-94af-49028a6603ea" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:39:29 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:39:29 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:39:29 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:39:29 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:39:31 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:39:31 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:39:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:39:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:39:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:39:31 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:39:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:32 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:33 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:39:33 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:39:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8907MB free_disk=25.071701049804688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:39:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:39:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:39:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 0796133c-71d6-4d64-94af-49028a6603ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:39:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 82cabffe-2794-409f-b797-e7db3046614e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:39:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:39:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:39:33 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:39:33 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:39:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:39:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:39:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:39:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:39:45 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Creating image(s)
Nov 08 17:39:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Did not create local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Ensure instance console log exists: /opt/stack/data/nova/instances/82cabffe-2794-409f-b797-e7db3046614e/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Start _get_guest_xml network_info=[{"id": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "address": "fa:16:3e:3f:9b:08", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec75ccfc-f3", "ovs_interfaceid": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '0e5ab059-f1bc-4d48-9fd7-2779be6aca6f', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imFMhLHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '82cabffe-2794-409f-b797-e7db3046614e', 'attached_at': '', 'detached_at': '', 'volume_id': 'a9c0622e-d0da-44e7-bc53-718ad2c1c89b', 'serial': 'a9c0622e-d0da-44e7-bc53-718ad2c1c89b'}, 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:39:45 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:39:45 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:39:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imFMhLHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:39:45 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:39:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:39:45 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:39:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:39:45 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:39:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c73597c-3654-4c17-925d-27fe9c5e5c2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:39:45 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e5998b-5434-4928-8fe2-e050c760ba28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b] added
Nov 08 17:39:45 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e32ac1a-7b51-48a5-b374-55b5e41fd808]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4421efc-4cf1-459b-b65a-8fce1a9989ea]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v imFMhLHo {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v imFMhLHo" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[040a7670-feec-400b-a152-eaa26d37beb4]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'imFMhLHo'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b6bcc9-0f36-4c89-a9cb-77f158b90032]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:39:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab480ca-6643-4b3b-98bc-8b419fd99643]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 17:39:46 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 17:39:46 user nova-compute[74669]:  {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:39:46 user nova-compute[74669]: WARNING os_brick.initiator.connectors.iscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 17:39:46 user nova-compute[74669]: 
Nov 08 17:39:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[17471eb8-ac40-41ed-a57f-df93eaf83c63]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b, portal: 172.16.0.220,3260]
Nov 08 17:39:46 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b, portal: 172.16.0.220,3260] successful.
Nov 08 17:39:46 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6916276-20cc-4459-b7c2-32b26341673e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b378513-dbbc-48f3-8cd0-67af000a7846]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)
Nov 08 17:39:46 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)
Nov 08 17:39:46 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b9b6f1-d4e0-484b-bb83-2f2565e10491]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:39:46 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imFMhLHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26161393236633631', 'path': '/dev/sdb'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161393236633631', 'path': '/dev/sdb'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1948192499',display_name='tempest-TestVolumeBootPattern-server-1948192499',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1948192499',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGSH1tfl+t1f+AoN2/TlyQFqcpvH4dUnBb0qtUp3kmmhEHY7AifIfQPVEX1+0Iv7aAMwriH1/vMPkr9izF41xY+X6NTHXQUsxzNFOO/wJqkiikY/LpDilWqnGkVHaws3Q==',key_name='tempest-TestVolumeBootPattern-1527417449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5be63fa80aa24b1e9c8d84e5f54c4270',ramdisk_id='',reservation_id='r-36dw8aq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-632748264',owner_user_name='tempest-TestVolumeBootPattern-632748264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:39:14Z,user_data=None,user_id='0907ddd682244b7db3c2a10726fffb46',uuid=82cabffe-2794-409f-b797-e7db3046614e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "address": "fa:16:3e:3f:9b:08", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec75ccfc-f3", "ovs_interfaceid": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converting VIF {"id": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "address": "fa:16:3e:3f:9b:08", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec75ccfc-f3", "ovs_interfaceid": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:9b:08,bridge_name='br-int',has_traffic_filtering=True,id=ec75ccfc-f347-4de7-89d7-9e4a2588edd4,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec75ccfc-f3') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG nova.objects.instance [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lazy-loading 'pci_devices' on Instance uuid 82cabffe-2794-409f-b797-e7db3046614e {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:39:47 user nova-compute[74669]:   <uuid>82cabffe-2794-409f-b797-e7db3046614e</uuid>
Nov 08 17:39:47 user nova-compute[74669]:   <name>instance-00000032</name>
Nov 08 17:39:47 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:39:47 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:39:47 user nova-compute[74669]:   <metadata>
Nov 08 17:39:47 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:39:47 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:39:47 user nova-compute[74669]:       <nova:name>tempest-TestVolumeBootPattern-server-1948192499</nova:name>
Nov 08 17:39:47 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:39:45</nova:creationTime>
Nov 08 17:39:47 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:39:47 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:39:47 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:39:47 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:39:47 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:39:47 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:39:47 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:39:47 user nova-compute[74669]:       <nova:owner>
Nov 08 17:39:47 user nova-compute[74669]:         <nova:user uuid="0907ddd682244b7db3c2a10726fffb46">tempest-TestVolumeBootPattern-632748264-project-member</nova:user>
Nov 08 17:39:47 user nova-compute[74669]:         <nova:project uuid="5be63fa80aa24b1e9c8d84e5f54c4270">tempest-TestVolumeBootPattern-632748264</nova:project>
Nov 08 17:39:47 user nova-compute[74669]:       </nova:owner>
Nov 08 17:39:47 user nova-compute[74669]:       <nova:ports>
Nov 08 17:39:47 user nova-compute[74669]:         <nova:port uuid="ec75ccfc-f347-4de7-89d7-9e4a2588edd4">
Nov 08 17:39:47 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 17:39:47 user nova-compute[74669]:         </nova:port>
Nov 08 17:39:47 user nova-compute[74669]:       </nova:ports>
Nov 08 17:39:47 user nova-compute[74669]:     </nova:instance>
Nov 08 17:39:47 user nova-compute[74669]:   </metadata>
Nov 08 17:39:47 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:39:47 user nova-compute[74669]:     <system>
Nov 08 17:39:47 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:39:47 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:39:47 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:39:47 user nova-compute[74669]:       <entry name="serial">82cabffe-2794-409f-b797-e7db3046614e</entry>
Nov 08 17:39:47 user nova-compute[74669]:       <entry name="uuid">82cabffe-2794-409f-b797-e7db3046614e</entry>
Nov 08 17:39:47 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:39:47 user nova-compute[74669]:     </system>
Nov 08 17:39:47 user nova-compute[74669]:   </sysinfo>
Nov 08 17:39:47 user nova-compute[74669]:   <os>
Nov 08 17:39:47 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:39:47 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:39:47 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:39:47 user nova-compute[74669]:   </os>
Nov 08 17:39:47 user nova-compute[74669]:   <features>
Nov 08 17:39:47 user nova-compute[74669]:     <acpi/>
Nov 08 17:39:47 user nova-compute[74669]:     <apic/>
Nov 08 17:39:47 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:39:47 user nova-compute[74669]:   </features>
Nov 08 17:39:47 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:39:47 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:39:47 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:39:47 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:39:47 user nova-compute[74669]:   </clock>
Nov 08 17:39:47 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:39:47 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:39:47 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:39:47 user nova-compute[74669]:   </cpu>
Nov 08 17:39:47 user nova-compute[74669]:   <devices>
Nov 08 17:39:47 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 17:39:47 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:39:47 user nova-compute[74669]:       <source dev="/dev/sdb"/>
Nov 08 17:39:47 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:39:47 user nova-compute[74669]:       <serial>a9c0622e-d0da-44e7-bc53-718ad2c1c89b</serial>
Nov 08 17:39:47 user nova-compute[74669]:     </disk>
Nov 08 17:39:47 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:39:47 user nova-compute[74669]:       <mac address="fa:16:3e:3f:9b:08"/>
Nov 08 17:39:47 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:39:47 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:39:47 user nova-compute[74669]:       <target dev="tapec75ccfc-f3"/>
Nov 08 17:39:47 user nova-compute[74669]:     </interface>
Nov 08 17:39:47 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:39:47 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/82cabffe-2794-409f-b797-e7db3046614e/console.log" append="off"/>
Nov 08 17:39:47 user nova-compute[74669]:     </serial>
Nov 08 17:39:47 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:39:47 user nova-compute[74669]:     <video>
Nov 08 17:39:47 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:39:47 user nova-compute[74669]:     </video>
Nov 08 17:39:47 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:39:47 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:39:47 user nova-compute[74669]:     </rng>
Nov 08 17:39:47 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:39:47 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:39:47 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:39:47 user nova-compute[74669]:     </memballoon>
Nov 08 17:39:47 user nova-compute[74669]:   </devices>
Nov 08 17:39:47 user nova-compute[74669]: </domain>
Nov 08 17:39:47 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1948192499',display_name='tempest-TestVolumeBootPattern-server-1948192499',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1948192499',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGSH1tfl+t1f+AoN2/TlyQFqcpvH4dUnBb0qtUp3kmmhEHY7AifIfQPVEX1+0Iv7aAMwriH1/vMPkr9izF41xY+X6NTHXQUsxzNFOO/wJqkiikY/LpDilWqnGkVHaws3Q==',key_name='tempest-TestVolumeBootPattern-1527417449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5be63fa80aa24b1e9c8d84e5f54c4270',ramdisk_id='',reservation_id='r-36dw8aq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-632748264',owner_user_name='tempest-TestVolumeBootPattern-632748264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:39:14Z,user_data=None,user_id='0907ddd682244b7db3c2a10726fffb46',uuid=82cabffe-2794-409f-b797-e7db3046614e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "address": "fa:16:3e:3f:9b:08", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec75ccfc-f3", "ovs_interfaceid": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converting VIF {"id": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "address": "fa:16:3e:3f:9b:08", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec75ccfc-f3", "ovs_interfaceid": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:9b:08,bridge_name='br-int',has_traffic_filtering=True,id=ec75ccfc-f347-4de7-89d7-9e4a2588edd4,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec75ccfc-f3') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG os_vif [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:9b:08,bridge_name='br-int',has_traffic_filtering=True,id=ec75ccfc-f347-4de7-89d7-9e4a2588edd4,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec75ccfc-f3') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0f4b9c0-d970-5fb5-9ce3-768728ff2c37', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec75ccfc-f3, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec75ccfc-f3, col_values=(('qos', UUID('53e6a92d-7656-46f0-95b1-080d18c1e058')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec75ccfc-f3, col_values=(('external_ids', {'iface-id': 'ec75ccfc-f347-4de7-89d7-9e4a2588edd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:9b:08', 'vm-uuid': '82cabffe-2794-409f-b797-e7db3046614e'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:47 user nova-compute[74669]: INFO os_vif [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:9b:08,bridge_name='br-int',has_traffic_filtering=True,id=ec75ccfc-f347-4de7-89d7-9e4a2588edd4,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec75ccfc-f3')
Nov 08 17:39:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:39:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] No VIF found with MAC fa:16:3e:3f:9b:08, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:39:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-ad21da18-d0f8-4d7e-a0c6-9fb87371d30a req-8a5b245f-895e-48d4-ba85-1c3ed5c58862 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Received event network-vif-plugged-ec75ccfc-f347-4de7-89d7-9e4a2588edd4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:39:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ad21da18-d0f8-4d7e-a0c6-9fb87371d30a req-8a5b245f-895e-48d4-ba85-1c3ed5c58862 service nova] Acquiring lock "82cabffe-2794-409f-b797-e7db3046614e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:39:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ad21da18-d0f8-4d7e-a0c6-9fb87371d30a req-8a5b245f-895e-48d4-ba85-1c3ed5c58862 service nova] Lock "82cabffe-2794-409f-b797-e7db3046614e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:39:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ad21da18-d0f8-4d7e-a0c6-9fb87371d30a req-8a5b245f-895e-48d4-ba85-1c3ed5c58862 service nova] Lock "82cabffe-2794-409f-b797-e7db3046614e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:39:48 user nova-compute[74669]: DEBUG nova.compute.manager [req-ad21da18-d0f8-4d7e-a0c6-9fb87371d30a req-8a5b245f-895e-48d4-ba85-1c3ed5c58862 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] No waiting events found dispatching network-vif-plugged-ec75ccfc-f347-4de7-89d7-9e4a2588edd4 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:39:48 user nova-compute[74669]: WARNING nova.compute.manager [req-ad21da18-d0f8-4d7e-a0c6-9fb87371d30a req-8a5b245f-895e-48d4-ba85-1c3ed5c58862 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Received unexpected event network-vif-plugged-ec75ccfc-f347-4de7-89d7-9e4a2588edd4 for instance with vm_state building and task_state spawning.
Nov 08 17:39:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:50 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:39:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:39:50 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Instance spawned successfully.
Nov 08 17:39:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:39:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:39:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:39:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:39:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:39:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:39:50 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:39:50 user nova-compute[74669]: INFO nova.compute.manager [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Took 4.81 seconds to spawn the instance on the hypervisor.
Nov 08 17:39:50 user nova-compute[74669]: DEBUG nova.compute.manager [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:39:50 user nova-compute[74669]: INFO nova.compute.manager [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Took 37.47 seconds to build instance.
Nov 08 17:39:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-ccdf985e-0e32-4981-a34a-2e23a638b96f tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "82cabffe-2794-409f-b797-e7db3046614e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.575s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:39:50 user nova-compute[74669]: DEBUG nova.compute.manager [req-eb1c3eab-58fe-4b19-8881-1ceb8e85ff00 req-71f5c59b-10be-4d76-a19d-7cbbace31bd8 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Received event network-vif-plugged-ec75ccfc-f347-4de7-89d7-9e4a2588edd4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:39:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eb1c3eab-58fe-4b19-8881-1ceb8e85ff00 req-71f5c59b-10be-4d76-a19d-7cbbace31bd8 service nova] Acquiring lock "82cabffe-2794-409f-b797-e7db3046614e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:39:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eb1c3eab-58fe-4b19-8881-1ceb8e85ff00 req-71f5c59b-10be-4d76-a19d-7cbbace31bd8 service nova] Lock "82cabffe-2794-409f-b797-e7db3046614e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:39:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-eb1c3eab-58fe-4b19-8881-1ceb8e85ff00 req-71f5c59b-10be-4d76-a19d-7cbbace31bd8 service nova] Lock "82cabffe-2794-409f-b797-e7db3046614e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:39:50 user nova-compute[74669]: DEBUG nova.compute.manager [req-eb1c3eab-58fe-4b19-8881-1ceb8e85ff00 req-71f5c59b-10be-4d76-a19d-7cbbace31bd8 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] No waiting events found dispatching network-vif-plugged-ec75ccfc-f347-4de7-89d7-9e4a2588edd4 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:39:50 user nova-compute[74669]: WARNING nova.compute.manager [req-eb1c3eab-58fe-4b19-8881-1ceb8e85ff00 req-71f5c59b-10be-4d76-a19d-7cbbace31bd8 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Received unexpected event network-vif-plugged-ec75ccfc-f347-4de7-89d7-9e4a2588edd4 for instance with vm_state active and task_state None.
Nov 08 17:39:51 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:39:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "0796133c-71d6-4d64-94af-49028a6603ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:39:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "0796133c-71d6-4d64-94af-49028a6603ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:39:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "0796133c-71d6-4d64-94af-49028a6603ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:39:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "0796133c-71d6-4d64-94af-49028a6603ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:39:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "0796133c-71d6-4d64-94af-49028a6603ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:39:54 user nova-compute[74669]: INFO nova.compute.manager [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Terminating instance
Nov 08 17:39:54 user nova-compute[74669]: DEBUG nova.compute.manager [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:39:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-6e29cd06-5540-4973-88f7-e879927604dc req-d90946e3-9fbd-401d-90e1-2dd7c712884c service nova] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Received event network-vif-unplugged-1fa691c0-3473-4f34-a504-3778913558ab {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:39:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6e29cd06-5540-4973-88f7-e879927604dc req-d90946e3-9fbd-401d-90e1-2dd7c712884c service nova] Acquiring lock "0796133c-71d6-4d64-94af-49028a6603ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:39:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6e29cd06-5540-4973-88f7-e879927604dc req-d90946e3-9fbd-401d-90e1-2dd7c712884c service nova] Lock "0796133c-71d6-4d64-94af-49028a6603ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:39:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6e29cd06-5540-4973-88f7-e879927604dc req-d90946e3-9fbd-401d-90e1-2dd7c712884c service nova] Lock "0796133c-71d6-4d64-94af-49028a6603ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:39:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-6e29cd06-5540-4973-88f7-e879927604dc req-d90946e3-9fbd-401d-90e1-2dd7c712884c service nova] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] No waiting events found dispatching network-vif-unplugged-1fa691c0-3473-4f34-a504-3778913558ab {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:39:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-6e29cd06-5540-4973-88f7-e879927604dc req-d90946e3-9fbd-401d-90e1-2dd7c712884c service nova] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Received event network-vif-unplugged-1fa691c0-3473-4f34-a504-3778913558ab for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:39:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:55 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Instance destroyed successfully.
Nov 08 17:39:55 user nova-compute[74669]: DEBUG nova.objects.instance [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lazy-loading 'resources' on Instance uuid 0796133c-71d6-4d64-94af-49028a6603ea {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:39:55 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:18:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-191094582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-191094582',id=38,image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:18:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08551815597744d89e3a61d190a9b8a7',ramdisk_id='',reservation_id='r-tjh2dw3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ee6edaa4-6206-44ab-8497-fdbc2291f87f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-293450045',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:20:33Z,user_data=None,user_id='b1fcd1d4cf714f62aa8648b27a04c04e',uuid=0796133c-71d6-4d64-94af-49028a6603ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fa691c0-3473-4f34-a504-3778913558ab", "address": "fa:16:3e:2f:15:d7", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa691c0-34", "ovs_interfaceid": "1fa691c0-3473-4f34-a504-3778913558ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:39:55 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converting VIF {"id": "1fa691c0-3473-4f34-a504-3778913558ab", "address": "fa:16:3e:2f:15:d7", "network": {"id": "3074d9e6-52ba-4a29-971e-5d394119ec9a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1721678367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08551815597744d89e3a61d190a9b8a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fa691c0-34", "ovs_interfaceid": "1fa691c0-3473-4f34-a504-3778913558ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:39:55 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:15:d7,bridge_name='br-int',has_traffic_filtering=True,id=1fa691c0-3473-4f34-a504-3778913558ab,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fa691c0-34') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:39:55 user nova-compute[74669]: DEBUG os_vif [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:15:d7,bridge_name='br-int',has_traffic_filtering=True,id=1fa691c0-3473-4f34-a504-3778913558ab,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fa691c0-34') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:39:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1fa691c0-34, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:39:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:39:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=197b515e-3848-4774-b1a1-efc85721f353) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:39:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:39:55 user nova-compute[74669]: INFO os_vif [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:15:d7,bridge_name='br-int',has_traffic_filtering=True,id=1fa691c0-3473-4f34-a504-3778913558ab,network=Network(3074d9e6-52ba-4a29-971e-5d394119ec9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fa691c0-34')
Nov 08 17:39:55 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Deleting instance files /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea_del
Nov 08 17:39:55 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Deletion of /opt/stack/data/nova/instances/0796133c-71d6-4d64-94af-49028a6603ea_del complete
Nov 08 17:39:55 user nova-compute[74669]: INFO nova.compute.manager [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 08 17:39:55 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:39:55 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:39:55 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:39:55 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:39:55 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Took 0.51 seconds to deallocate network for instance.
Nov 08 17:39:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:39:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:39:55 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:39:55 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:39:55 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:39:56 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Deleted allocations for instance 0796133c-71d6-4d64-94af-49028a6603ea
Nov 08 17:39:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-789f6db6-c6d9-47a1-bf16-12599f391a60 tempest-ServerBootFromVolumeStableRescueTest-293450045 tempest-ServerBootFromVolumeStableRescueTest-293450045-project-member] Lock "0796133c-71d6-4d64-94af-49028a6603ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.782s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:39:56 user nova-compute[74669]: DEBUG nova.compute.manager [req-88646a5c-1f60-4123-a40f-df474222e92c req-789f27af-ffa1-423e-a602-dfcfb9aec907 service nova] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Received event network-vif-plugged-1fa691c0-3473-4f34-a504-3778913558ab {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:39:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-88646a5c-1f60-4123-a40f-df474222e92c req-789f27af-ffa1-423e-a602-dfcfb9aec907 service nova] Acquiring lock "0796133c-71d6-4d64-94af-49028a6603ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:39:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-88646a5c-1f60-4123-a40f-df474222e92c req-789f27af-ffa1-423e-a602-dfcfb9aec907 service nova] Lock "0796133c-71d6-4d64-94af-49028a6603ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:39:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-88646a5c-1f60-4123-a40f-df474222e92c req-789f27af-ffa1-423e-a602-dfcfb9aec907 service nova] Lock "0796133c-71d6-4d64-94af-49028a6603ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:39:56 user nova-compute[74669]: DEBUG nova.compute.manager [req-88646a5c-1f60-4123-a40f-df474222e92c req-789f27af-ffa1-423e-a602-dfcfb9aec907 service nova] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] No waiting events found dispatching network-vif-plugged-1fa691c0-3473-4f34-a504-3778913558ab {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:39:56 user nova-compute[74669]: WARNING nova.compute.manager [req-88646a5c-1f60-4123-a40f-df474222e92c req-789f27af-ffa1-423e-a602-dfcfb9aec907 service nova] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Received unexpected event network-vif-plugged-1fa691c0-3473-4f34-a504-3778913558ab for instance with vm_state deleted and task_state None.
Nov 08 17:39:56 user nova-compute[74669]: DEBUG nova.compute.manager [req-88646a5c-1f60-4123-a40f-df474222e92c req-789f27af-ffa1-423e-a602-dfcfb9aec907 service nova] [instance: 0796133c-71d6-4d64-94af-49028a6603ea] Received event network-vif-deleted-1fa691c0-3473-4f34-a504-3778913558ab {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:40:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:40:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:40:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:40:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:40:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:40:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:40:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:40:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:40:19 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:40:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:40:24 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:40:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:40:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:40:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:40:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:40:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:40:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:40:25 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:40:26 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:40:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:40:30 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:40:30 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:40:30 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 17:40:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:40:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:40:30 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:40:30 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lazy-loading 'info_cache' on Instance uuid 82cabffe-2794-409f-b797-e7db3046614e {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:40:31 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Updating instance_info_cache with network_info: [{"id": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "address": "fa:16:3e:3f:9b:08", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec75ccfc-f3", "ovs_interfaceid": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:40:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:40:31 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:40:31 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:40:31 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:40:31 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:40:32 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:40:32 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:40:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:40:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:40:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:40:32 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:40:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:40:33 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:40:33 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:40:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8919MB free_disk=25.187667846679688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:40:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:40:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:40:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 82cabffe-2794-409f-b797-e7db3046614e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:40:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:40:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:40:33 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:40:33 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:40:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:40:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:40:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:40:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:40:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:40:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:40:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:40:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:40:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:40:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:40:46 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:40:47 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:40:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:40:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:40:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:40:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:40:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:40:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:40:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:04 user nova-compute[74669]: DEBUG nova.compute.manager [req-b91c06ed-ef5a-42a4-a7bf-c05c1c1d7087 req-27af1ca3-a18b-4d71-84d4-400b757f4c86 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Received event network-changed-ec75ccfc-f347-4de7-89d7-9e4a2588edd4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:41:04 user nova-compute[74669]: DEBUG nova.compute.manager [req-b91c06ed-ef5a-42a4-a7bf-c05c1c1d7087 req-27af1ca3-a18b-4d71-84d4-400b757f4c86 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Refreshing instance network info cache due to event network-changed-ec75ccfc-f347-4de7-89d7-9e4a2588edd4. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:41:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b91c06ed-ef5a-42a4-a7bf-c05c1c1d7087 req-27af1ca3-a18b-4d71-84d4-400b757f4c86 service nova] Acquiring lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:41:04 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b91c06ed-ef5a-42a4-a7bf-c05c1c1d7087 req-27af1ca3-a18b-4d71-84d4-400b757f4c86 service nova] Acquired lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:41:04 user nova-compute[74669]: DEBUG nova.network.neutron [req-b91c06ed-ef5a-42a4-a7bf-c05c1c1d7087 req-27af1ca3-a18b-4d71-84d4-400b757f4c86 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Refreshing network info cache for port ec75ccfc-f347-4de7-89d7-9e4a2588edd4 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:41:04 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:04 user nova-compute[74669]: DEBUG nova.network.neutron [req-b91c06ed-ef5a-42a4-a7bf-c05c1c1d7087 req-27af1ca3-a18b-4d71-84d4-400b757f4c86 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Updated VIF entry in instance network info cache for port ec75ccfc-f347-4de7-89d7-9e4a2588edd4. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:41:04 user nova-compute[74669]: DEBUG nova.network.neutron [req-b91c06ed-ef5a-42a4-a7bf-c05c1c1d7087 req-27af1ca3-a18b-4d71-84d4-400b757f4c86 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Updating instance_info_cache with network_info: [{"id": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "address": "fa:16:3e:3f:9b:08", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec75ccfc-f3", "ovs_interfaceid": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:41:05 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b91c06ed-ef5a-42a4-a7bf-c05c1c1d7087 req-27af1ca3-a18b-4d71-84d4-400b757f4c86 service nova] Releasing lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:41:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:21 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "2b5cbcf4-9413-42fe-9dc1-9451a1a43233" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "2b5cbcf4-9413-42fe-9dc1-9451a1a43233" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:41:24 user nova-compute[74669]: INFO nova.compute.claims [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Claim successful on node user
Nov 08 17:41:24 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG nova.network.neutron [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:41:24 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:41:24 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG nova.policy [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0907ddd682244b7db3c2a10726fffb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be63fa80aa24b1e9c8d84e5f54c4270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:41:24 user nova-compute[74669]: INFO nova.virt.block_device [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Booting with volume 0d0c01e7-e551-4114-90e0-0ef2fe69c551 at /dev/vda
Nov 08 17:41:24 user nova-compute[74669]: DEBUG os_brick.utils [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c1ec7a-64fb-4cf0-babc-f00b2bec0e8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6785eb7d-d70b-4736-9450-3ee883dc5300]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef46159-b3fb-4a53-9c39-7d73b98ea314]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f30bb6-bf4f-4a49-b7f5-2701e97d5288]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:41:24 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:41:24 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e4f7a4-7fd6-40f3-b321-ec4b141b67bc]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG os_brick.utils [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:41:24 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Updating existing volume attachment record: 060248d8-0dab-4649-8c5f-0a3fe3e38ef4 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:41:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:25 user nova-compute[74669]: DEBUG nova.network.neutron [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Successfully created port: a6251159-dec3-4c79-aa05-7eceb49c838c {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:41:25 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:41:26 user nova-compute[74669]: DEBUG nova.network.neutron [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Successfully updated port: a6251159-dec3-4c79-aa05-7eceb49c838c {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:41:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "refresh_cache-2b5cbcf4-9413-42fe-9dc1-9451a1a43233" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:41:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquired lock "refresh_cache-2b5cbcf4-9413-42fe-9dc1-9451a1a43233" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:41:26 user nova-compute[74669]: DEBUG nova.network.neutron [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:41:26 user nova-compute[74669]: DEBUG nova.network.neutron [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:41:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-44b004aa-6c6a-40d4-9d82-fb833e27ceee req-f51728d6-d1e7-4025-80cc-6871ccdeddec service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Received event network-changed-a6251159-dec3-4c79-aa05-7eceb49c838c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:41:26 user nova-compute[74669]: DEBUG nova.compute.manager [req-44b004aa-6c6a-40d4-9d82-fb833e27ceee req-f51728d6-d1e7-4025-80cc-6871ccdeddec service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Refreshing instance network info cache due to event network-changed-a6251159-dec3-4c79-aa05-7eceb49c838c. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:41:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-44b004aa-6c6a-40d4-9d82-fb833e27ceee req-f51728d6-d1e7-4025-80cc-6871ccdeddec service nova] Acquiring lock "refresh_cache-2b5cbcf4-9413-42fe-9dc1-9451a1a43233" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:41:26 user nova-compute[74669]: DEBUG nova.network.neutron [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Updating instance_info_cache with network_info: [{"id": "a6251159-dec3-4c79-aa05-7eceb49c838c", "address": "fa:16:3e:32:e3:59", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6251159-de", "ovs_interfaceid": "a6251159-dec3-4c79-aa05-7eceb49c838c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:41:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Releasing lock "refresh_cache-2b5cbcf4-9413-42fe-9dc1-9451a1a43233" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:41:26 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Instance network_info: |[{"id": "a6251159-dec3-4c79-aa05-7eceb49c838c", "address": "fa:16:3e:32:e3:59", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6251159-de", "ovs_interfaceid": "a6251159-dec3-4c79-aa05-7eceb49c838c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:41:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-44b004aa-6c6a-40d4-9d82-fb833e27ceee req-f51728d6-d1e7-4025-80cc-6871ccdeddec service nova] Acquired lock "refresh_cache-2b5cbcf4-9413-42fe-9dc1-9451a1a43233" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:41:26 user nova-compute[74669]: DEBUG nova.network.neutron [req-44b004aa-6c6a-40d4-9d82-fb833e27ceee req-f51728d6-d1e7-4025-80cc-6871ccdeddec service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Refreshing network info cache for port a6251159-dec3-4c79-aa05-7eceb49c838c {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:41:26 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:41:26 user nova-compute[74669]: DEBUG nova.network.neutron [req-44b004aa-6c6a-40d4-9d82-fb833e27ceee req-f51728d6-d1e7-4025-80cc-6871ccdeddec service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Updated VIF entry in instance network info cache for port a6251159-dec3-4c79-aa05-7eceb49c838c. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:41:26 user nova-compute[74669]: DEBUG nova.network.neutron [req-44b004aa-6c6a-40d4-9d82-fb833e27ceee req-f51728d6-d1e7-4025-80cc-6871ccdeddec service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Updating instance_info_cache with network_info: [{"id": "a6251159-dec3-4c79-aa05-7eceb49c838c", "address": "fa:16:3e:32:e3:59", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6251159-de", "ovs_interfaceid": "a6251159-dec3-4c79-aa05-7eceb49c838c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:41:26 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-44b004aa-6c6a-40d4-9d82-fb833e27ceee req-f51728d6-d1e7-4025-80cc-6871ccdeddec service nova] Releasing lock "refresh_cache-2b5cbcf4-9413-42fe-9dc1-9451a1a43233" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:41:27 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:41:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:30 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:41:30 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:41:30 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 17:41:30 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Skipping network cache update for instance because it is Building. {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 08 17:41:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:41:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:41:30 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:41:30 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lazy-loading 'info_cache' on Instance uuid 82cabffe-2794-409f-b797-e7db3046614e {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:41:31 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Updating instance_info_cache with network_info: [{"id": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "address": "fa:16:3e:3f:9b:08", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec75ccfc-f3", "ovs_interfaceid": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:41:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:41:31 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:41:31 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:41:32 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:41:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:41:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:41:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:41:32 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:41:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:41:33 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:41:33 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:41:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8924MB free_disk=25.185535430908203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:41:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:41:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:41:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 82cabffe-2794-409f-b797-e7db3046614e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:41:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2b5cbcf4-9413-42fe-9dc1-9451a1a43233 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:41:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:41:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:41:33 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:41:33 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:41:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:41:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:41:34 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:41:34 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:41:34 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:41:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:41:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:41:47 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Creating image(s)
Nov 08 17:41:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Did not create local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Ensure instance console log exists: /opt/stack/data/nova/instances/2b5cbcf4-9413-42fe-9dc1-9451a1a43233/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Start _get_guest_xml network_info=[{"id": "a6251159-dec3-4c79-aa05-7eceb49c838c", "address": "fa:16:3e:32:e3:59", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6251159-de", "ovs_interfaceid": "a6251159-dec3-4c79-aa05-7eceb49c838c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '060248d8-0dab-4649-8c5f-0a3fe3e38ef4', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'inAlTXdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2b5cbcf4-9413-42fe-9dc1-9451a1a43233', 'attached_at': '', 'detached_at': '', 'volume_id': '0d0c01e7-e551-4114-90e0-0ef2fe69c551', 'serial': '0d0c01e7-e551-4114-90e0-0ef2fe69c551'}, 'guest_format': None, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:41:47 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:41:47 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:41:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'inAlTXdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:41:47 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:41:47 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:41:47 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf74bf2c-008c-4a05-a444-7c5facc15fbf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:41:47 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcfe30e-5403-4bb7-8f05-8635a4aa466e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551] added
Nov 08 17:41:47 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cdd9a5-bbc1-4d7e-a786-3b1429c7068e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[89284aef-6ae4-4c1e-a365-83d552fed53a]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v inAlTXdV {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v inAlTXdV" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9bcbd1-40e3-49bb-a840-8ee310e569e1]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'inAlTXdV'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0d65b4-f58b-4e60-b232-f1576f4694ae]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e1e306-6389-43d7-b579-266a89c687db]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)
Nov 08 17:41:47 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)
Nov 08 17:41:47 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dacd967-0dd0-43fb-8b7d-c7c18841d0a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551, portal: 172.16.0.220,3260]
Nov 08 17:41:47 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551, portal: 172.16.0.220,3260] successful.
Nov 08 17:41:47 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[37477323-b3dd-457b-bb4d-6356c11f89c8]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9066f70b-9a5c-4a56-bc58-56c0c03126e2]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)
Nov 08 17:41:47 user nova-compute[74669]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 (non-flash)
Nov 08 17:41:47 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)
Nov 08 17:41:47 user nova-compute[74669]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 (non-flash)
Nov 08 17:41:47 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6c0abf-0ec8-440d-9348-c945a5ba81b9]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:41:47 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'inAlTXdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26566346661396535', 'path': '/dev/sdc'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566346661396535', 'path': '/dev/sdc'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-180917821',display_name='tempest-TestVolumeBootPattern-server-180917821',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-180917821',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGSH1tfl+t1f+AoN2/TlyQFqcpvH4dUnBb0qtUp3kmmhEHY7AifIfQPVEX1+0Iv7aAMwriH1/vMPkr9izF41xY+X6NTHXQUsxzNFOO/wJqkiikY/LpDilWqnGkVHaws3Q==',key_name='tempest-TestVolumeBootPattern-1527417449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5be63fa80aa24b1e9c8d84e5f54c4270',ramdisk_id='',reservation_id='r-px4t5enp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-632748264',owner_user_name='tempest-TestVolumeBootPattern-632748264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:41:25Z,user_data=None,user_id='0907ddd682244b7db3c2a10726fffb46',uuid=2b5cbcf4-9413-42fe-9dc1-9451a1a43233,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6251159-dec3-4c79-aa05-7eceb49c838c", "address": "fa:16:3e:32:e3:59", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6251159-de", "ovs_interfaceid": "a6251159-dec3-4c79-aa05-7eceb49c838c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converting VIF {"id": "a6251159-dec3-4c79-aa05-7eceb49c838c", "address": "fa:16:3e:32:e3:59", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6251159-de", "ovs_interfaceid": "a6251159-dec3-4c79-aa05-7eceb49c838c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:e3:59,bridge_name='br-int',has_traffic_filtering=True,id=a6251159-dec3-4c79-aa05-7eceb49c838c,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6251159-de') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG nova.objects.instance [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b5cbcf4-9413-42fe-9dc1-9451a1a43233 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:41:48 user nova-compute[74669]:   <uuid>2b5cbcf4-9413-42fe-9dc1-9451a1a43233</uuid>
Nov 08 17:41:48 user nova-compute[74669]:   <name>instance-00000033</name>
Nov 08 17:41:48 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:41:48 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:41:48 user nova-compute[74669]:   <metadata>
Nov 08 17:41:48 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:41:48 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:41:48 user nova-compute[74669]:       <nova:name>tempest-TestVolumeBootPattern-server-180917821</nova:name>
Nov 08 17:41:48 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:41:47</nova:creationTime>
Nov 08 17:41:48 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:41:48 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:41:48 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:41:48 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:41:48 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:41:48 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:41:48 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:41:48 user nova-compute[74669]:       <nova:owner>
Nov 08 17:41:48 user nova-compute[74669]:         <nova:user uuid="0907ddd682244b7db3c2a10726fffb46">tempest-TestVolumeBootPattern-632748264-project-member</nova:user>
Nov 08 17:41:48 user nova-compute[74669]:         <nova:project uuid="5be63fa80aa24b1e9c8d84e5f54c4270">tempest-TestVolumeBootPattern-632748264</nova:project>
Nov 08 17:41:48 user nova-compute[74669]:       </nova:owner>
Nov 08 17:41:48 user nova-compute[74669]:       <nova:ports>
Nov 08 17:41:48 user nova-compute[74669]:         <nova:port uuid="a6251159-dec3-4c79-aa05-7eceb49c838c">
Nov 08 17:41:48 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 17:41:48 user nova-compute[74669]:         </nova:port>
Nov 08 17:41:48 user nova-compute[74669]:       </nova:ports>
Nov 08 17:41:48 user nova-compute[74669]:     </nova:instance>
Nov 08 17:41:48 user nova-compute[74669]:   </metadata>
Nov 08 17:41:48 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:41:48 user nova-compute[74669]:     <system>
Nov 08 17:41:48 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:41:48 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:41:48 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:41:48 user nova-compute[74669]:       <entry name="serial">2b5cbcf4-9413-42fe-9dc1-9451a1a43233</entry>
Nov 08 17:41:48 user nova-compute[74669]:       <entry name="uuid">2b5cbcf4-9413-42fe-9dc1-9451a1a43233</entry>
Nov 08 17:41:48 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:41:48 user nova-compute[74669]:     </system>
Nov 08 17:41:48 user nova-compute[74669]:   </sysinfo>
Nov 08 17:41:48 user nova-compute[74669]:   <os>
Nov 08 17:41:48 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:41:48 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:41:48 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:41:48 user nova-compute[74669]:   </os>
Nov 08 17:41:48 user nova-compute[74669]:   <features>
Nov 08 17:41:48 user nova-compute[74669]:     <acpi/>
Nov 08 17:41:48 user nova-compute[74669]:     <apic/>
Nov 08 17:41:48 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:41:48 user nova-compute[74669]:   </features>
Nov 08 17:41:48 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:41:48 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:41:48 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:41:48 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:41:48 user nova-compute[74669]:   </clock>
Nov 08 17:41:48 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:41:48 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:41:48 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:41:48 user nova-compute[74669]:   </cpu>
Nov 08 17:41:48 user nova-compute[74669]:   <devices>
Nov 08 17:41:48 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 17:41:48 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:41:48 user nova-compute[74669]:       <source dev="/dev/sdc"/>
Nov 08 17:41:48 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:41:48 user nova-compute[74669]:       <serial>0d0c01e7-e551-4114-90e0-0ef2fe69c551</serial>
Nov 08 17:41:48 user nova-compute[74669]:     </disk>
Nov 08 17:41:48 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:41:48 user nova-compute[74669]:       <mac address="fa:16:3e:32:e3:59"/>
Nov 08 17:41:48 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:41:48 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:41:48 user nova-compute[74669]:       <target dev="tapa6251159-de"/>
Nov 08 17:41:48 user nova-compute[74669]:     </interface>
Nov 08 17:41:48 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:41:48 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/2b5cbcf4-9413-42fe-9dc1-9451a1a43233/console.log" append="off"/>
Nov 08 17:41:48 user nova-compute[74669]:     </serial>
Nov 08 17:41:48 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:41:48 user nova-compute[74669]:     <video>
Nov 08 17:41:48 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:41:48 user nova-compute[74669]:     </video>
Nov 08 17:41:48 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:41:48 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:41:48 user nova-compute[74669]:     </rng>
Nov 08 17:41:48 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:41:48 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:41:48 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:41:48 user nova-compute[74669]:     </memballoon>
Nov 08 17:41:48 user nova-compute[74669]:   </devices>
Nov 08 17:41:48 user nova-compute[74669]: </domain>
Nov 08 17:41:48 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-180917821',display_name='tempest-TestVolumeBootPattern-server-180917821',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-180917821',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGSH1tfl+t1f+AoN2/TlyQFqcpvH4dUnBb0qtUp3kmmhEHY7AifIfQPVEX1+0Iv7aAMwriH1/vMPkr9izF41xY+X6NTHXQUsxzNFOO/wJqkiikY/LpDilWqnGkVHaws3Q==',key_name='tempest-TestVolumeBootPattern-1527417449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5be63fa80aa24b1e9c8d84e5f54c4270',ramdisk_id='',reservation_id='r-px4t5enp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-632748264',owner_user_name='tempest-TestVolumeBootPattern-632748264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:41:25Z,user_data=None,user_id='0907ddd682244b7db3c2a10726fffb46',uuid=2b5cbcf4-9413-42fe-9dc1-9451a1a43233,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6251159-dec3-4c79-aa05-7eceb49c838c", "address": "fa:16:3e:32:e3:59", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6251159-de", "ovs_interfaceid": "a6251159-dec3-4c79-aa05-7eceb49c838c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converting VIF {"id": "a6251159-dec3-4c79-aa05-7eceb49c838c", "address": "fa:16:3e:32:e3:59", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6251159-de", "ovs_interfaceid": "a6251159-dec3-4c79-aa05-7eceb49c838c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:e3:59,bridge_name='br-int',has_traffic_filtering=True,id=a6251159-dec3-4c79-aa05-7eceb49c838c,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6251159-de') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG os_vif [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:e3:59,bridge_name='br-int',has_traffic_filtering=True,id=a6251159-dec3-4c79-aa05-7eceb49c838c,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6251159-de') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4c187b2-0a3a-5986-972c-b6e9f52da5ec', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6251159-de, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6251159-de, col_values=(('qos', UUID('0386f8a7-4d6d-45b3-a578-0d759696f4f8')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6251159-de, col_values=(('external_ids', {'iface-id': 'a6251159-dec3-4c79-aa05-7eceb49c838c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:e3:59', 'vm-uuid': '2b5cbcf4-9413-42fe-9dc1-9451a1a43233'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:48 user nova-compute[74669]: INFO os_vif [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:e3:59,bridge_name='br-int',has_traffic_filtering=True,id=a6251159-dec3-4c79-aa05-7eceb49c838c,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6251159-de')
Nov 08 17:41:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:41:48 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] No VIF found with MAC fa:16:3e:32:e3:59, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:41:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:50 user nova-compute[74669]: DEBUG nova.compute.manager [req-9497fb0f-3f27-4dd5-b9d9-04acb2163736 req-605299fa-043e-4d68-a726-a8ed2cee5b4f service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Received event network-vif-plugged-a6251159-dec3-4c79-aa05-7eceb49c838c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:41:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9497fb0f-3f27-4dd5-b9d9-04acb2163736 req-605299fa-043e-4d68-a726-a8ed2cee5b4f service nova] Acquiring lock "2b5cbcf4-9413-42fe-9dc1-9451a1a43233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:41:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9497fb0f-3f27-4dd5-b9d9-04acb2163736 req-605299fa-043e-4d68-a726-a8ed2cee5b4f service nova] Lock "2b5cbcf4-9413-42fe-9dc1-9451a1a43233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:41:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9497fb0f-3f27-4dd5-b9d9-04acb2163736 req-605299fa-043e-4d68-a726-a8ed2cee5b4f service nova] Lock "2b5cbcf4-9413-42fe-9dc1-9451a1a43233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:41:50 user nova-compute[74669]: DEBUG nova.compute.manager [req-9497fb0f-3f27-4dd5-b9d9-04acb2163736 req-605299fa-043e-4d68-a726-a8ed2cee5b4f service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] No waiting events found dispatching network-vif-plugged-a6251159-dec3-4c79-aa05-7eceb49c838c {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:41:50 user nova-compute[74669]: WARNING nova.compute.manager [req-9497fb0f-3f27-4dd5-b9d9-04acb2163736 req-605299fa-043e-4d68-a726-a8ed2cee5b4f service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Received unexpected event network-vif-plugged-a6251159-dec3-4c79-aa05-7eceb49c838c for instance with vm_state building and task_state spawning.
Nov 08 17:41:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:52 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:41:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:41:52 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Instance spawned successfully.
Nov 08 17:41:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:41:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:41:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:41:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:41:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:41:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:41:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:41:52 user nova-compute[74669]: INFO nova.compute.manager [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Took 4.98 seconds to spawn the instance on the hypervisor.
Nov 08 17:41:52 user nova-compute[74669]: DEBUG nova.compute.manager [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:41:52 user nova-compute[74669]: DEBUG nova.compute.manager [req-5dc85ccd-156c-4097-8940-cd4d1563892a req-11d42ec5-da7e-4a7a-9d81-c22bff7b122c service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Received event network-vif-plugged-a6251159-dec3-4c79-aa05-7eceb49c838c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:41:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5dc85ccd-156c-4097-8940-cd4d1563892a req-11d42ec5-da7e-4a7a-9d81-c22bff7b122c service nova] Acquiring lock "2b5cbcf4-9413-42fe-9dc1-9451a1a43233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:41:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5dc85ccd-156c-4097-8940-cd4d1563892a req-11d42ec5-da7e-4a7a-9d81-c22bff7b122c service nova] Lock "2b5cbcf4-9413-42fe-9dc1-9451a1a43233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:41:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5dc85ccd-156c-4097-8940-cd4d1563892a req-11d42ec5-da7e-4a7a-9d81-c22bff7b122c service nova] Lock "2b5cbcf4-9413-42fe-9dc1-9451a1a43233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:41:52 user nova-compute[74669]: DEBUG nova.compute.manager [req-5dc85ccd-156c-4097-8940-cd4d1563892a req-11d42ec5-da7e-4a7a-9d81-c22bff7b122c service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] No waiting events found dispatching network-vif-plugged-a6251159-dec3-4c79-aa05-7eceb49c838c {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:41:52 user nova-compute[74669]: WARNING nova.compute.manager [req-5dc85ccd-156c-4097-8940-cd4d1563892a req-11d42ec5-da7e-4a7a-9d81-c22bff7b122c service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Received unexpected event network-vif-plugged-a6251159-dec3-4c79-aa05-7eceb49c838c for instance with vm_state building and task_state spawning.
Nov 08 17:41:52 user nova-compute[74669]: INFO nova.compute.manager [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Took 28.33 seconds to build instance.
Nov 08 17:41:52 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-e87a5a90-e8e3-4bac-a1f2-cef1a74ec117 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "2b5cbcf4-9413-42fe-9dc1-9451a1a43233" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.440s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:41:52 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:41:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:41:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:42:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:42:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:42:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:42:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:42:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:42:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:42:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:42:20 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:42:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:42:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:42:26 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:42:27 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:42:28 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:42:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:42:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:42:30 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:42:30 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:42:30 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 17:42:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:42:30 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:42:30 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:42:30 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lazy-loading 'info_cache' on Instance uuid 82cabffe-2794-409f-b797-e7db3046614e {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:42:31 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Updating instance_info_cache with network_info: [{"id": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "address": "fa:16:3e:3f:9b:08", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec75ccfc-f3", "ovs_interfaceid": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:42:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:42:31 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:42:32 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:42:32 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:42:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:42:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:42:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:42:32 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:42:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:42:32 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:42:33 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:42:33 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:42:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8774MB free_disk=25.183330535888672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:42:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:42:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:42:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 82cabffe-2794-409f-b797-e7db3046614e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:42:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 2b5cbcf4-9413-42fe-9dc1-9451a1a43233 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:42:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:42:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:42:33 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing inventories for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 17:42:33 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Updating ProviderTree inventory for provider ce26964b-e55b-43d2-801a-7221ff1fe64b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 17:42:33 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Updating inventory in ProviderTree for provider ce26964b-e55b-43d2-801a-7221ff1fe64b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 17:42:33 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing aggregate associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, aggregates: None {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 17:42:33 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing trait associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, traits: HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 17:42:33 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:42:33 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:42:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:42:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.475s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:42:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:42:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:42:35 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:42:35 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:42:35 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:42:38 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:42:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 17:42:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] There are 0 instances to clean {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 17:42:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:42:42 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:42:42 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74669) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 17:42:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:42:44 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:42:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:42:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:42:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:43:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:43:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:43:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:43:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:43:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-9aa51bf0-fb74-440b-b6bf-b0f6f0f747a4 req-1388a0f2-e970-4d02-a742-a8f57a9b1754 service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Received event network-changed-a6251159-dec3-4c79-aa05-7eceb49c838c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:43:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-9aa51bf0-fb74-440b-b6bf-b0f6f0f747a4 req-1388a0f2-e970-4d02-a742-a8f57a9b1754 service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Refreshing instance network info cache due to event network-changed-a6251159-dec3-4c79-aa05-7eceb49c838c. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:43:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9aa51bf0-fb74-440b-b6bf-b0f6f0f747a4 req-1388a0f2-e970-4d02-a742-a8f57a9b1754 service nova] Acquiring lock "refresh_cache-2b5cbcf4-9413-42fe-9dc1-9451a1a43233" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:43:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9aa51bf0-fb74-440b-b6bf-b0f6f0f747a4 req-1388a0f2-e970-4d02-a742-a8f57a9b1754 service nova] Acquired lock "refresh_cache-2b5cbcf4-9413-42fe-9dc1-9451a1a43233" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:43:15 user nova-compute[74669]: DEBUG nova.network.neutron [req-9aa51bf0-fb74-440b-b6bf-b0f6f0f747a4 req-1388a0f2-e970-4d02-a742-a8f57a9b1754 service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Refreshing network info cache for port a6251159-dec3-4c79-aa05-7eceb49c838c {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:43:16 user nova-compute[74669]: DEBUG nova.network.neutron [req-9aa51bf0-fb74-440b-b6bf-b0f6f0f747a4 req-1388a0f2-e970-4d02-a742-a8f57a9b1754 service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Updated VIF entry in instance network info cache for port a6251159-dec3-4c79-aa05-7eceb49c838c. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:43:16 user nova-compute[74669]: DEBUG nova.network.neutron [req-9aa51bf0-fb74-440b-b6bf-b0f6f0f747a4 req-1388a0f2-e970-4d02-a742-a8f57a9b1754 service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Updating instance_info_cache with network_info: [{"id": "a6251159-dec3-4c79-aa05-7eceb49c838c", "address": "fa:16:3e:32:e3:59", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6251159-de", "ovs_interfaceid": "a6251159-dec3-4c79-aa05-7eceb49c838c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:43:16 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9aa51bf0-fb74-440b-b6bf-b0f6f0f747a4 req-1388a0f2-e970-4d02-a742-a8f57a9b1754 service nova] Releasing lock "refresh_cache-2b5cbcf4-9413-42fe-9dc1-9451a1a43233" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:43:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "2b5cbcf4-9413-42fe-9dc1-9451a1a43233" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:43:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "2b5cbcf4-9413-42fe-9dc1-9451a1a43233" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:43:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "2b5cbcf4-9413-42fe-9dc1-9451a1a43233-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:43:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "2b5cbcf4-9413-42fe-9dc1-9451a1a43233-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:43:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "2b5cbcf4-9413-42fe-9dc1-9451a1a43233-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:43:17 user nova-compute[74669]: INFO nova.compute.manager [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Terminating instance
Nov 08 17:43:17 user nova-compute[74669]: DEBUG nova.compute.manager [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:43:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:43:17 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:43:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-8670579a-7119-411d-a268-a7a5297ea98a req-2a0f1f5c-4489-4b49-8660-ca672c82866e service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Received event network-changed-a6251159-dec3-4c79-aa05-7eceb49c838c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:43:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-8670579a-7119-411d-a268-a7a5297ea98a req-2a0f1f5c-4489-4b49-8660-ca672c82866e service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Refreshing instance network info cache due to event network-changed-a6251159-dec3-4c79-aa05-7eceb49c838c. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:43:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8670579a-7119-411d-a268-a7a5297ea98a req-2a0f1f5c-4489-4b49-8660-ca672c82866e service nova] Acquiring lock "refresh_cache-2b5cbcf4-9413-42fe-9dc1-9451a1a43233" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:43:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8670579a-7119-411d-a268-a7a5297ea98a req-2a0f1f5c-4489-4b49-8660-ca672c82866e service nova] Acquired lock "refresh_cache-2b5cbcf4-9413-42fe-9dc1-9451a1a43233" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:43:17 user nova-compute[74669]: DEBUG nova.network.neutron [req-8670579a-7119-411d-a268-a7a5297ea98a req-2a0f1f5c-4489-4b49-8660-ca672c82866e service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Refreshing network info cache for port a6251159-dec3-4c79-aa05-7eceb49c838c {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:43:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-6f0fd42e-55f1-419d-9d20-bbab69cde2f5 req-0d4110e8-22ba-43fe-95b0-07a9e3ac5459 service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Received event network-vif-unplugged-a6251159-dec3-4c79-aa05-7eceb49c838c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:43:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6f0fd42e-55f1-419d-9d20-bbab69cde2f5 req-0d4110e8-22ba-43fe-95b0-07a9e3ac5459 service nova] Acquiring lock "2b5cbcf4-9413-42fe-9dc1-9451a1a43233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:43:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6f0fd42e-55f1-419d-9d20-bbab69cde2f5 req-0d4110e8-22ba-43fe-95b0-07a9e3ac5459 service nova] Lock "2b5cbcf4-9413-42fe-9dc1-9451a1a43233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:43:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-6f0fd42e-55f1-419d-9d20-bbab69cde2f5 req-0d4110e8-22ba-43fe-95b0-07a9e3ac5459 service nova] Lock "2b5cbcf4-9413-42fe-9dc1-9451a1a43233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:43:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-6f0fd42e-55f1-419d-9d20-bbab69cde2f5 req-0d4110e8-22ba-43fe-95b0-07a9e3ac5459 service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] No waiting events found dispatching network-vif-unplugged-a6251159-dec3-4c79-aa05-7eceb49c838c {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:43:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-6f0fd42e-55f1-419d-9d20-bbab69cde2f5 req-0d4110e8-22ba-43fe-95b0-07a9e3ac5459 service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Received event network-vif-unplugged-a6251159-dec3-4c79-aa05-7eceb49c838c for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG nova.network.neutron [req-8670579a-7119-411d-a268-a7a5297ea98a req-2a0f1f5c-4489-4b49-8660-ca672c82866e service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Updated VIF entry in instance network info cache for port a6251159-dec3-4c79-aa05-7eceb49c838c. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG nova.network.neutron [req-8670579a-7119-411d-a268-a7a5297ea98a req-2a0f1f5c-4489-4b49-8660-ca672c82866e service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Updating instance_info_cache with network_info: [{"id": "a6251159-dec3-4c79-aa05-7eceb49c838c", "address": "fa:16:3e:32:e3:59", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6251159-de", "ovs_interfaceid": "a6251159-dec3-4c79-aa05-7eceb49c838c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-8670579a-7119-411d-a268-a7a5297ea98a req-2a0f1f5c-4489-4b49-8660-ca672c82866e service nova] Releasing lock "refresh_cache-2b5cbcf4-9413-42fe-9dc1-9451a1a43233" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:43:18 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Instance destroyed successfully.
Nov 08 17:43:18 user nova-compute[74669]: DEBUG nova.objects.instance [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lazy-loading 'resources' on Instance uuid 2b5cbcf4-9413-42fe-9dc1-9451a1a43233 {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:41:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-180917821',display_name='tempest-TestVolumeBootPattern-server-180917821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-180917821',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGSH1tfl+t1f+AoN2/TlyQFqcpvH4dUnBb0qtUp3kmmhEHY7AifIfQPVEX1+0Iv7aAMwriH1/vMPkr9izF41xY+X6NTHXQUsxzNFOO/wJqkiikY/LpDilWqnGkVHaws3Q==',key_name='tempest-TestVolumeBootPattern-1527417449',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:41:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5be63fa80aa24b1e9c8d84e5f54c4270',ramdisk_id='',reservation_id='r-px4t5enp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-632748264',owner_user_name='tempest-TestVolumeBootPattern-632748264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:41:52Z,user_data=None,user_id='0907ddd682244b7db3c2a10726fffb46',uuid=2b5cbcf4-9413-42fe-9dc1-9451a1a43233,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6251159-dec3-4c79-aa05-7eceb49c838c", "address": "fa:16:3e:32:e3:59", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6251159-de", "ovs_interfaceid": "a6251159-dec3-4c79-aa05-7eceb49c838c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converting VIF {"id": "a6251159-dec3-4c79-aa05-7eceb49c838c", "address": "fa:16:3e:32:e3:59", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6251159-de", "ovs_interfaceid": "a6251159-dec3-4c79-aa05-7eceb49c838c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:e3:59,bridge_name='br-int',has_traffic_filtering=True,id=a6251159-dec3-4c79-aa05-7eceb49c838c,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6251159-de') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG os_vif [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:e3:59,bridge_name='br-int',has_traffic_filtering=True,id=a6251159-dec3-4c79-aa05-7eceb49c838c,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6251159-de') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6251159-de, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0386f8a7-4d6d-45b3-a578-0d759696f4f8) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:43:18 user nova-compute[74669]: INFO os_vif [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:e3:59,bridge_name='br-int',has_traffic_filtering=True,id=a6251159-dec3-4c79-aa05-7eceb49c838c,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6251159-de')
Nov 08 17:43:18 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'inAlTXdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:43:18 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:43:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[53430e8b-788c-481e-97c8-71609960fab3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:43:18 user nova-compute[74669]: No targets found.
Nov 08 17:43:18 user nova-compute[74669]: iSNS:
Nov 08 17:43:18 user nova-compute[74669]: No targets found.
Nov 08 17:43:18 user nova-compute[74669]: STATIC:
Nov 08 17:43:18 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551
Nov 08 17:43:18 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:43:18 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:43:18 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b
Nov 08 17:43:18 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:43:18 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:43:18 user nova-compute[74669]: FIRMWARE:
Nov 08 17:43:18 user nova-compute[74669]: No targets found.
Nov 08 17:43:18 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:43:18 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:43:18 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7576ffc-1b69-475a-88a2-c742268d5995]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab34f4b-1842-4c32-b1df-9cba7ac8014e]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)
Nov 08 17:43:18 user nova-compute[74669]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 (non-flash)
Nov 08 17:43:18 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)
Nov 08 17:43:18 user nova-compute[74669]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 (non-flash)
Nov 08 17:43:18 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd984370790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551'): ({'sdc'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Removing single pathed devices sdc {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff59816-3c16-4ef8-bd37-56ea5fd6c9b8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d22ff1b-5535-4dd4-89a2-9eda12d3609c]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Flushing IO for device /dev/sdc {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68f2570-0243-49d5-838a-9504141816e4]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b179f6-7886-4cb9-ba6b-a35fa60cfa5e]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] SCSI volumes sdc have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_bde2a357',) {{(pid=86107) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a940e7b-79a3-469d-a070-98cc77bde3db]: (4, None) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[c774db16-a282-4718-a352-0d845a39d68e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99c5b02-73c5-48c9-9194-3c4ac2f569aa]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551, portal: 172.16.0.220,3260]
Nov 08 17:43:18 user nova-compute[74669]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551, portal: 172.16.0.220,3260] successful.
Nov 08 17:43:18 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d0c01e7-e551-4114-90e0-0ef2fe69c551 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb2c259-1561-4b6f-a83f-fade29078326]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] <== disconnect_volume: return (314ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:43:18 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Deleting instance files /opt/stack/data/nova/instances/2b5cbcf4-9413-42fe-9dc1-9451a1a43233_del
Nov 08 17:43:18 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Deletion of /opt/stack/data/nova/instances/2b5cbcf4-9413-42fe-9dc1-9451a1a43233_del complete
Nov 08 17:43:18 user nova-compute[74669]: INFO nova.compute.manager [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 08 17:43:18 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:43:18 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:43:19 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:43:19 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Took 0.44 seconds to deallocate network for instance.
Nov 08 17:43:19 user nova-compute[74669]: DEBUG nova.compute.manager [req-63c34239-4030-44aa-a605-aaed4f360e4a req-b98ceec6-ff5b-42dc-b295-278fd908e5c6 service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Received event network-vif-deleted-a6251159-dec3-4c79-aa05-7eceb49c838c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:43:19 user nova-compute[74669]: INFO nova.compute.manager [req-63c34239-4030-44aa-a605-aaed4f360e4a req-b98ceec6-ff5b-42dc-b295-278fd908e5c6 service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Neutron deleted interface a6251159-dec3-4c79-aa05-7eceb49c838c; detaching it from the instance and deleting it from the info cache
Nov 08 17:43:19 user nova-compute[74669]: DEBUG nova.network.neutron [req-63c34239-4030-44aa-a605-aaed4f360e4a req-b98ceec6-ff5b-42dc-b295-278fd908e5c6 service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:43:19 user nova-compute[74669]: DEBUG nova.compute.manager [req-63c34239-4030-44aa-a605-aaed4f360e4a req-b98ceec6-ff5b-42dc-b295-278fd908e5c6 service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Detach interface failed, port_id=a6251159-dec3-4c79-aa05-7eceb49c838c, reason: Instance 2b5cbcf4-9413-42fe-9dc1-9451a1a43233 could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 17:43:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:43:20 user nova-compute[74669]: DEBUG nova.compute.manager [req-70e50289-e197-4093-ab7d-ff7605724c80 req-9637f5a1-776d-432f-a96b-87e68be89daf service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Received event network-vif-plugged-a6251159-dec3-4c79-aa05-7eceb49c838c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:43:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-70e50289-e197-4093-ab7d-ff7605724c80 req-9637f5a1-776d-432f-a96b-87e68be89daf service nova] Acquiring lock "2b5cbcf4-9413-42fe-9dc1-9451a1a43233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:43:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-70e50289-e197-4093-ab7d-ff7605724c80 req-9637f5a1-776d-432f-a96b-87e68be89daf service nova] Lock "2b5cbcf4-9413-42fe-9dc1-9451a1a43233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:43:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-70e50289-e197-4093-ab7d-ff7605724c80 req-9637f5a1-776d-432f-a96b-87e68be89daf service nova] Lock "2b5cbcf4-9413-42fe-9dc1-9451a1a43233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:43:20 user nova-compute[74669]: DEBUG nova.compute.manager [req-70e50289-e197-4093-ab7d-ff7605724c80 req-9637f5a1-776d-432f-a96b-87e68be89daf service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] No waiting events found dispatching network-vif-plugged-a6251159-dec3-4c79-aa05-7eceb49c838c {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:43:20 user nova-compute[74669]: WARNING nova.compute.manager [req-70e50289-e197-4093-ab7d-ff7605724c80 req-9637f5a1-776d-432f-a96b-87e68be89daf service nova] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Received unexpected event network-vif-plugged-a6251159-dec3-4c79-aa05-7eceb49c838c for instance with vm_state active and task_state deleting.
Nov 08 17:43:20 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:43:23 user nova-compute[74669]: INFO nova.compute.manager [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 2b5cbcf4-9413-42fe-9dc1-9451a1a43233] Took 3.66 seconds to detach 1 volumes for instance.
Nov 08 17:43:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:43:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:43:23 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:43:23 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:43:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:43:23 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Deleted allocations for instance 2b5cbcf4-9413-42fe-9dc1-9451a1a43233
Nov 08 17:43:23 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-dc198d14-6019-46b8-b8c0-3c246b3b4421 tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "2b5cbcf4-9413-42fe-9dc1-9451a1a43233" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.614s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:43:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:43:26 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:43:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:43:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:43:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:43:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:43:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:43:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:43:28 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:43:29 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:43:31 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:43:31 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:43:31 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Didn't find any instances for network info cache update. {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 17:43:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:43:33 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:43:33 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:43:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:43:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:43:33 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:43:33 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:43:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:43:34 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:43:34 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:43:34 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8902MB free_disk=25.181835174560547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:43:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:43:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:43:34 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 82cabffe-2794-409f-b797-e7db3046614e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:43:34 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:43:34 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:43:34 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:43:34 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:43:34 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:43:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:43:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:43:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:43:36 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:43:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:43:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:43:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:43:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:43:53 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:43:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:44:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:44:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:44:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:44:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:44:20 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:44:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:44:27 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:44:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:44:28 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:44:29 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:44:31 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:44:31 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:44:31 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 17:44:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:44:31 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:44:31 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:44:31 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lazy-loading 'info_cache' on Instance uuid 82cabffe-2794-409f-b797-e7db3046614e {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG nova.compute.manager [req-d3a23257-126b-43a6-82c2-b7df7ec1ed38 req-6b4d0261-387b-428e-a56f-d87a6ef80435 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Received event network-changed-ec75ccfc-f347-4de7-89d7-9e4a2588edd4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG nova.compute.manager [req-d3a23257-126b-43a6-82c2-b7df7ec1ed38 req-6b4d0261-387b-428e-a56f-d87a6ef80435 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Refreshing instance network info cache due to event network-changed-ec75ccfc-f347-4de7-89d7-9e4a2588edd4. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d3a23257-126b-43a6-82c2-b7df7ec1ed38 req-6b4d0261-387b-428e-a56f-d87a6ef80435 service nova] Acquiring lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Updating instance_info_cache with network_info: [{"id": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "address": "fa:16:3e:3f:9b:08", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec75ccfc-f3", "ovs_interfaceid": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "82cabffe-2794-409f-b797-e7db3046614e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "82cabffe-2794-409f-b797-e7db3046614e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "82cabffe-2794-409f-b797-e7db3046614e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "82cabffe-2794-409f-b797-e7db3046614e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "82cabffe-2794-409f-b797-e7db3046614e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d3a23257-126b-43a6-82c2-b7df7ec1ed38 req-6b4d0261-387b-428e-a56f-d87a6ef80435 service nova] Acquired lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG nova.network.neutron [req-d3a23257-126b-43a6-82c2-b7df7ec1ed38 req-6b4d0261-387b-428e-a56f-d87a6ef80435 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Refreshing network info cache for port ec75ccfc-f347-4de7-89d7-9e4a2588edd4 {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:44:32 user nova-compute[74669]: INFO nova.compute.manager [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Terminating instance
Nov 08 17:44:32 user nova-compute[74669]: DEBUG nova.compute.manager [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG nova.compute.manager [req-0e2f64fa-6e7a-43a1-85cc-0473abb1f535 req-2db70cc5-be53-4916-a6c9-65bbb400c500 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Received event network-vif-unplugged-ec75ccfc-f347-4de7-89d7-9e4a2588edd4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0e2f64fa-6e7a-43a1-85cc-0473abb1f535 req-2db70cc5-be53-4916-a6c9-65bbb400c500 service nova] Acquiring lock "82cabffe-2794-409f-b797-e7db3046614e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0e2f64fa-6e7a-43a1-85cc-0473abb1f535 req-2db70cc5-be53-4916-a6c9-65bbb400c500 service nova] Lock "82cabffe-2794-409f-b797-e7db3046614e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-0e2f64fa-6e7a-43a1-85cc-0473abb1f535 req-2db70cc5-be53-4916-a6c9-65bbb400c500 service nova] Lock "82cabffe-2794-409f-b797-e7db3046614e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG nova.compute.manager [req-0e2f64fa-6e7a-43a1-85cc-0473abb1f535 req-2db70cc5-be53-4916-a6c9-65bbb400c500 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] No waiting events found dispatching network-vif-unplugged-ec75ccfc-f347-4de7-89d7-9e4a2588edd4 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG nova.compute.manager [req-0e2f64fa-6e7a-43a1-85cc-0473abb1f535 req-2db70cc5-be53-4916-a6c9-65bbb400c500 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Received event network-vif-unplugged-ec75ccfc-f347-4de7-89d7-9e4a2588edd4 for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG nova.network.neutron [req-d3a23257-126b-43a6-82c2-b7df7ec1ed38 req-6b4d0261-387b-428e-a56f-d87a6ef80435 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Updated VIF entry in instance network info cache for port ec75ccfc-f347-4de7-89d7-9e4a2588edd4. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG nova.network.neutron [req-d3a23257-126b-43a6-82c2-b7df7ec1ed38 req-6b4d0261-387b-428e-a56f-d87a6ef80435 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Updating instance_info_cache with network_info: [{"id": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "address": "fa:16:3e:3f:9b:08", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec75ccfc-f3", "ovs_interfaceid": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:44:32 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-d3a23257-126b-43a6-82c2-b7df7ec1ed38 req-6b4d0261-387b-428e-a56f-d87a6ef80435 service nova] Releasing lock "refresh_cache-82cabffe-2794-409f-b797-e7db3046614e" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:44:33 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Instance destroyed successfully.
Nov 08 17:44:33 user nova-compute[74669]: DEBUG nova.objects.instance [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lazy-loading 'resources' on Instance uuid 82cabffe-2794-409f-b797-e7db3046614e {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:39:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1948192499',display_name='tempest-TestVolumeBootPattern-server-1948192499',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1948192499',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGSH1tfl+t1f+AoN2/TlyQFqcpvH4dUnBb0qtUp3kmmhEHY7AifIfQPVEX1+0Iv7aAMwriH1/vMPkr9izF41xY+X6NTHXQUsxzNFOO/wJqkiikY/LpDilWqnGkVHaws3Q==',key_name='tempest-TestVolumeBootPattern-1527417449',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:39:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5be63fa80aa24b1e9c8d84e5f54c4270',ramdisk_id='',reservation_id='r-36dw8aq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-632748264',owner_user_name='tempest-TestVolumeBootPattern-632748264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:39:51Z,user_data=None,user_id='0907ddd682244b7db3c2a10726fffb46',uuid=82cabffe-2794-409f-b797-e7db3046614e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "address": "fa:16:3e:3f:9b:08", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec75ccfc-f3", "ovs_interfaceid": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converting VIF {"id": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "address": "fa:16:3e:3f:9b:08", "network": {"id": "afb781a1-f6a2-48ac-8131-013f56e070a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1124554642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5be63fa80aa24b1e9c8d84e5f54c4270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec75ccfc-f3", "ovs_interfaceid": "ec75ccfc-f347-4de7-89d7-9e4a2588edd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:9b:08,bridge_name='br-int',has_traffic_filtering=True,id=ec75ccfc-f347-4de7-89d7-9e4a2588edd4,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec75ccfc-f3') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG os_vif [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:9b:08,bridge_name='br-int',has_traffic_filtering=True,id=ec75ccfc-f347-4de7-89d7-9e4a2588edd4,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec75ccfc-f3') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec75ccfc-f3, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53e6a92d-7656-46f0-95b1-080d18c1e058) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:44:33 user nova-compute[74669]: INFO os_vif [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:9b:08,bridge_name='br-int',has_traffic_filtering=True,id=ec75ccfc-f347-4de7-89d7-9e4a2588edd4,network=Network(afb781a1-f6a2-48ac-8131-013f56e070a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec75ccfc-f3')
Nov 08 17:44:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imFMhLHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:44:33 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:44:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[00848015-6f33-4378-ae34-1d3b6afd0020]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:44:33 user nova-compute[74669]: No targets found.
Nov 08 17:44:33 user nova-compute[74669]: iSNS:
Nov 08 17:44:33 user nova-compute[74669]: No targets found.
Nov 08 17:44:33 user nova-compute[74669]: STATIC:
Nov 08 17:44:33 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b
Nov 08 17:44:33 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:44:33 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:44:33 user nova-compute[74669]: FIRMWARE:
Nov 08 17:44:33 user nova-compute[74669]: No targets found.
Nov 08 17:44:33 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:44:33 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:44:33 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5472130b-00f6-4cc0-8d45-75b89d975537]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c5976b-599b-44fa-bbde-acf5ea8ecd95]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)
Nov 08 17:44:33 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b (non-flash)
Nov 08 17:44:33 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd984690550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b'): ({'sdb'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Removing single pathed devices sdb {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[186b4056-7b84-4d1a-b828-175040e52210]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6f0b32-d031-4397-b5d7-0e2c286671f2]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Flushing IO for device /dev/sdb {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6b756b-87d3-49ce-993e-a9e89a958b5e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7f9612-b1d7-4206-bbe3-e5f0f06f60cb]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_aae2e32b', '/dev/disk/by-id/scsi-1SCST_BIOaae2e32b-aa926c61afbf7b97', '/dev/disk/by-id/scsi-26161393236633631') {{(pid=86107) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[397a5cdb-526c-48e4-a576-e25a66ad381e]: (4, None) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[634be6ef-340f-49f6-b6ae-ba2a33a77759]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c2747e-59de-47fc-bb61-e890de653b2d]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b, portal: 172.16.0.220,3260]
Nov 08 17:44:33 user nova-compute[74669]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b, portal: 172.16.0.220,3260] successful.
Nov 08 17:44:33 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9c0622e-d0da-44e7-bc53-718ad2c1c89b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48fe20f-9552-4e43-b504-f30900b19454]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] <== disconnect_volume: return (317ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:44:33 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Deleting instance files /opt/stack/data/nova/instances/82cabffe-2794-409f-b797-e7db3046614e_del
Nov 08 17:44:33 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Deletion of /opt/stack/data/nova/instances/82cabffe-2794-409f-b797-e7db3046614e_del complete
Nov 08 17:44:33 user nova-compute[74669]: INFO nova.compute.manager [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 82cabffe-2794-409f-b797-e7db3046614e] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:44:33 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Took 0.38 seconds to deallocate network for instance.
Nov 08 17:44:33 user nova-compute[74669]: DEBUG nova.compute.manager [req-69614f05-a35e-465a-94b6-50117706a188 req-2cc0ad6a-6b64-453c-a4dc-77280c5875ab service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Received event network-vif-deleted-ec75ccfc-f347-4de7-89d7-9e4a2588edd4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:44:33 user nova-compute[74669]: INFO nova.compute.manager [req-69614f05-a35e-465a-94b6-50117706a188 req-2cc0ad6a-6b64-453c-a4dc-77280c5875ab service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Neutron deleted interface ec75ccfc-f347-4de7-89d7-9e4a2588edd4; detaching it from the instance and deleting it from the info cache
Nov 08 17:44:33 user nova-compute[74669]: DEBUG nova.network.neutron [req-69614f05-a35e-465a-94b6-50117706a188 req-2cc0ad6a-6b64-453c-a4dc-77280c5875ab service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:44:33 user nova-compute[74669]: DEBUG nova.compute.manager [req-69614f05-a35e-465a-94b6-50117706a188 req-2cc0ad6a-6b64-453c-a4dc-77280c5875ab service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Detach interface failed, port_id=ec75ccfc-f347-4de7-89d7-9e4a2588edd4, reason: Instance 82cabffe-2794-409f-b797-e7db3046614e could not be found. {{(pid=74669) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 17:44:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-2fc62f32-8f3a-41f9-ba6d-5f3ffe98a2a8 req-edc6fb37-9c42-4df1-b192-334e61740421 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Received event network-vif-plugged-ec75ccfc-f347-4de7-89d7-9e4a2588edd4 {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:44:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2fc62f32-8f3a-41f9-ba6d-5f3ffe98a2a8 req-edc6fb37-9c42-4df1-b192-334e61740421 service nova] Acquiring lock "82cabffe-2794-409f-b797-e7db3046614e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:44:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2fc62f32-8f3a-41f9-ba6d-5f3ffe98a2a8 req-edc6fb37-9c42-4df1-b192-334e61740421 service nova] Lock "82cabffe-2794-409f-b797-e7db3046614e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:44:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2fc62f32-8f3a-41f9-ba6d-5f3ffe98a2a8 req-edc6fb37-9c42-4df1-b192-334e61740421 service nova] Lock "82cabffe-2794-409f-b797-e7db3046614e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:44:34 user nova-compute[74669]: DEBUG nova.compute.manager [req-2fc62f32-8f3a-41f9-ba6d-5f3ffe98a2a8 req-edc6fb37-9c42-4df1-b192-334e61740421 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] No waiting events found dispatching network-vif-plugged-ec75ccfc-f347-4de7-89d7-9e4a2588edd4 {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:44:34 user nova-compute[74669]: WARNING nova.compute.manager [req-2fc62f32-8f3a-41f9-ba6d-5f3ffe98a2a8 req-edc6fb37-9c42-4df1-b192-334e61740421 service nova] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Received unexpected event network-vif-plugged-ec75ccfc-f347-4de7-89d7-9e4a2588edd4 for instance with vm_state active and task_state deleting.
Nov 08 17:44:34 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:44:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:44:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:44:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:44:34 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:44:35 user nova-compute[74669]: INFO nova.compute.manager [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] [instance: 82cabffe-2794-409f-b797-e7db3046614e] Took 1.19 seconds to detach 1 volumes for instance.
Nov 08 17:44:35 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:44:35 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:44:35 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=9029MB free_disk=25.18010711669922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:44:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:44:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:44:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:44:35 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 82cabffe-2794-409f-b797-e7db3046614e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:44:35 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:44:35 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:44:35 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:44:35 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:44:35 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:44:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.350s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:44:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.297s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:44:35 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:44:35 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:44:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:44:35 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Deleted allocations for instance 82cabffe-2794-409f-b797-e7db3046614e
Nov 08 17:44:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-9ef43185-0c9d-4c06-97c2-f735eab8fcda tempest-TestVolumeBootPattern-632748264 tempest-TestVolumeBootPattern-632748264-project-member] Lock "82cabffe-2794-409f-b797-e7db3046614e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.350s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:44:36 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:44:36 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:44:37 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:44:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:44:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:44:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:44:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:44:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:45:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:45:16 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:21 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:21 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:45:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:27 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:45:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:28 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:45:29 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:29 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:45:32 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:45:32 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:45:32 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 17:45:32 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Didn't find any instances for network info cache update. {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 17:45:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:35 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:45:35 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:45:35 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:45:35 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:45:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:45:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:45:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:45:35 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:45:36 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:45:36 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:45:36 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=9050MB free_disk=25.169601440429688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:45:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:45:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:45:36 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:45:36 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:45:36 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:45:36 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:45:36 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:45:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:45:37 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:39 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:45:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquiring lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:45:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:45:44 user nova-compute[74669]: DEBUG nova.compute.manager [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Starting instance... {{(pid=74669) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 17:45:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:45:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:45:44 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:45:44 user nova-compute[74669]: INFO nova.compute.claims [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Claim successful on node user
Nov 08 17:45:44 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:45:44 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:45:44 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.249s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:45:44 user nova-compute[74669]: DEBUG nova.compute.manager [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Start building networks asynchronously for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 17:45:44 user nova-compute[74669]: DEBUG nova.compute.manager [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Allocating IP information in the background. {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 17:45:44 user nova-compute[74669]: DEBUG nova.network.neutron [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] allocate_for_instance() {{(pid=74669) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 17:45:44 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 17:45:44 user nova-compute[74669]: DEBUG nova.compute.manager [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Start building block device mappings for instance. {{(pid=74669) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 17:45:45 user nova-compute[74669]: INFO nova.virt.block_device [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Booting with volume ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 at /dev/vda
Nov 08 17:45:45 user nova-compute[74669]: DEBUG nova.policy [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8e663b1b12d425d81aec27d1f10bcfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd40c24d61fa4ef6a44ce175d23b6a4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74669) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 17:45:45 user nova-compute[74669]: DEBUG os_brick.utils [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:45:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:45:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:45:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[018b2668-548a-4428-bf71-ffa19468ea88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:45:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:45:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:45:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8204329-4b59-4218-b607-51b7bcb8b7ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:45:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:45:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:45:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[54aab66d-e0b1-40f4-a080-f2a2d2b9a41c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:45:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a33513-5b0a-4a5d-a9c9-c46e6ea0dbd6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:45:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:45:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:45:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:45:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:45:45 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:45:45 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:45:45 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e62a31b-b74b-483d-9abb-6e76f0970bc3]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:45:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:45:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:45:45 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:45:45 user nova-compute[74669]: DEBUG os_brick.utils [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:45:45 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updating existing volume attachment record: 18b9d4c0-cedf-499c-a126-680ab1219700 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:45:46 user nova-compute[74669]: DEBUG nova.network.neutron [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Successfully created port: 4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 17:45:47 user nova-compute[74669]: DEBUG nova.network.neutron [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Successfully updated port: 4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 17:45:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquiring lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:45:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquired lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:45:47 user nova-compute[74669]: DEBUG nova.network.neutron [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:45:47 user nova-compute[74669]: DEBUG nova.network.neutron [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Instance cache missing network info. {{(pid=74669) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 17:45:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-c0ba3b2f-c905-4537-b62b-e2b473fc0d11 req-abc91644-729c-47b9-8cc1-5428f8a2fdbd service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Received event network-changed-4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:45:47 user nova-compute[74669]: DEBUG nova.compute.manager [req-c0ba3b2f-c905-4537-b62b-e2b473fc0d11 req-abc91644-729c-47b9-8cc1-5428f8a2fdbd service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Refreshing instance network info cache due to event network-changed-4cac36e0-dcd3-4da6-bafb-67426abb9e5c. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:45:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c0ba3b2f-c905-4537-b62b-e2b473fc0d11 req-abc91644-729c-47b9-8cc1-5428f8a2fdbd service nova] Acquiring lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:45:47 user nova-compute[74669]: DEBUG nova.network.neutron [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updating instance_info_cache with network_info: [{"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:45:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Releasing lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:45:47 user nova-compute[74669]: DEBUG nova.compute.manager [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Instance network_info: |[{"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74669) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 17:45:47 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c0ba3b2f-c905-4537-b62b-e2b473fc0d11 req-abc91644-729c-47b9-8cc1-5428f8a2fdbd service nova] Acquired lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:45:47 user nova-compute[74669]: DEBUG nova.network.neutron [req-c0ba3b2f-c905-4537-b62b-e2b473fc0d11 req-abc91644-729c-47b9-8cc1-5428f8a2fdbd service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Refreshing network info cache for port 4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:45:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:45:48 user nova-compute[74669]: DEBUG nova.network.neutron [req-c0ba3b2f-c905-4537-b62b-e2b473fc0d11 req-abc91644-729c-47b9-8cc1-5428f8a2fdbd service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updated VIF entry in instance network info cache for port 4cac36e0-dcd3-4da6-bafb-67426abb9e5c. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:45:48 user nova-compute[74669]: DEBUG nova.network.neutron [req-c0ba3b2f-c905-4537-b62b-e2b473fc0d11 req-abc91644-729c-47b9-8cc1-5428f8a2fdbd service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updating instance_info_cache with network_info: [{"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:45:48 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-c0ba3b2f-c905-4537-b62b-e2b473fc0d11 req-abc91644-729c-47b9-8cc1-5428f8a2fdbd service nova] Releasing lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:45:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:45:57 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:45:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG nova.compute.manager [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Start spawning the instance on the hypervisor. {{(pid=74669) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:46:11 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Creating image(s)
Nov 08 17:46:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Did not create local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Ensure instance console log exists: /opt/stack/data/nova/instances/11aea0f4-ce45-4b05-aa5c-7523aabb6d3b/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Start _get_guest_xml network_info=[{"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '18b9d4c0-cedf-499c-a126-680ab1219700', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FwDVlrsj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '11aea0f4-ce45-4b05-aa5c-7523aabb6d3b', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff4f8621-ead9-4ec0-b7eb-9cea00b96f66', 'serial': 'ff4f8621-ead9-4ec0-b7eb-9cea00b96f66'}, 'guest_format': None, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:46:11 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:46:11 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:46:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FwDVlrsj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:46:11 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:46:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:46:11 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:46:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:46:11 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:46:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[784d458e-518f-459d-bcb1-97b67f587cfd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:46:11 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:46:11 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54a5d60-3220-4d89-a307-eab0b5751119]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66] added
Nov 08 17:46:12 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[219983b4-e1e8-43aa-bb31-bd0e46bf1a4b]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8a6edc-df87-4673-ab42-dce1fc132055]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FwDVlrsj {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FwDVlrsj" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8815ea6d-2c39-4097-86f4-d17231a6ddb6]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FwDVlrsj'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6c92c7-5d3a-4c2a-ba17-115eef619fe4]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2fe329-3b1b-4238-8252-7f4e5b7f983a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 17:46:12 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 17:46:12 user nova-compute[74669]:  {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:46:12 user nova-compute[74669]: WARNING os_brick.initiator.connectors.iscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 17:46:12 user nova-compute[74669]: 
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67db1c1-b746-46a2-9269-b27d421cde5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66, portal: 172.16.0.220,3260]
Nov 08 17:46:12 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66, portal: 172.16.0.220,3260] successful.
Nov 08 17:46:12 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9a1efa-76e1-4af5-88c8-40bd8659eb1a]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3330794b-2805-40f5-b99f-72cbdfa6837b]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 (non-flash)
Nov 08 17:46:12 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 (non-flash)
Nov 08 17:46:12 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.029s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b5322a-c445-4c6a-9133-20906f41b653]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:46:12 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FwDVlrsj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23239613266343238', 'path': '/dev/sdb'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239613266343238', 'path': '/dev/sdb'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-84134548',display_name='tempest-TestShelveInstance-server-84134548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-84134548',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDX3a0K3JUIZchChqzIEKuQzW+V0ebQ5ogV1Zzp0Zan78yycXIx2O7mVNuQU9i05Uvha52Zk8jZpqVBh4eulw29UNba9mggifMYNrmnu6VY5bOZlA6tvOx+Ho24EZ3HMZQ==',key_name='tempest-TestShelveInstance-921904317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd40c24d61fa4ef6a44ce175d23b6a4c',ramdisk_id='',reservation_id='r-qfw2qypk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2038104905',owner_user_name='tempest-TestShelveInstance-2038104905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:45:45Z,user_data=None,user_id='d8e663b1b12d425d81aec27d1f10bcfd',uuid=11aea0f4-ce45-4b05-aa5c-7523aabb6d3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Converting VIF {"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:41:b4,bridge_name='br-int',has_traffic_filtering=True,id=4cac36e0-dcd3-4da6-bafb-67426abb9e5c,network=Network(e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cac36e0-dc') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG nova.objects.instance [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lazy-loading 'pci_devices' on Instance uuid 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:46:13 user nova-compute[74669]:   <uuid>11aea0f4-ce45-4b05-aa5c-7523aabb6d3b</uuid>
Nov 08 17:46:13 user nova-compute[74669]:   <name>instance-00000034</name>
Nov 08 17:46:13 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:46:13 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:46:13 user nova-compute[74669]:   <metadata>
Nov 08 17:46:13 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:46:13 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:46:13 user nova-compute[74669]:       <nova:name>tempest-TestShelveInstance-server-84134548</nova:name>
Nov 08 17:46:13 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:46:11</nova:creationTime>
Nov 08 17:46:13 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:46:13 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:46:13 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:46:13 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:46:13 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:46:13 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:46:13 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:46:13 user nova-compute[74669]:       <nova:owner>
Nov 08 17:46:13 user nova-compute[74669]:         <nova:user uuid="d8e663b1b12d425d81aec27d1f10bcfd">tempest-TestShelveInstance-2038104905-project-member</nova:user>
Nov 08 17:46:13 user nova-compute[74669]:         <nova:project uuid="cd40c24d61fa4ef6a44ce175d23b6a4c">tempest-TestShelveInstance-2038104905</nova:project>
Nov 08 17:46:13 user nova-compute[74669]:       </nova:owner>
Nov 08 17:46:13 user nova-compute[74669]:       <nova:ports>
Nov 08 17:46:13 user nova-compute[74669]:         <nova:port uuid="4cac36e0-dcd3-4da6-bafb-67426abb9e5c">
Nov 08 17:46:13 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 17:46:13 user nova-compute[74669]:         </nova:port>
Nov 08 17:46:13 user nova-compute[74669]:       </nova:ports>
Nov 08 17:46:13 user nova-compute[74669]:     </nova:instance>
Nov 08 17:46:13 user nova-compute[74669]:   </metadata>
Nov 08 17:46:13 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:46:13 user nova-compute[74669]:     <system>
Nov 08 17:46:13 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:46:13 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:46:13 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:46:13 user nova-compute[74669]:       <entry name="serial">11aea0f4-ce45-4b05-aa5c-7523aabb6d3b</entry>
Nov 08 17:46:13 user nova-compute[74669]:       <entry name="uuid">11aea0f4-ce45-4b05-aa5c-7523aabb6d3b</entry>
Nov 08 17:46:13 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:46:13 user nova-compute[74669]:     </system>
Nov 08 17:46:13 user nova-compute[74669]:   </sysinfo>
Nov 08 17:46:13 user nova-compute[74669]:   <os>
Nov 08 17:46:13 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:46:13 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:46:13 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:46:13 user nova-compute[74669]:   </os>
Nov 08 17:46:13 user nova-compute[74669]:   <features>
Nov 08 17:46:13 user nova-compute[74669]:     <acpi/>
Nov 08 17:46:13 user nova-compute[74669]:     <apic/>
Nov 08 17:46:13 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:46:13 user nova-compute[74669]:   </features>
Nov 08 17:46:13 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:46:13 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:46:13 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:46:13 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:46:13 user nova-compute[74669]:   </clock>
Nov 08 17:46:13 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:46:13 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:46:13 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:46:13 user nova-compute[74669]:   </cpu>
Nov 08 17:46:13 user nova-compute[74669]:   <devices>
Nov 08 17:46:13 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 17:46:13 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:46:13 user nova-compute[74669]:       <source dev="/dev/sdb"/>
Nov 08 17:46:13 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:46:13 user nova-compute[74669]:       <serial>ff4f8621-ead9-4ec0-b7eb-9cea00b96f66</serial>
Nov 08 17:46:13 user nova-compute[74669]:     </disk>
Nov 08 17:46:13 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:46:13 user nova-compute[74669]:       <mac address="fa:16:3e:b0:41:b4"/>
Nov 08 17:46:13 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:46:13 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:46:13 user nova-compute[74669]:       <target dev="tap4cac36e0-dc"/>
Nov 08 17:46:13 user nova-compute[74669]:     </interface>
Nov 08 17:46:13 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:46:13 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/11aea0f4-ce45-4b05-aa5c-7523aabb6d3b/console.log" append="off"/>
Nov 08 17:46:13 user nova-compute[74669]:     </serial>
Nov 08 17:46:13 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:46:13 user nova-compute[74669]:     <video>
Nov 08 17:46:13 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:46:13 user nova-compute[74669]:     </video>
Nov 08 17:46:13 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:46:13 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:46:13 user nova-compute[74669]:     </rng>
Nov 08 17:46:13 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:46:13 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:46:13 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:46:13 user nova-compute[74669]:     </memballoon>
Nov 08 17:46:13 user nova-compute[74669]:   </devices>
Nov 08 17:46:13 user nova-compute[74669]: </domain>
Nov 08 17:46:13 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-84134548',display_name='tempest-TestShelveInstance-server-84134548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-84134548',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDX3a0K3JUIZchChqzIEKuQzW+V0ebQ5ogV1Zzp0Zan78yycXIx2O7mVNuQU9i05Uvha52Zk8jZpqVBh4eulw29UNba9mggifMYNrmnu6VY5bOZlA6tvOx+Ho24EZ3HMZQ==',key_name='tempest-TestShelveInstance-921904317',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd40c24d61fa4ef6a44ce175d23b6a4c',ramdisk_id='',reservation_id='r-qfw2qypk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2038104905',owner_user_name='tempest-TestShelveInstance-2038104905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T17:45:45Z,user_data=None,user_id='d8e663b1b12d425d81aec27d1f10bcfd',uuid=11aea0f4-ce45-4b05-aa5c-7523aabb6d3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Converting VIF {"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:41:b4,bridge_name='br-int',has_traffic_filtering=True,id=4cac36e0-dcd3-4da6-bafb-67426abb9e5c,network=Network(e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cac36e0-dc') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG os_vif [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:41:b4,bridge_name='br-int',has_traffic_filtering=True,id=4cac36e0-dcd3-4da6-bafb-67426abb9e5c,network=Network(e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cac36e0-dc') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7389cd09-2ca6-5ed7-a3a5-ff13fa99ac84', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cac36e0-dc, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4cac36e0-dc, col_values=(('qos', UUID('7fbbe67d-dc3e-47bc-b4e7-e045b5bfa58e')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4cac36e0-dc, col_values=(('external_ids', {'iface-id': '4cac36e0-dcd3-4da6-bafb-67426abb9e5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:41:b4', 'vm-uuid': '11aea0f4-ce45-4b05-aa5c-7523aabb6d3b'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:13 user nova-compute[74669]: INFO os_vif [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:41:b4,bridge_name='br-int',has_traffic_filtering=True,id=4cac36e0-dcd3-4da6-bafb-67426abb9e5c,network=Network(e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cac36e0-dc')
Nov 08 17:46:13 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:46:13 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] No VIF found with MAC fa:16:3e:b0:41:b4, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:46:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-a9732b18-22f4-4ad3-b474-8b3614673f9d req-39fb0bf8-fcdb-4c1b-a4b0-2122f3c35765 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Received event network-vif-plugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:46:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a9732b18-22f4-4ad3-b474-8b3614673f9d req-39fb0bf8-fcdb-4c1b-a4b0-2122f3c35765 service nova] Acquiring lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:46:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a9732b18-22f4-4ad3-b474-8b3614673f9d req-39fb0bf8-fcdb-4c1b-a4b0-2122f3c35765 service nova] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:46:15 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-a9732b18-22f4-4ad3-b474-8b3614673f9d req-39fb0bf8-fcdb-4c1b-a4b0-2122f3c35765 service nova] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:46:15 user nova-compute[74669]: DEBUG nova.compute.manager [req-a9732b18-22f4-4ad3-b474-8b3614673f9d req-39fb0bf8-fcdb-4c1b-a4b0-2122f3c35765 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] No waiting events found dispatching network-vif-plugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:46:15 user nova-compute[74669]: WARNING nova.compute.manager [req-a9732b18-22f4-4ad3-b474-8b3614673f9d req-39fb0bf8-fcdb-4c1b-a4b0-2122f3c35765 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Received unexpected event network-vif-plugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c for instance with vm_state building and task_state spawning.
Nov 08 17:46:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:16 user nova-compute[74669]: DEBUG nova.compute.manager [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:46:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:46:16 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Instance spawned successfully.
Nov 08 17:46:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 17:46:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Found default for hw_cdrom_bus of ide {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:46:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Found default for hw_disk_bus of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:46:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Found default for hw_input_bus of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:46:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Found default for hw_pointer_model of None {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:46:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Found default for hw_video_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:46:16 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Found default for hw_vif_model of virtio {{(pid=74669) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 17:46:16 user nova-compute[74669]: INFO nova.compute.manager [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 08 17:46:16 user nova-compute[74669]: DEBUG nova.compute.manager [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:46:17 user nova-compute[74669]: INFO nova.compute.manager [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Took 32.56 seconds to build instance.
Nov 08 17:46:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-1f93c32b-ad19-4ebd-b0b9-4f560955e456 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.686s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:46:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-f77370fe-52fa-4712-85ff-ce18deae55ec req-c135d16d-e360-4fb7-a997-38d7f4d4c223 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Received event network-vif-plugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:46:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f77370fe-52fa-4712-85ff-ce18deae55ec req-c135d16d-e360-4fb7-a997-38d7f4d4c223 service nova] Acquiring lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:46:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f77370fe-52fa-4712-85ff-ce18deae55ec req-c135d16d-e360-4fb7-a997-38d7f4d4c223 service nova] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:46:17 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f77370fe-52fa-4712-85ff-ce18deae55ec req-c135d16d-e360-4fb7-a997-38d7f4d4c223 service nova] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:46:17 user nova-compute[74669]: DEBUG nova.compute.manager [req-f77370fe-52fa-4712-85ff-ce18deae55ec req-c135d16d-e360-4fb7-a997-38d7f4d4c223 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] No waiting events found dispatching network-vif-plugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:46:17 user nova-compute[74669]: WARNING nova.compute.manager [req-f77370fe-52fa-4712-85ff-ce18deae55ec req-c135d16d-e360-4fb7-a997-38d7f4d4c223 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Received unexpected event network-vif-plugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c for instance with vm_state active and task_state None.
Nov 08 17:46:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:23 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:46:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:46:28 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:46:29 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:46:29 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:46:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:46:34 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:34 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:46:34 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:46:34 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 17:46:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:46:34 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:46:34 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:46:34 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lazy-loading 'info_cache' on Instance uuid 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:46:35 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updating instance_info_cache with network_info: [{"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:46:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:46:35 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:46:35 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:46:35 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:46:35 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:46:35 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:46:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:46:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:46:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:46:35 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:46:35 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:46:36 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:46:36 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:46:36 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8833MB free_disk=25.166790008544922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:46:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:46:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:46:36 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:46:36 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:46:36 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:46:36 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:46:36 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:46:36 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:46:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:46:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:38 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:46:38 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:46:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:49 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:51 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:46:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:47:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:47:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:47:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:47:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:47:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:47:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:47:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:47:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:47:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:47:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:47:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:47:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:47:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:47:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:47:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:47:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:47:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:24 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:47:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:47:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:47:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:47:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:47:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:28 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:47:29 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:47:29 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:47:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:47:34 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:47:34 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:47:34 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 17:47:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:47:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:47:35 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:47:35 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lazy-loading 'info_cache' on Instance uuid 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:47:35 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updating instance_info_cache with network_info: [{"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:47:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:47:35 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:47:35 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:47:35 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:47:35 user nova-compute[74669]: DEBUG nova.compute.manager [req-bcf0315a-5a42-48e6-8b30-5b978fa7427e req-0af02e5a-07c9-490b-b1c7-9e97a13a8143 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Received event network-changed-4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:47:35 user nova-compute[74669]: DEBUG nova.compute.manager [req-bcf0315a-5a42-48e6-8b30-5b978fa7427e req-0af02e5a-07c9-490b-b1c7-9e97a13a8143 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Refreshing instance network info cache due to event network-changed-4cac36e0-dcd3-4da6-bafb-67426abb9e5c. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:47:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-bcf0315a-5a42-48e6-8b30-5b978fa7427e req-0af02e5a-07c9-490b-b1c7-9e97a13a8143 service nova] Acquiring lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:47:35 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-bcf0315a-5a42-48e6-8b30-5b978fa7427e req-0af02e5a-07c9-490b-b1c7-9e97a13a8143 service nova] Acquired lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:47:35 user nova-compute[74669]: DEBUG nova.network.neutron [req-bcf0315a-5a42-48e6-8b30-5b978fa7427e req-0af02e5a-07c9-490b-b1c7-9e97a13a8143 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Refreshing network info cache for port 4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:47:36 user nova-compute[74669]: DEBUG nova.network.neutron [req-bcf0315a-5a42-48e6-8b30-5b978fa7427e req-0af02e5a-07c9-490b-b1c7-9e97a13a8143 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updated VIF entry in instance network info cache for port 4cac36e0-dcd3-4da6-bafb-67426abb9e5c. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:47:36 user nova-compute[74669]: DEBUG nova.network.neutron [req-bcf0315a-5a42-48e6-8b30-5b978fa7427e req-0af02e5a-07c9-490b-b1c7-9e97a13a8143 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updating instance_info_cache with network_info: [{"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:47:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-bcf0315a-5a42-48e6-8b30-5b978fa7427e req-0af02e5a-07c9-490b-b1c7-9e97a13a8143 service nova] Releasing lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:47:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquiring lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:47:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:47:36 user nova-compute[74669]: INFO nova.compute.manager [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Shelve offloading
Nov 08 17:47:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:36 user nova-compute[74669]: DEBUG nova.compute.manager [req-5eaa7a92-fa73-42f4-8385-046084254788 req-aab252c2-ca0e-421a-9f7b-d3324dfb070d service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Received event network-vif-unplugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:47:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5eaa7a92-fa73-42f4-8385-046084254788 req-aab252c2-ca0e-421a-9f7b-d3324dfb070d service nova] Acquiring lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:47:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5eaa7a92-fa73-42f4-8385-046084254788 req-aab252c2-ca0e-421a-9f7b-d3324dfb070d service nova] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:47:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-5eaa7a92-fa73-42f4-8385-046084254788 req-aab252c2-ca0e-421a-9f7b-d3324dfb070d service nova] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:47:36 user nova-compute[74669]: DEBUG nova.compute.manager [req-5eaa7a92-fa73-42f4-8385-046084254788 req-aab252c2-ca0e-421a-9f7b-d3324dfb070d service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] No waiting events found dispatching network-vif-unplugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:47:36 user nova-compute[74669]: WARNING nova.compute.manager [req-5eaa7a92-fa73-42f4-8385-046084254788 req-aab252c2-ca0e-421a-9f7b-d3324dfb070d service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Received unexpected event network-vif-unplugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c for instance with vm_state active and task_state shelving.
Nov 08 17:47:36 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:36 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Instance destroyed successfully.
Nov 08 17:47:36 user nova-compute[74669]: DEBUG nova.compute.manager [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:47:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquiring lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:47:36 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquired lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:47:36 user nova-compute[74669]: DEBUG nova.network.neutron [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:47:37 user nova-compute[74669]: DEBUG nova.network.neutron [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updating instance_info_cache with network_info: [{"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:47:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Releasing lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:47:37 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:47:37 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:47:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:47:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:47:37 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:47:37 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:47:37 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:47:38 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:47:38 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=9078MB free_disk=25.16577911376953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:47:38 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Instance destroyed successfully.
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.objects.instance [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lazy-loading 'resources' on Instance uuid 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T17:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-84134548',display_name='tempest-TestShelveInstance-server-84134548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-84134548',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDX3a0K3JUIZchChqzIEKuQzW+V0ebQ5ogV1Zzp0Zan78yycXIx2O7mVNuQU9i05Uvha52Zk8jZpqVBh4eulw29UNba9mggifMYNrmnu6VY5bOZlA6tvOx+Ho24EZ3HMZQ==',key_name='tempest-TestShelveInstance-921904317',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:46:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd40c24d61fa4ef6a44ce175d23b6a4c',ramdisk_id='',reservation_id='r-qfw2qypk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2038104905',owner_user_name='tempest-TestShelveInstance-2038104905-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:46:17Z,user_data=None,user_id='d8e663b1b12d425d81aec27d1f10bcfd',uuid=11aea0f4-ce45-4b05-aa5c-7523aabb6d3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Converting VIF {"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:41:b4,bridge_name='br-int',has_traffic_filtering=True,id=4cac36e0-dcd3-4da6-bafb-67426abb9e5c,network=Network(e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cac36e0-dc') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG os_vif [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:41:b4,bridge_name='br-int',has_traffic_filtering=True,id=4cac36e0-dcd3-4da6-bafb-67426abb9e5c,network=Network(e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cac36e0-dc') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cac36e0-dc, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fbbe67d-dc3e-47bc-b4e7-e045b5bfa58e) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:47:38 user nova-compute[74669]: INFO os_vif [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:41:b4,bridge_name='br-int',has_traffic_filtering=True,id=4cac36e0-dcd3-4da6-bafb-67426abb9e5c,network=Network(e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cac36e0-dc')
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FwDVlrsj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:47:38 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:47:38 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0720e586-a767-4772-939f-35ad879e966f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:47:38 user nova-compute[74669]: No targets found.
Nov 08 17:47:38 user nova-compute[74669]: iSNS:
Nov 08 17:47:38 user nova-compute[74669]: No targets found.
Nov 08 17:47:38 user nova-compute[74669]: STATIC:
Nov 08 17:47:38 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66
Nov 08 17:47:38 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:47:38 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:47:38 user nova-compute[74669]: FIRMWARE:
Nov 08 17:47:38 user nova-compute[74669]: No targets found.
Nov 08 17:47:38 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:47:38 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:47:38 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af6e13e-9123-437f-9e70-6d8a75bdbd92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing inventories for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e5cd25-c7b6-411f-9d55-8eac93a4187d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 (non-flash)
Nov 08 17:47:38 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 (non-flash)
Nov 08 17:47:38 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9845020e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66'): ({'sdb'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Removing single pathed devices sdb {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Updating ProviderTree inventory for provider ce26964b-e55b-43d2-801a-7221ff1fe64b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Updating inventory in ProviderTree for provider ce26964b-e55b-43d2-801a-7221ff1fe64b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25c7c2d-180f-4c8b-b29e-6acf9eb39c6c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing aggregate associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, aggregates: None {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3049509-d8f9-4d7d-beb4-dcb6543a6e07]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Flushing IO for device /dev/sdb {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[507041d6-3154-420c-bbf7-d448db80f48d]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing trait associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, traits: HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10b67e9-aae9-4566-b74d-07becf4a1703]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5beb21-c4af-4bf9-b725-e1ed90f6c3e5]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[d386d32e-ecd9-4488-8485-e9bfc50eb32b]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66, portal: 172.16.0.220,3260]
Nov 08 17:47:38 user nova-compute[74669]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66, portal: 172.16.0.220,3260] successful.
Nov 08 17:47:38 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[26644f97-130d-41a9-994d-e48a22542184]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] <== disconnect_volume: return (281ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:47:38 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Deleting instance files /opt/stack/data/nova/instances/11aea0f4-ce45-4b05-aa5c-7523aabb6d3b_del
Nov 08 17:47:38 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Deletion of /opt/stack/data/nova/instances/11aea0f4-ce45-4b05-aa5c-7523aabb6d3b_del complete
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.compute.manager [req-ea96232e-2dce-4e77-b779-49b94e58e9f1 req-1e049e1d-f488-4299-aeb7-d6761c73a4e5 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Received event network-vif-plugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ea96232e-2dce-4e77-b779-49b94e58e9f1 req-1e049e1d-f488-4299-aeb7-d6761c73a4e5 service nova] Acquiring lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ea96232e-2dce-4e77-b779-49b94e58e9f1 req-1e049e1d-f488-4299-aeb7-d6761c73a4e5 service nova] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ea96232e-2dce-4e77-b779-49b94e58e9f1 req-1e049e1d-f488-4299-aeb7-d6761c73a4e5 service nova] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.compute.manager [req-ea96232e-2dce-4e77-b779-49b94e58e9f1 req-1e049e1d-f488-4299-aeb7-d6761c73a4e5 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] No waiting events found dispatching network-vif-plugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:47:38 user nova-compute[74669]: WARNING nova.compute.manager [req-ea96232e-2dce-4e77-b779-49b94e58e9f1 req-1e049e1d-f488-4299-aeb7-d6761c73a4e5 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Received unexpected event network-vif-plugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c for instance with vm_state active and task_state shelving.
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.compute.manager [req-ea96232e-2dce-4e77-b779-49b94e58e9f1 req-1e049e1d-f488-4299-aeb7-d6761c73a4e5 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Received event network-changed-4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.compute.manager [req-ea96232e-2dce-4e77-b779-49b94e58e9f1 req-1e049e1d-f488-4299-aeb7-d6761c73a4e5 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Refreshing instance network info cache due to event network-changed-4cac36e0-dcd3-4da6-bafb-67426abb9e5c. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ea96232e-2dce-4e77-b779-49b94e58e9f1 req-1e049e1d-f488-4299-aeb7-d6761c73a4e5 service nova] Acquiring lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ea96232e-2dce-4e77-b779-49b94e58e9f1 req-1e049e1d-f488-4299-aeb7-d6761c73a4e5 service nova] Acquired lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.network.neutron [req-ea96232e-2dce-4e77-b779-49b94e58e9f1 req-1e049e1d-f488-4299-aeb7-d6761c73a4e5 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Refreshing network info cache for port 4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.network.neutron [req-ea96232e-2dce-4e77-b779-49b94e58e9f1 req-1e049e1d-f488-4299-aeb7-d6761c73a4e5 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updated VIF entry in instance network info cache for port 4cac36e0-dcd3-4da6-bafb-67426abb9e5c. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG nova.network.neutron [req-ea96232e-2dce-4e77-b779-49b94e58e9f1 req-1e049e1d-f488-4299-aeb7-d6761c73a4e5 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updating instance_info_cache with network_info: [{"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": null, "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:47:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-ea96232e-2dce-4e77-b779-49b94e58e9f1 req-1e049e1d-f488-4299-aeb7-d6761c73a4e5 service nova] Releasing lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:47:39 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Deleted allocations for instance 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b
Nov 08 17:47:39 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:47:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:47:39 user nova-compute[74669]: DEBUG nova.objects.instance [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lazy-loading 'numa_topology' on Instance uuid 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:47:39 user nova-compute[74669]: DEBUG nova.objects.base [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Object Instance<11aea0f4-ce45-4b05-aa5c-7523aabb6d3b> lazy-loaded attributes: resources,numa_topology {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:47:39 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:47:39 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:47:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:47:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-2b6c9439-7d2b-4801-a02e-7601b1b1c108 tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.708s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:47:41 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:47:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:44 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:46 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:47:46 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 17:47:46 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] There are 0 instances to clean {{(pid=74669) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 17:47:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:52 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:47:52 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74669) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 17:47:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:47:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:47:55 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:47:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:48:01 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:48:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:48:04 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:48:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:48:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:48:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:48:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:48:22 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:48:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:48:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:48:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:48:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:48:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:48:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:48:24 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:48:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:48:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:48:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:48:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:48:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:48:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:48:29 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:48:31 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:48:31 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:48:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:48:35 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:48:35 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:48:35 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 17:48:35 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Didn't find any instances for network info cache update. {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 17:48:37 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:48:37 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:48:37 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:48:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:48:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:48:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:48:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:48:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:48:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:48:38 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:48:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:48:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:48:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:48:38 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:48:39 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:48:39 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:48:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=9115MB free_disk=25.165145874023438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:48:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:48:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:48:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:48:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:48:39 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:48:39 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:48:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:48:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:48:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:48:43 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:48:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:48:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:48:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:49:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:49:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:49:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:49:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:49:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:49:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:49:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:49:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:49:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:49:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:49:25 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquiring lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:49:28 user nova-compute[74669]: INFO nova.compute.manager [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Unshelving
Nov 08 17:49:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:49:28 user nova-compute[74669]: INFO nova.virt.block_device [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Booting with volume ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 at /dev/vda
Nov 08 17:49:28 user nova-compute[74669]: DEBUG os_brick.utils [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2603d37f-24af-49dc-a467-f24bfe41b06c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:67fea8dc43e6\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d80956-7b53-4b73-aafd-de141d4dd860]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef260ac-294f-470d-a8e4-ddfbaaa5f5f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b560c7-1691-4750-8957-1d821100bb27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Running cmd (subprocess): nvme version {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] 'nvme version' failed. Not Retrying. {{(pid=74669) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] nvme not present on system {{(pid=74669) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 17:49:28 user nova-compute[74669]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 17:49:28 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e079245-6b36-42c0-a970-0e3c7f2f1b11]: (4, '') {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74669) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.lightos [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] LIGHTOS: no hostnqn found. {{(pid=74669) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG os_brick.utils [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:67fea8dc43e6', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:49:28 user nova-compute[74669]: DEBUG nova.virt.block_device [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updating existing volume attachment record: 93455cb9-e19c-4fe2-8c8c-f6290123ffb6 {{(pid=74669) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 17:49:31 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:49:32 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:49:32 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:49:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:49:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:49:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:49:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:49:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:49:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:49:37 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:49:37 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:49:37 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 17:49:37 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Didn't find any instances for network info cache update. {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 17:49:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:49:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:49:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:49:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:49:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:49:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:49:38 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:49:38 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:49:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:49:38 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:49:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:49:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:49:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:49:38 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:49:39 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:49:39 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:49:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=9118MB free_disk=25.164478302001953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:49:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:49:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:49:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 17:49:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:49:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:49:39 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:49:39 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:49:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:49:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:49:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:49:43 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:49:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:49:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:49:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:49:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:49:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:49:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:49:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:49:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:49:50 user nova-compute[74669]: DEBUG nova.objects.instance [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lazy-loading 'pci_requests' on Instance uuid 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:49:50 user nova-compute[74669]: DEBUG nova.objects.instance [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lazy-loading 'numa_topology' on Instance uuid 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:49:50 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74669) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 17:49:50 user nova-compute[74669]: INFO nova.compute.claims [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Claim successful on node user
Nov 08 17:49:50 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:49:50 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:49:50 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.213s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:49:50 user nova-compute[74669]: INFO nova.network.neutron [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updating port 4cac36e0-dcd3-4da6-bafb-67426abb9e5c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 17:49:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquiring lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquired lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.network.neutron [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Building network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.compute.manager [req-2778529a-33d3-420b-8fc2-cc2ebcb5d5f4 req-95cf0529-5f2d-4598-bcf6-9c3e7004e902 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Received event network-changed-4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.compute.manager [req-2778529a-33d3-420b-8fc2-cc2ebcb5d5f4 req-95cf0529-5f2d-4598-bcf6-9c3e7004e902 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Refreshing instance network info cache due to event network-changed-4cac36e0-dcd3-4da6-bafb-67426abb9e5c. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2778529a-33d3-420b-8fc2-cc2ebcb5d5f4 req-95cf0529-5f2d-4598-bcf6-9c3e7004e902 service nova] Acquiring lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.network.neutron [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updating instance_info_cache with network_info: [{"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Releasing lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Creating instance directory {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 17:49:51 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Creating image(s)
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Did not create local disks {{(pid=74669) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Ensure instance console log exists: /opt/stack/data/nova/instances/11aea0f4-ce45-4b05-aa5c-7523aabb6d3b/console.log {{(pid=74669) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Start _get_guest_xml network_info=[{"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '93455cb9-e19c-4fe2-8c8c-f6290123ffb6', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FwDVlrsj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '11aea0f4-ce45-4b05-aa5c-7523aabb6d3b', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff4f8621-ead9-4ec0-b7eb-9cea00b96f66', 'serial': 'ff4f8621-ead9-4ec0-b7eb-9cea00b96f66'}, 'guest_format': None, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2778529a-33d3-420b-8fc2-cc2ebcb5d5f4 req-95cf0529-5f2d-4598-bcf6-9c3e7004e902 service nova] Acquired lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.network.neutron [req-2778529a-33d3-420b-8fc2-cc2ebcb5d5f4 req-95cf0529-5f2d-4598-bcf6-9c3e7004e902 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Refreshing network info cache for port 4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:49:51 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:49:51 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] CPU controller missing on host. {{(pid=74669) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.host [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] CPU controller found on host. {{(pid=74669) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74669) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T16:46:52Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Flavor limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Image limits 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Flavor pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Image pref 0:0:0 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Got 1 possible topologies {{(pid=74669) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.virt.hardware [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74669) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.objects.instance [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lazy-loading 'vcpu_model' on Instance uuid 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.objects.base [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Object Instance<11aea0f4-ce45-4b05-aa5c-7523aabb6d3b> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Calling os-brick to attach iSCSI Volume {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FwDVlrsj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:49:51 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:49:51 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:49:51 user nova-compute[74669]: INFO os_brick.initiator.connectors.iscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[42274f97-615d-4714-bea4-1e53bb0bbdbe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 17:49:51 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --interface default --op new {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[113d1249-1b68-4faa-bb60-7b6ab03d52f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66] added\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66] added
Nov 08 17:49:51 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4a82c3-3609-42b8-a01a-7538a53944ae]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ee245e-e383-43d0-8576-1124a5132103]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FwDVlrsj {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FwDVlrsj" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df55890-07eb-409b-af5c-218c32bc84c0]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FwDVlrsj'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebba569-5e0d-42c1-89b9-ae03bc3e68d3]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad3ee07-db5d-4bdd-a3af-718a330dc6ac]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 17:49:51 user nova-compute[74669]:  {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 17:49:51 user nova-compute[74669]:  {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:49:51 user nova-compute[74669]: WARNING os_brick.initiator.connectors.iscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 17:49:51 user nova-compute[74669]: 
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --login {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb43d25-c4af-44b3-85dd-a4a4a99283e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66, portal: 172.16.0.220,3260]
Nov 08 17:49:51 user nova-compute[74669]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66, portal: 172.16.0.220,3260] successful.
Nov 08 17:49:51 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d38a346-cbc9-4d23-bd2b-5b025b041842]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ec906f-9450-4b0b-8d4e-a5f23d87ff0c]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 (non-flash)
Nov 08 17:49:51 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 (non-flash)
Nov 08 17:49:51 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Connected to 172.16.0.220:3260 {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74669) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74669) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[437d8ba6-a331-4dff-a2db-3f3820fef5d0]: (4, ('- - 0', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74669) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FwDVlrsj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74669) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.network.neutron [req-2778529a-33d3-420b-8fc2-cc2ebcb5d5f4 req-95cf0529-5f2d-4598-bcf6-9c3e7004e902 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updated VIF entry in instance network info cache for port 4cac36e0-dcd3-4da6-bafb-67426abb9e5c. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG nova.network.neutron [req-2778529a-33d3-420b-8fc2-cc2ebcb5d5f4 req-95cf0529-5f2d-4598-bcf6-9c3e7004e902 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updating instance_info_cache with network_info: [{"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:49:51 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-2778529a-33d3-420b-8fc2-cc2ebcb5d5f4 req-95cf0529-5f2d-4598-bcf6-9c3e7004e902 service nova] Releasing lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:49:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:49:52 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23239613266343238', 'path': '/dev/sdb'} {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:49:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239613266343238', 'path': '/dev/sdb'} {{(pid=74669) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 17:49:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T17:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-84134548',display_name='tempest-TestShelveInstance-server-84134548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-84134548',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-921904317',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:46:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='cd40c24d61fa4ef6a44ce175d23b6a4c',ramdisk_id='',reservation_id='r-qfw2qypk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2038104905',owner_user_name='tempest-TestShelveInstance-2038104905-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:49:28Z,user_data=None,user_id='d8e663b1b12d425d81aec27d1f10bcfd',uuid=11aea0f4-ce45-4b05-aa5c-7523aabb6d3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74669) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 17:49:52 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Converting VIF {"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:49:52 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:41:b4,bridge_name='br-int',has_traffic_filtering=True,id=4cac36e0-dcd3-4da6-bafb-67426abb9e5c,network=Network(e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cac36e0-dc') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:49:52 user nova-compute[74669]: DEBUG nova.objects.instance [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lazy-loading 'pci_devices' on Instance uuid 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:49:52 user nova-compute[74669]: DEBUG nova.objects.base [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Object Instance<11aea0f4-ce45-4b05-aa5c-7523aabb6d3b> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74669) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 17:49:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 17:49:52 user nova-compute[74669]:   <uuid>11aea0f4-ce45-4b05-aa5c-7523aabb6d3b</uuid>
Nov 08 17:49:52 user nova-compute[74669]:   <name>instance-00000034</name>
Nov 08 17:49:52 user nova-compute[74669]:   <memory>524288</memory>
Nov 08 17:49:52 user nova-compute[74669]:   <vcpu>1</vcpu>
Nov 08 17:49:52 user nova-compute[74669]:   <metadata>
Nov 08 17:49:52 user nova-compute[74669]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 17:49:52 user nova-compute[74669]:       <nova:package version="0.0.0"/>
Nov 08 17:49:52 user nova-compute[74669]:       <nova:name>tempest-TestShelveInstance-server-84134548</nova:name>
Nov 08 17:49:52 user nova-compute[74669]:       <nova:creationTime>2023-11-08 17:49:51</nova:creationTime>
Nov 08 17:49:52 user nova-compute[74669]:       <nova:flavor name="m1.tiny">
Nov 08 17:49:52 user nova-compute[74669]:         <nova:memory>512</nova:memory>
Nov 08 17:49:52 user nova-compute[74669]:         <nova:disk>1</nova:disk>
Nov 08 17:49:52 user nova-compute[74669]:         <nova:swap>0</nova:swap>
Nov 08 17:49:52 user nova-compute[74669]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 17:49:52 user nova-compute[74669]:         <nova:vcpus>1</nova:vcpus>
Nov 08 17:49:52 user nova-compute[74669]:       </nova:flavor>
Nov 08 17:49:52 user nova-compute[74669]:       <nova:owner>
Nov 08 17:49:52 user nova-compute[74669]:         <nova:user uuid="d8e663b1b12d425d81aec27d1f10bcfd">tempest-TestShelveInstance-2038104905-project-member</nova:user>
Nov 08 17:49:52 user nova-compute[74669]:         <nova:project uuid="cd40c24d61fa4ef6a44ce175d23b6a4c">tempest-TestShelveInstance-2038104905</nova:project>
Nov 08 17:49:52 user nova-compute[74669]:       </nova:owner>
Nov 08 17:49:52 user nova-compute[74669]:       <nova:ports>
Nov 08 17:49:52 user nova-compute[74669]:         <nova:port uuid="4cac36e0-dcd3-4da6-bafb-67426abb9e5c">
Nov 08 17:49:52 user nova-compute[74669]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 17:49:52 user nova-compute[74669]:         </nova:port>
Nov 08 17:49:52 user nova-compute[74669]:       </nova:ports>
Nov 08 17:49:52 user nova-compute[74669]:     </nova:instance>
Nov 08 17:49:52 user nova-compute[74669]:   </metadata>
Nov 08 17:49:52 user nova-compute[74669]:   <sysinfo type="smbios">
Nov 08 17:49:52 user nova-compute[74669]:     <system>
Nov 08 17:49:52 user nova-compute[74669]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 17:49:52 user nova-compute[74669]:       <entry name="product">OpenStack Nova</entry>
Nov 08 17:49:52 user nova-compute[74669]:       <entry name="version">0.0.0</entry>
Nov 08 17:49:52 user nova-compute[74669]:       <entry name="serial">11aea0f4-ce45-4b05-aa5c-7523aabb6d3b</entry>
Nov 08 17:49:52 user nova-compute[74669]:       <entry name="uuid">11aea0f4-ce45-4b05-aa5c-7523aabb6d3b</entry>
Nov 08 17:49:52 user nova-compute[74669]:       <entry name="family">Virtual Machine</entry>
Nov 08 17:49:52 user nova-compute[74669]:     </system>
Nov 08 17:49:52 user nova-compute[74669]:   </sysinfo>
Nov 08 17:49:52 user nova-compute[74669]:   <os>
Nov 08 17:49:52 user nova-compute[74669]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 17:49:52 user nova-compute[74669]:     <boot dev="hd"/>
Nov 08 17:49:52 user nova-compute[74669]:     <smbios mode="sysinfo"/>
Nov 08 17:49:52 user nova-compute[74669]:   </os>
Nov 08 17:49:52 user nova-compute[74669]:   <features>
Nov 08 17:49:52 user nova-compute[74669]:     <acpi/>
Nov 08 17:49:52 user nova-compute[74669]:     <apic/>
Nov 08 17:49:52 user nova-compute[74669]:     <vmcoreinfo/>
Nov 08 17:49:52 user nova-compute[74669]:   </features>
Nov 08 17:49:52 user nova-compute[74669]:   <clock offset="utc">
Nov 08 17:49:52 user nova-compute[74669]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 17:49:52 user nova-compute[74669]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 17:49:52 user nova-compute[74669]:     <timer name="hpet" present="no"/>
Nov 08 17:49:52 user nova-compute[74669]:   </clock>
Nov 08 17:49:52 user nova-compute[74669]:   <cpu mode="custom" match="exact">
Nov 08 17:49:52 user nova-compute[74669]:     <model>Nehalem</model>
Nov 08 17:49:52 user nova-compute[74669]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 17:49:52 user nova-compute[74669]:   </cpu>
Nov 08 17:49:52 user nova-compute[74669]:   <devices>
Nov 08 17:49:52 user nova-compute[74669]:     <disk type="block" device="disk">
Nov 08 17:49:52 user nova-compute[74669]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 17:49:52 user nova-compute[74669]:       <source dev="/dev/sdb"/>
Nov 08 17:49:52 user nova-compute[74669]:       <target dev="vda" bus="virtio"/>
Nov 08 17:49:52 user nova-compute[74669]:       <serial>ff4f8621-ead9-4ec0-b7eb-9cea00b96f66</serial>
Nov 08 17:49:52 user nova-compute[74669]:     </disk>
Nov 08 17:49:52 user nova-compute[74669]:     <interface type="ethernet">
Nov 08 17:49:52 user nova-compute[74669]:       <mac address="fa:16:3e:b0:41:b4"/>
Nov 08 17:49:52 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:49:52 user nova-compute[74669]:       <mtu size="1442"/>
Nov 08 17:49:52 user nova-compute[74669]:       <target dev="tap4cac36e0-dc"/>
Nov 08 17:49:52 user nova-compute[74669]:     </interface>
Nov 08 17:49:52 user nova-compute[74669]:     <serial type="pty">
Nov 08 17:49:52 user nova-compute[74669]:       <log file="/opt/stack/data/nova/instances/11aea0f4-ce45-4b05-aa5c-7523aabb6d3b/console.log" append="off"/>
Nov 08 17:49:52 user nova-compute[74669]:     </serial>
Nov 08 17:49:52 user nova-compute[74669]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 17:49:52 user nova-compute[74669]:     <video>
Nov 08 17:49:52 user nova-compute[74669]:       <model type="virtio"/>
Nov 08 17:49:52 user nova-compute[74669]:     </video>
Nov 08 17:49:52 user nova-compute[74669]:     <rng model="virtio">
Nov 08 17:49:52 user nova-compute[74669]:       <backend model="random">/dev/urandom</backend>
Nov 08 17:49:52 user nova-compute[74669]:     </rng>
Nov 08 17:49:52 user nova-compute[74669]:     <controller type="usb" index="0" model="none"/>
Nov 08 17:49:52 user nova-compute[74669]:     <memballoon model="virtio">
Nov 08 17:49:52 user nova-compute[74669]:       <stats period="10"/>
Nov 08 17:49:52 user nova-compute[74669]:     </memballoon>
Nov 08 17:49:52 user nova-compute[74669]:   </devices>
Nov 08 17:49:52 user nova-compute[74669]: </domain>
Nov 08 17:49:52 user nova-compute[74669]:  {{(pid=74669) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 17:49:52 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T17:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-84134548',display_name='tempest-TestShelveInstance-server-84134548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-84134548',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-921904317',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:46:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='cd40c24d61fa4ef6a44ce175d23b6a4c',ramdisk_id='',reservation_id='r-qfw2qypk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2038104905',owner_user_name='tempest-TestShelveInstance-2038104905-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:49:28Z,user_data=None,user_id='d8e663b1b12d425d81aec27d1f10bcfd',uuid=11aea0f4-ce45-4b05-aa5c-7523aabb6d3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 17:49:52 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Converting VIF {"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:49:52 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:41:b4,bridge_name='br-int',has_traffic_filtering=True,id=4cac36e0-dcd3-4da6-bafb-67426abb9e5c,network=Network(e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cac36e0-dc') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:49:52 user nova-compute[74669]: DEBUG os_vif [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:41:b4,bridge_name='br-int',has_traffic_filtering=True,id=4cac36e0-dcd3-4da6-bafb-67426abb9e5c,network=Network(e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cac36e0-dc') {{(pid=74669) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 17:49:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:49:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:49:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 17:49:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:49:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7389cd09-2ca6-5ed7-a3a5-ff13fa99ac84', '_type': 'linux-noop'}}, row=False) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:49:52 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:49:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:49:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:49:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cac36e0-dc, may_exist=True, interface_attrs={}) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:49:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4cac36e0-dc, col_values=(('qos', UUID('7fbf6c8d-7ce1-474f-a26d-41d1802d9121')),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:49:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4cac36e0-dc, col_values=(('external_ids', {'iface-id': '4cac36e0-dcd3-4da6-bafb-67426abb9e5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:41:b4', 'vm-uuid': '11aea0f4-ce45-4b05-aa5c-7523aabb6d3b'}),), if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:49:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:49:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:49:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:49:53 user nova-compute[74669]: INFO os_vif [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:41:b4,bridge_name='br-int',has_traffic_filtering=True,id=4cac36e0-dcd3-4da6-bafb-67426abb9e5c,network=Network(e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cac36e0-dc')
Nov 08 17:49:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] No BDM found with device name vda, not building metadata. {{(pid=74669) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 17:49:53 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] No VIF found with MAC fa:16:3e:b0:41:b4, not building metadata {{(pid=74669) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 17:49:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:49:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:49:54 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:49:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-9f29a930-94cb-4d07-94a0-6fa4b2a164ed req-e526120d-0e05-4232-992d-1df64fcc06bd service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Received event network-vif-plugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:49:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9f29a930-94cb-4d07-94a0-6fa4b2a164ed req-e526120d-0e05-4232-992d-1df64fcc06bd service nova] Acquiring lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:49:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9f29a930-94cb-4d07-94a0-6fa4b2a164ed req-e526120d-0e05-4232-992d-1df64fcc06bd service nova] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:49:54 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-9f29a930-94cb-4d07-94a0-6fa4b2a164ed req-e526120d-0e05-4232-992d-1df64fcc06bd service nova] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:49:54 user nova-compute[74669]: DEBUG nova.compute.manager [req-9f29a930-94cb-4d07-94a0-6fa4b2a164ed req-e526120d-0e05-4232-992d-1df64fcc06bd service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] No waiting events found dispatching network-vif-plugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:49:54 user nova-compute[74669]: WARNING nova.compute.manager [req-9f29a930-94cb-4d07-94a0-6fa4b2a164ed req-e526120d-0e05-4232-992d-1df64fcc06bd service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Received unexpected event network-vif-plugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 17:49:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:49:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:49:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:49:56 user nova-compute[74669]: DEBUG nova.compute.manager [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Instance event wait completed in 0 seconds for  {{(pid=74669) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 17:49:56 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Guest created on hypervisor {{(pid=74669) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 17:49:56 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Instance spawned successfully.
Nov 08 17:49:56 user nova-compute[74669]: DEBUG nova.compute.manager [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Checking state {{(pid=74669) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 17:49:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-52671c55-0112-46a8-af5a-bb17e83df37d tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 28.541s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:49:56 user nova-compute[74669]: DEBUG nova.compute.manager [req-acecb418-0cd2-4c23-877e-4e9ca484da5a req-ab1cc749-655d-4252-805e-0ad6c9d462ad service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Received event network-vif-plugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:49:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-acecb418-0cd2-4c23-877e-4e9ca484da5a req-ab1cc749-655d-4252-805e-0ad6c9d462ad service nova] Acquiring lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:49:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-acecb418-0cd2-4c23-877e-4e9ca484da5a req-ab1cc749-655d-4252-805e-0ad6c9d462ad service nova] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:49:56 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-acecb418-0cd2-4c23-877e-4e9ca484da5a req-ab1cc749-655d-4252-805e-0ad6c9d462ad service nova] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:49:56 user nova-compute[74669]: DEBUG nova.compute.manager [req-acecb418-0cd2-4c23-877e-4e9ca484da5a req-ab1cc749-655d-4252-805e-0ad6c9d462ad service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] No waiting events found dispatching network-vif-plugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:49:56 user nova-compute[74669]: WARNING nova.compute.manager [req-acecb418-0cd2-4c23-877e-4e9ca484da5a req-ab1cc749-655d-4252-805e-0ad6c9d462ad service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Received unexpected event network-vif-plugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c for instance with vm_state active and task_state None.
Nov 08 17:49:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:49:59 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:50:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:50:06 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:50:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:50:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:50:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:50:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:50:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:50:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:50:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:50:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:50:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:50:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:50:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:50:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:50:14 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:50:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:50:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:50:23 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:50:24 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:50:26 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:50:28 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:50:31 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:50:33 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:50:33 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:50:33 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:50:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:50:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:50:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:50:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:50:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:50:38 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:50:38 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:50:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:50:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 17:50:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:50:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquired lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:50:38 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Forcefully refreshing network info cache for instance {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 17:50:38 user nova-compute[74669]: DEBUG nova.objects.instance [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lazy-loading 'info_cache' on Instance uuid 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:50:39 user nova-compute[74669]: DEBUG nova.network.neutron [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updating instance_info_cache with network_info: [{"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:50:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Releasing lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:50:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updated the network info_cache for instance {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 17:50:39 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:50:39 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:50:39 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:50:39 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:50:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:50:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:50:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:50:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:50:39 user nova-compute[74669]: DEBUG nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74669) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 17:50:39 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:50:39 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:50:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=8934MB free_disk=25.162940979003906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:50:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:50:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:50:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Instance 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74669) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 17:50:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:50:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:50:39 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:50:39 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:50:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:50:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:50:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:50:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:50:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:50:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:50:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:50:43 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:50:45 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:50:48 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:50:53 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:50:58 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:51:03 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:51:08 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:51:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:51:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:51:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:51:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:51:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:51:13 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:51:18 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquiring lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquiring lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:51:19 user nova-compute[74669]: INFO nova.compute.manager [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Terminating instance
Nov 08 17:51:19 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Start destroying the instance on the hypervisor. {{(pid=74669) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG nova.compute.manager [req-f196fc84-1f71-450d-aef2-6d9e8bbc0a84 req-3eddca4a-ea91-4200-932e-3333d2d3aefc service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Received event network-changed-4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG nova.compute.manager [req-f196fc84-1f71-450d-aef2-6d9e8bbc0a84 req-3eddca4a-ea91-4200-932e-3333d2d3aefc service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Refreshing instance network info cache due to event network-changed-4cac36e0-dcd3-4da6-bafb-67426abb9e5c. {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f196fc84-1f71-450d-aef2-6d9e8bbc0a84 req-3eddca4a-ea91-4200-932e-3333d2d3aefc service nova] Acquiring lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f196fc84-1f71-450d-aef2-6d9e8bbc0a84 req-3eddca4a-ea91-4200-932e-3333d2d3aefc service nova] Acquired lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG nova.network.neutron [req-f196fc84-1f71-450d-aef2-6d9e8bbc0a84 req-3eddca4a-ea91-4200-932e-3333d2d3aefc service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Refreshing network info cache for port 4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG nova.compute.manager [req-319cedf2-84b6-4a0b-a9c5-198b9099f92e req-feca67d2-3949-4196-813f-04199b9e2070 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Received event network-vif-unplugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-319cedf2-84b6-4a0b-a9c5-198b9099f92e req-feca67d2-3949-4196-813f-04199b9e2070 service nova] Acquiring lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-319cedf2-84b6-4a0b-a9c5-198b9099f92e req-feca67d2-3949-4196-813f-04199b9e2070 service nova] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-319cedf2-84b6-4a0b-a9c5-198b9099f92e req-feca67d2-3949-4196-813f-04199b9e2070 service nova] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG nova.compute.manager [req-319cedf2-84b6-4a0b-a9c5-198b9099f92e req-feca67d2-3949-4196-813f-04199b9e2070 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] No waiting events found dispatching network-vif-unplugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG nova.compute.manager [req-319cedf2-84b6-4a0b-a9c5-198b9099f92e req-feca67d2-3949-4196-813f-04199b9e2070 service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Received event network-vif-unplugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c for instance with task_state deleting. {{(pid=74669) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:51:19 user nova-compute[74669]: INFO nova.virt.libvirt.driver [-] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Instance destroyed successfully.
Nov 08 17:51:19 user nova-compute[74669]: DEBUG nova.objects.instance [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lazy-loading 'resources' on Instance uuid 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b {{(pid=74669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG nova.virt.libvirt.vif [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T17:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-84134548',display_name='tempest-TestShelveInstance-server-84134548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-84134548',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDX3a0K3JUIZchChqzIEKuQzW+V0ebQ5ogV1Zzp0Zan78yycXIx2O7mVNuQU9i05Uvha52Zk8jZpqVBh4eulw29UNba9mggifMYNrmnu6VY5bOZlA6tvOx+Ho24EZ3HMZQ==',key_name='tempest-TestShelveInstance-921904317',keypairs=<?>,launch_index=0,launched_at=2023-11-08T17:49:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd40c24d61fa4ef6a44ce175d23b6a4c',ramdisk_id='',reservation_id='r-qfw2qypk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2038104905',owner_user_name='tempest-TestShelveInstance-2038104905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T17:49:57Z,user_data=None,user_id='d8e663b1b12d425d81aec27d1f10bcfd',uuid=11aea0f4-ce45-4b05-aa5c-7523aabb6d3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Converting VIF {"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 17:51:19 user nova-compute[74669]: DEBUG nova.network.os_vif_util [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:41:b4,bridge_name='br-int',has_traffic_filtering=True,id=4cac36e0-dcd3-4da6-bafb-67426abb9e5c,network=Network(e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cac36e0-dc') {{(pid=74669) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG os_vif [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:41:b4,bridge_name='br-int',has_traffic_filtering=True,id=4cac36e0-dcd3-4da6-bafb-67426abb9e5c,network=Network(e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cac36e0-dc') {{(pid=74669) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cac36e0-dc, bridge=br-int, if_exists=True) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fbf6c8d-7ce1-474f-a26d-41d1802d9121) {{(pid=74669) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:51:20 user nova-compute[74669]: INFO os_vif [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:41:b4,bridge_name='br-int',has_traffic_filtering=True,id=4cac36e0-dcd3-4da6-bafb-67426abb9e5c,network=Network(e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cac36e0-dc')
Nov 08 17:51:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] calling os-brick to detach iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd9a83f53c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FwDVlrsj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 17:51:20 user nova-compute[74669]: WARNING os_brick.initiator.connectors.base [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 17:51:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[457f6753-bc87-4ac8-b41a-a4b5f7cdf802]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 17:51:20 user nova-compute[74669]: No targets found.
Nov 08 17:51:20 user nova-compute[74669]: iSNS:
Nov 08 17:51:20 user nova-compute[74669]: No targets found.
Nov 08 17:51:20 user nova-compute[74669]: STATIC:
Nov 08 17:51:20 user nova-compute[74669]: Target: iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66
Nov 08 17:51:20 user nova-compute[74669]:         Portal: 172.16.0.220:3260,-1
Nov 08 17:51:20 user nova-compute[74669]:                 Iface Name: default
Nov 08 17:51:20 user nova-compute[74669]: FIRMWARE:
Nov 08 17:51:20 user nova-compute[74669]: No targets found.
Nov 08 17:51:20 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 17:51:20 user nova-compute[74669]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 17:51:20 user nova-compute[74669]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74669) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66', 0)] {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df6151a-e134-44dd-be07-71c7d1607b22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4c2081-b605-47cb-a981-561be6050b04]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 (non-flash)\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 (non-flash)
Nov 08 17:51:20 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 (non-flash)
Nov 08 17:51:20 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9a86c4310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66'): ({'sdb'}, set())}) {{(pid=74669) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Removing single pathed devices sdb {{(pid=74669) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa01fda-07ff-469f-b20b-3e1788f74ee4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a23e889-daad-4559-929d-4e24a746b73c]: (4, ('ok\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Flushing IO for device /dev/sdb {{(pid=74669) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9cf39d-cd3d-4c78-8f02-b67a60df5b4a]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74669) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4c8463-cf10-467f-b7ba-c434042b137a]: (4, ('1', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG os_brick.initiator.linuxscsi [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] SCSI volumes sdb have been removed. {{(pid=74669) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66')] {{(pid=74669) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cacab6-ce3d-4dd8-9349-07b8d28cfb1e]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --logout {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef61dba6-1c58-49c4-a5ca-4a3a08540477]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66, portal: 172.16.0.220,3260]
Nov 08 17:51:20 user nova-compute[74669]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66, portal: 172.16.0.220,3260] successful.
Nov 08 17:51:20 user nova-compute[74669]:  stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op delete {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86107) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo.privsep.daemon [-] privsep: reply[117b3d64-4c35-4b40-9f64-c4098538e467]: (4, ('', '')) {{(pid=86107) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74669) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.base [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] <== disconnect_volume: return (324ms) None {{(pid=74669) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Disconnected iSCSI Volume {{(pid=74669) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 17:51:20 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Deleting instance files /opt/stack/data/nova/instances/11aea0f4-ce45-4b05-aa5c-7523aabb6d3b_del
Nov 08 17:51:20 user nova-compute[74669]: INFO nova.virt.libvirt.driver [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Deletion of /opt/stack/data/nova/instances/11aea0f4-ce45-4b05-aa5c-7523aabb6d3b_del complete
Nov 08 17:51:20 user nova-compute[74669]: DEBUG nova.network.neutron [req-f196fc84-1f71-450d-aef2-6d9e8bbc0a84 req-3eddca4a-ea91-4200-932e-3333d2d3aefc service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updated VIF entry in instance network info cache for port 4cac36e0-dcd3-4da6-bafb-67426abb9e5c. {{(pid=74669) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG nova.network.neutron [req-f196fc84-1f71-450d-aef2-6d9e8bbc0a84 req-3eddca4a-ea91-4200-932e-3333d2d3aefc service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updating instance_info_cache with network_info: [{"id": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "address": "fa:16:3e:b0:41:b4", "network": {"id": "e748e9bb-f4e7-4282-b7cb-c09b9ecb34f1", "bridge": "br-int", "label": "tempest-TestShelveInstance-438157577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd40c24d61fa4ef6a44ce175d23b6a4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac36e0-dc", "ovs_interfaceid": "4cac36e0-dcd3-4da6-bafb-67426abb9e5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-f196fc84-1f71-450d-aef2-6d9e8bbc0a84 req-3eddca4a-ea91-4200-932e-3333d2d3aefc service nova] Releasing lock "refresh_cache-11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" {{(pid=74669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 17:51:20 user nova-compute[74669]: INFO nova.compute.manager [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 08 17:51:20 user nova-compute[74669]: DEBUG oslo.service.loopingcall [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74669) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG nova.compute.manager [-] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Deallocating network for instance {{(pid=74669) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 17:51:20 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] deallocate_for_instance() {{(pid=74669) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 17:51:21 user nova-compute[74669]: DEBUG nova.network.neutron [-] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Updating instance_info_cache with network_info: [] {{(pid=74669) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 17:51:21 user nova-compute[74669]: INFO nova.compute.manager [-] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Took 0.62 seconds to deallocate network for instance.
Nov 08 17:51:21 user nova-compute[74669]: DEBUG nova.compute.manager [req-b6955025-881b-4cf3-972b-00534644c740 req-a7b7b78a-0773-4049-8706-69ec6aa0b2ad service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Received event network-vif-plugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:51:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b6955025-881b-4cf3-972b-00534644c740 req-a7b7b78a-0773-4049-8706-69ec6aa0b2ad service nova] Acquiring lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:51:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b6955025-881b-4cf3-972b-00534644c740 req-a7b7b78a-0773-4049-8706-69ec6aa0b2ad service nova] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:51:21 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [req-b6955025-881b-4cf3-972b-00534644c740 req-a7b7b78a-0773-4049-8706-69ec6aa0b2ad service nova] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:51:21 user nova-compute[74669]: DEBUG nova.compute.manager [req-b6955025-881b-4cf3-972b-00534644c740 req-a7b7b78a-0773-4049-8706-69ec6aa0b2ad service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] No waiting events found dispatching network-vif-plugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 17:51:21 user nova-compute[74669]: WARNING nova.compute.manager [req-b6955025-881b-4cf3-972b-00534644c740 req-a7b7b78a-0773-4049-8706-69ec6aa0b2ad service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Received unexpected event network-vif-plugged-4cac36e0-dcd3-4da6-bafb-67426abb9e5c for instance with vm_state active and task_state deleting.
Nov 08 17:51:21 user nova-compute[74669]: DEBUG nova.compute.manager [req-b6955025-881b-4cf3-972b-00534644c740 req-a7b7b78a-0773-4049-8706-69ec6aa0b2ad service nova] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Received event network-vif-deleted-4cac36e0-dcd3-4da6-bafb-67426abb9e5c {{(pid=74669) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 17:51:22 user nova-compute[74669]: INFO nova.compute.manager [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Took 0.93 seconds to detach 1 volumes for instance.
Nov 08 17:51:22 user nova-compute[74669]: DEBUG nova.compute.manager [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] [instance: 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b] Deleting volume: ff4f8621-ead9-4ec0-b7eb-9cea00b96f66 {{(pid=74669) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 17:51:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:51:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:51:22 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:51:22 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:51:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:51:22 user nova-compute[74669]: INFO nova.scheduler.client.report [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Deleted allocations for instance 11aea0f4-ce45-4b05-aa5c-7523aabb6d3b
Nov 08 17:51:22 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-5de54fd7-f276-4c46-a704-b21e778edf1a tempest-TestShelveInstance-2038104905 tempest-TestShelveInstance-2038104905-project-member] Lock "11aea0f4-ce45-4b05-aa5c-7523aabb6d3b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.109s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:51:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:51:27 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:51:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:51:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:51:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74669) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 17:51:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:51:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74669) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 17:51:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:51:33 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:51:33 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:51:34 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:51:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:51:38 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:51:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:51:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 17:51:38 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Didn't find any instances for network info cache update. {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 17:51:38 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:51:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:51:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:51:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:51:38 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:51:39 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:51:39 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:51:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=9092MB free_disk=25.162158966064453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:51:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:51:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:51:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:51:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:51:39 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:51:39 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:51:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:51:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:51:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:51:40 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:51:40 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:51:40 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:51:45 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:51:45 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:51:50 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:51:55 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:52:00 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:52:05 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:52:09 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:52:10 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:52:11 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:52:12 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:52:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:52:15 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:52:20 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:52:25 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:52:29 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:52:30 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:52:34 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:52:34 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:52:35 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 17:52:35 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:52:38 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:52:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:52:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:52:38 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:52:38 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Auditing locally available compute resources for user (node: user) {{(pid=74669) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 17:52:39 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:52:39 user nova-compute[74669]: WARNING nova.virt.libvirt.driver [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 17:52:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Hypervisor/Node resource view: name=user free_ram=9233MB free_disk=25.107471466064453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74669) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 17:52:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 17:52:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 17:52:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 17:52:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74669) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 17:52:39 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing inventories for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 17:52:39 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Updating ProviderTree inventory for provider ce26964b-e55b-43d2-801a-7221ff1fe64b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 17:52:39 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Updating inventory in ProviderTree for provider ce26964b-e55b-43d2-801a-7221ff1fe64b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 17:52:39 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing aggregate associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, aggregates: None {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 17:52:39 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Refreshing trait associations for resource provider ce26964b-e55b-43d2-801a-7221ff1fe64b, traits: HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=74669) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 17:52:39 user nova-compute[74669]: DEBUG nova.compute.provider_tree [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed in ProviderTree for provider: ce26964b-e55b-43d2-801a-7221ff1fe64b {{(pid=74669) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 17:52:39 user nova-compute[74669]: DEBUG nova.scheduler.client.report [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Inventory has not changed for provider ce26964b-e55b-43d2-801a-7221ff1fe64b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74669) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 17:52:39 user nova-compute[74669]: DEBUG nova.compute.resource_tracker [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Compute_service record updated for user:user {{(pid=74669) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 17:52:39 user nova-compute[74669]: DEBUG oslo_concurrency.lockutils [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=74669) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 17:52:40 user nova-compute[74669]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74669) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 17:52:40 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:52:40 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74669) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 17:52:40 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 17:52:40 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Starting heal instance info cache {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 17:52:40 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Rebuilding the list of instances to heal {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 17:52:40 user nova-compute[74669]: DEBUG nova.compute.manager [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Didn't find any instances for network info cache update. {{(pid=74669) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 17:52:41 user nova-compute[74669]: DEBUG oslo_service.periodic_task [None req-d145c5c8-7477-4b49-8305-7746ca994407 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74669) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}